2025-11-10T09:39:03.522695Z node 12 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[12:7571028951130337729:2077];send_to=[0:7307199536658146131:7762515];
2025-11-10T09:39:03.522774Z node 12 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/fhvo/0016b6/r3tmp/tmpmI1Umu/pdisk_1.dat
2025-11-10T09:39:03.720332Z node 12 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-10T09:39:03.745194Z node 12 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-10T09:39:03.789731Z node 13 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-10T09:39:03.811509Z node 13 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-10T09:39:03.813875Z node 13 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-10T09:39:03.937157Z node 12 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-10T09:39:03.991857Z node 13 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-10T09:39:04.220977Z node 12 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(12, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-10T09:39:04.233391Z node 12 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(12, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-10T09:39:04.234705Z node 12 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(13, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-10T09:39:04.234794Z node 12 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(13, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-10T09:39:04.235609Z node 12 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-10T09:39:04.263733Z node 12 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-10T09:39:04.268162Z node 12 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 13 Cookie 13
2025-11-10T09:39:04.268330Z node 12 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(12, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-10T09:39:04.271059Z node 12 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(13, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 5412, node 12
2025-11-10T09:39:04.482158Z node 13 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-10T09:39:04.525665Z node 12 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/fhvo/0016b6/r3tmp/yandexpXSOZu.tmp
2025-11-10T09:39:04.525698Z node 12 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/fhvo/0016b6/r3tmp/yandexpXSOZu.tmp
2025-11-10T09:39:04.525857Z node 12 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/fhvo/0016b6/r3tmp/yandexpXSOZu.tmp
2025-11-10T09:39:04.526047Z node 12 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-10T09:39:04.634027Z INFO: TTestServer started on Port 29198 GrpcPort 5412
2025-11-10T09:39:04.666437Z node 12 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-10T09:39:04.697812Z node 13 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:29198
PQClient connected to localhost:5412
WaitRootIsUp 'Root'...
TClient::Ls request: Root
2025-11-10T09:39:05.441133Z node 12 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-10T09:39:05.454851Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-11-10T09:39:05.868836Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
waiting...
2025-11-10T09:39:06.148415Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976710660, at schemeshard: 72057594046644480
waiting...
2025-11-10T09:39:08.525328Z node 12 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[12:7571028951130337729:2077];send_to=[0:7307199536658146131:7762515];
2025-11-10T09:39:08.525432Z node 12 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-10T09:39:12.215513Z node 12 :KQP_PROXY ERROR: kqp_proxy_service.cpp:1316: TraceId: "01k9pj49wa2zsn02b0pfvmw38g", Request deadline has expired for 0.966408s seconds
2025-11-10T09:39:12.224113Z node 12 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [12:7571028989785044559:2342], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-10T09:39:12.224224Z node 12 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [12:7571028989785044543:2339], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-10T09:39:12.225236Z node 12 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-10T09:39:12.228622Z node 12 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [12:7571028989785044576:2345], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-10T09:39:12.228790Z node 12 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-10T09:39:12.232731Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976710662:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-10T09:39:12.245512Z node 12 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [12:7571028989785044610:2347], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-10T09:39:12.245631Z node 12 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-10T09:39:12.248785Z node 12 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [12:7571028989785044612:2348], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-10T09:39:12.248902Z node 12 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-10T09:39:12.355586Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-10T09:39:12.415387Z node 12 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [12:7571028989785044575:2344], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976710662 completed, doublechecking }
2025-11-10T09:39:12.493294Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-10T09:39:12.506308Z node 12 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [12:7571028989785044832:2920] txid# 281474976710665, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 9], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-10T09:39:12.580784Z node 12 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [12:7571028989785044850:2364], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-10T09:39:12.581374Z node 12 :KQP_SESSION WARN: kqp_session_actor.cpp:2520: SessionId: ydb://session/3?node_id=12&id=NTU4NjJmYzktZjc4ZTJjOWUtM2JiMmJmNjktNzIyNDVmMmU=, ActorId: [12:7571028989785044534:2336], ActorState: ExecuteState, TraceId: 01k9pj4fpt0184fgv4z28zcq01, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-10T09:39:12.581927Z node 12 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-10T09:39:12.591747Z node 13 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [13:7571028986653531249:2314], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-10T09:39:12.593699Z node 13 :KQP_SESSION WARN: kqp_session_actor.cpp:2520: SessionId: ydb://session/3?node_id=13&id=MTUxZjE3NzMtOTkxNGQ5MWUtMWU4NmVlMGItZWE4OTE2NWQ=, ActorId: [13:7571028986653531200:2306], ActorState: ExecuteState, TraceId: 01k9pj4g0k1ay4121tbssdg718, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-10T09:39:12.594331Z node 13 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-10T09:39:12.711124Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710666:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-11-10T09:39:13.195499Z node 12 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710667. Ctx: { TraceId: 01k9pj4gcm46k7s192z0egmg11, Database: , SessionId: ydb://session/3?node_id=12&id=NjllNjNhM2EtODI1YTk4YTAtNTFjMzAyNDMtNzhlNjY2Nzg=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [12:7571028994080012428:3138] 
2025-11-10T09:39:19.093209Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7737: Cannot get console configs
2025-11-10T09:39:19.093246Z node 12 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 2 partitions
CallPersQueueGRPC request to localhost:5412
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-10T09:39:21.381791Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:5412
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 2
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-11-10T09:39:21.470851Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [12:7571029028439751239:3392] connected; active server actors: 1
2025-11-10T09:39:21.471115Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [1, 0]
2025-11-10T09:39:21.471888Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-10T09:39:21.474530Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) (1, 72075186224037892) 
2025-11-10T09:39:21.480533Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-10T09:39:21.483722Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-10T09:39:21.484000Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-10T09:39:21.484038Z node 13 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-10T09:39:21.484085Z node 13 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-10T09:39:21.484681Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [12:7571029028439751236:3389], now have 1 active actors on pipe
2025-11-10T09:39:21.484714Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [12:7571029028439751266:2474], now have 1 active actors on pipe
2025-11-10T09:39:21.485650Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-10T09:39:21.485804Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 13, Generation 1
2025-11-10T09:39:21.490937Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-10T09:39:21.499625Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [12:7571029028439751301:3441], now have 1 active actors on pipe
2025-11-10T09:39:21.500860Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-10T09:39:21.505166Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-10T09:39:21.506891Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:1:Initializer] Start initializing step TInitConfigStep
2025-11-10T09:39:21.506922Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-11-10T09:39:21.506957Z node 13 :PERSQUEUE DEBUG: partition.cpp:1313: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-10T09:39:21.506981Z node 13 :PERSQUEUE DEBUG: partition.cpp:1313: [72075186224037892][Partition][1][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-10T09:39:21.507394Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:1:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-10T09:39:21.510125Z node 13 :PERSQUEUE INFO: partition_init.cpp:1102: [72075186224037892][Partition][1][StateInit] bootstrapping 1 [13:7571029025308237139:2366]
2025-11-10T09:39:21.512809Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:1:Initializer] Start initializing step TInitFieldsStep
2025-11-10T09:39:21.512847Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:1:Initializer] Initializing completed.
2025-11-10T09:39:21.512880Z node 13 :PERSQUEUE INFO: partition.cpp:708: [72075186224037892][Partition][1][StateInit] init complete for topic 'rt3.dc1--topic1' partition 1 generation 1 [13:7571029025308237139:2366]
2025-11-10T09:39:21.512920Z node 13 :PERSQUEUE DEBUG: partition.cpp:728: [72075186224037892][Partition][1][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 1 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-10T09:39:21.512964Z node 13 :PERSQUEUE DEBUG: partition_mlp.cpp:107: [72075186224037892][Partition][1][StateIdle] Initializing MLP Consumers: 0
2025-11-10T09:39:21.514635Z node 13 :PERSQUEUE DEBUG: partition.cpp:4403: [72075186224037892][Partition][1][StateIdle] Process pending events. Count 1
2025-11-10T09:39:21.514713Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:21.514746Z node 13 :PERSQUEUE DEBUG: partition.cpp:2397: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ProposeConfig])
2025-11-10T09:39:21.514816Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:21.514835Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:21.514860Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:21.514874Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:21.514909Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:21.514925Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:21.514940Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:21.514962Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:21.514976Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:21.515022Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-10T09:39:21.515073Z node 13 :PERSQUEUE DEBUG: partition_mlp.cpp:70: [72075186224037892][Partition][1][StateIdle] Process MLP pending events. Count 0
2025-11-10T09:39:21.515297Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-10T09:39:21.515583Z node 13 :PERSQUEUE INFO: partition_init.cpp:1102: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [13:7571029025308237140:2366]
2025-11-10T09:39:21.519086Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-11-10T09:39:21.519131Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-11-10T09:39:21.519175Z node 13 :PERSQUEUE INFO: partition.cpp:708: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [13:7571029025308237140:2366]
2025-11-10T09:39:21.519217Z node 13 :PERSQUEUE DEBUG: partition.cpp:728: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-10T09:39:21.519258Z node 13 :PERSQUEUE DEBUG: partition_mlp.cpp:107: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-10T09:39:21.520662Z node 13 :PERSQUEUE DEBUG: partition.cpp:4403: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-10T09:39:21.520699Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:21.520728Z node 13 :PERSQUEUE DEBUG: partition.cpp:2397: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ProposeConfig])
2025-11-10T09:39:21.520773Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:21.520789Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:21.520812Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:21.520826Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:21.520857Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:21.520873Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:21.520887Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:21.520904Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:21.520918Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:21.520959Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-10T09:39:21.521006Z node 13 :PERSQUEUE DEBUG: partition_mlp.cpp:70: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-10T09:39:21.522296Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-11-10T09:39:21.522647Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-10T09:39:21.522783Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T09:39:21.537239Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-10T09:39:21.537423Z node 13 :PERSQUEUE DEBUG: partition.cpp:1425: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762767561541, TxId 281474976710672
2025-11-10T09:39:21.537528Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:21.537549Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:21.537569Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:21.537612Z node 13 :PERSQUEUE DEBUG: partition.cpp:2461: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ProposeConfig])
2025-11-10T09:39:21.537675Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:21.537693Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T09:39:21.537717Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:21.537961Z node 13 :PERSQUEUE DEBUG: partition.cpp:1425: [72075186224037892][Partition][1][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762767561541, TxId 281474976710672
2025-11-10T09:39:21.538019Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:21.538031Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:21.538041Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:21.538064Z node 13 :PERSQUEUE DEBUG: partition.cpp:2461: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ProposeConfig])
2025-11-10T09:39:21.538090Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:21.538101Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-10T09:39:21.538114Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:21.538238Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T09:39:21.538274Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T09:39:21.543478Z node 13 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T09:39:21.543798Z node 13 :PERSQUEUE DEBUG: partition_mlp.cpp:107: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-10T09:39:21.543963Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T09:39:21.543990Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:21.544007Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.544023Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:21.544042Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.544059Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:21.544090Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T09:39:21.544125Z node 13 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T09:39:21.544289Z node 13 :PERSQUEUE DEBUG: partition_mlp.cpp:107: [72075186224037892][Partition][1][StateIdle] Initializing MLP Consumers: 0
2025-11-10T09:39:21.544368Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T09:39:21.544382Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:21.544393Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.544404Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:21.544418Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.544428Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:21.544445Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-11-10T09:39:21.544936Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 2 SourceIdMaxCounts: 6000000 } PartitionIds: 1 PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-10T09:39:21.545075Z node 13 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-10T09:39:21.545431Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-10T09:39:21.554827Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-10T09:39:21.554924Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-10T09:39:21.557588Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-10T09:39:21.610543Z node 12 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710673. Ctx: { TraceId: 01k9pj4rqtchd0c029wssas5b5, Database: , SessionId: ydb://session/3?node_id=12&id=ZmEzZjVkOTEtZjg1YzNjYzctMWMxMGJiZTEtZGYyNzUxMTY=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-10T09:39:21.615251Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:21.615291Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.615317Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:21.615344Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.615363Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:21.621796Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:21.621843Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.621865Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:21.621889Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.621906Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762767561541
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 13
    TotalGroupCount: 2
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 600000...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762767561541
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 13
    TotalGroupCount: 2
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 1
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 2
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 2
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:5412
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
CallPersQueueGRPC response:
2025-11-10T09:39:21.659132Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-10T09:39:21.684610Z :INFO: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] Starting read session
2025-11-10T09:39:21.684691Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] Starting session to cluster null (localhost:5412)
2025-11-10T09:39:21.691001Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-10T09:39:21.691063Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-10T09:39:21.691137Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] Reconnecting session to cluster null in 0.000000s
===== CreateReader =====
MessagesInflight: 0
BytesInflightUncompressed: 0
BytesInflightCompressed: 0
BytesInflightTotal: 0
============
2025-11-10T09:39:21.695097Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] Successfully connected. Initializing session
2025-11-10T09:39:21.695584Z node 12 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-10T09:39:21.695621Z node 12 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-10T09:39:21.696082Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-10T09:39:21.696300Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 read init: from# ipv6:[::1]:41250, request# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-10T09:39:21.696757Z node 12 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 auth for : user
2025-11-10T09:39:21.697388Z node 12 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 Handle describe topics response
2025-11-10T09:39:21.697557Z node 12 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 auth is DEAD
2025-11-10T09:39:21.697655Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 auth ok: topics# 1, initDone# 0
2025-11-10T09:39:21.698876Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 register session: topic# rt3.dc1--topic1
2025-11-10T09:39:21.699186Z :INFO: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] Server session id: shared/user_12_1_421379334442898555_v1
2025-11-10T09:39:21.699232Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029028439751380:2489] connected; active server actors: 1
2025-11-10T09:39:21.699279Z node 12 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--topic1] consumer "user" register session for pipe [12:7571029028439751380:2489] session shared/user_12_1_421379334442898555_v1
2025-11-10T09:39:21.699338Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--topic1] consumer user register readable partition 0
2025-11-10T09:39:21.699429Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--topic1] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-10T09:39:21.699464Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--topic1] consumer user register readable partition 1
2025-11-10T09:39:21.699598Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-10T09:39:21.699498Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--topic1] consumer user family created family=2 (Status=Free, Partitions=[1])
2025-11-10T09:39:21.699585Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--topic1] consumer user register reading session ReadingSession "shared/user_12_1_421379334442898555_v1" (Sender=[12:7571029028439751377:2489], Pipe=[12:7571029028439751380:2489], Partitions=[], ActiveFamilyCount=0)
2025-11-10T09:39:21.699628Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--topic1] consumer user rebalancing was scheduled
2025-11-10T09:39:21.699702Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--topic1] consumer user balancing. Sessions=1, Families=2, UnradableFamilies=2 [2 (1), 1 (0), ], RequireBalancing=0 []
2025-11-10T09:39:21.699794Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--topic1] consumer user balancing family=2 (Status=Free, Partitions=[1]) for ReadingSession "shared/user_12_1_421379334442898555_v1" (Sender=[12:7571029028439751377:2489], Pipe=[12:7571029028439751380:2489], Partitions=[], ActiveFamilyCount=0)
2025-11-10T09:39:21.699883Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--topic1] consumer user family 2 status Active partitions [1] session "shared/user_12_1_421379334442898555_v1" sender [12:7571029028439751377:2489] lock partition 1 for ReadingSession "shared/user_12_1_421379334442898555_v1" (Sender=[12:7571029028439751377:2489], Pipe=[12:7571029028439751380:2489], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-10T09:39:21.699967Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--topic1] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_12_1_421379334442898555_v1" (Sender=[12:7571029028439751377:2489], Pipe=[12:7571029028439751380:2489], Partitions=[], ActiveFamilyCount=1)
2025-11-10T09:39:21.700015Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--topic1] consumer user family 1 status Active partitions [0] session "shared/user_12_1_421379334442898555_v1" sender [12:7571029028439751377:2489] lock partition 0 for ReadingSession "shared/user_12_1_421379334442898555_v1" (Sender=[12:7571029028439751377:2489], Pipe=[12:7571029028439751380:2489], Partitions=[], ActiveFamilyCount=2) generation 1 step 2
2025-11-10T09:39:21.700068Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--topic1] consumer user start rebalancing. familyCount=2, sessionCount=1, desiredFamilyCount=2, allowPlusOne=0
2025-11-10T09:39:21.700119Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--topic1] consumer user balancing duration: 0.000372s
2025-11-10T09:39:21.700911Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 assign: record# { Partition: 1 TabletId: 72075186224037892 Topic: "rt3.dc1--topic1" Generation: 1 Step: 1 Session: "shared/user_12_1_421379334442898555_v1" ClientId: "user" PipeClient { RawX1: 7571029028439751380 RawX2: 4503651166980537 } Path: "/Root/PQ/rt3.dc1--topic1" }
2025-11-10T09:39:21.701035Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 INITING TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)
2025-11-10T09:39:21.701102Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--topic1" Generation: 1 Step: 2 Session: "shared/user_12_1_421379334442898555_v1" ClientId: "user" PipeClient { RawX1: 7571029028439751380 RawX2: 4503651166980537 } Path: "/Root/PQ/rt3.dc1--topic1" }
2025-11-10T09:39:21.701160Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 grpc read done: success# 1, data# { read { } }
2025-11-10T09:39:21.701173Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 INITING TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)
2025-11-10T09:39:21.701270Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 got read request: guid# 6e0564a5-837d5169-26c9a149-1f7fea0b
2025-11-10T09:39:21.704558Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [12:7571029028439751383:2492]
2025-11-10T09:39:21.704674Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [12:7571029028439751385:2493]
2025-11-10T09:39:21.704792Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [12:7571029028439751383:2492], now have 1 active actors on pipe
2025-11-10T09:39:21.704836Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [12:7571029028439751385:2493], now have 1 active actors on pipe
2025-11-10T09:39:21.705275Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:21.705320Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:21.705367Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_12_1_421379334442898555_v1 on pipe: [12:7571029028439751383:2492]
2025-11-10T09:39:21.705443Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:21.705444Z node 13 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_12_1_421379334442898555_v1:1 with generation 1
2025-11-10T09:39:21.705459Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:21.705479Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_12_1_421379334442898555_v1 on pipe: [12:7571029028439751385:2493]
2025-11-10T09:39:21.705500Z node 13 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_12_1_421379334442898555_v1:2 with generation 1
2025-11-10T09:39:21.705542Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:21.705572Z node 13 :PERSQUEUE DEBUG: partition.cpp:2390: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TEvPQ::TEvSetClientInfo)
2025-11-10T09:39:21.705612Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:21.705630Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:21.705680Z node 13 :PERSQUEUE DEBUG: partition.cpp:2454: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TEvPQ::TEvSetClientInfo)
2025-11-10T09:39:21.705750Z node 13 :PERSQUEUE DEBUG: partition.cpp:3796: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 user user session is set to 0 (startOffset 0) session shared/user_12_1_421379334442898555_v1
2025-11-10T09:39:21.705773Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:21.705792Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-10T09:39:21.705815Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:21.705999Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:21.706015Z node 13 :PERSQUEUE DEBUG: partition.cpp:2390: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TEvPQ::TEvSetClientInfo)
2025-11-10T09:39:21.706040Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:21.706052Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:21.706067Z node 13 :PERSQUEUE DEBUG: partition.cpp:2454: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TEvPQ::TEvSetClientInfo)
2025-11-10T09:39:21.706101Z node 13 :PERSQUEUE DEBUG: partition.cpp:3796: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user session is set to 0 (startOffset 0) session shared/user_12_1_421379334442898555_v1
2025-11-10T09:39:21.706112Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:21.706124Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T09:39:21.706136Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:21.706232Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T09:39:21.706269Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T09:39:21.712164Z node 13 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T09:39:21.712278Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T09:39:21.712313Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:21.712335Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.712356Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:21.712378Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.712397Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:21.712427Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-11-10T09:39:21.712454Z node 13 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T09:39:21.712501Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T09:39:21.712516Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:21.712528Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.712538Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:21.712549Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.712560Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:21.712574Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T09:39:21.712616Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-10T09:39:21.713097Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1762767561615 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-10T09:39:21.712672Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-10T09:39:21.713099Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1762767561621 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-10T09:39:21.713160Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 INIT DONE TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 0 readOffset 0 committedOffset 0
2025-11-10T09:39:21.713161Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 INIT DONE TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-11-10T09:39:21.713223Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 sending to client partition status
2025-11-10T09:39:21.713475Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 sending to client partition status
CreatePartitionStream { PartitionStreamId: 1 TopicPath: topic1 Cluster: dc1 PartitionId: 1 CommittedOffset: 0 EndOffset: 0 }
2025-11-10T09:39:21.714107Z :INFO: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "topic1". Partition: 1. Read offset: (NULL)
2025-11-10T09:39:21.715631Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:21.715680Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.715704Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:21.715732Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.715759Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
CreatePartitionStream { PartitionStreamId: 2 TopicPath: topic1 Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 0 }
2025-11-10T09:39:21.717759Z :INFO: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] Confirm partition stream create. Partition stream id: 2. Cluster: "dc1". Topic: "topic1". Partition: 0. Read offset: (NULL)
2025-11-10T09:39:21.718369Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: try to update token
2025-11-10T09:39:21.718952Z :INFO: [] MessageGroupId [source0] SessionId [] Write session: Do CDS request
2025-11-10T09:39:21.719023Z :INFO: [] MessageGroupId [source0] SessionId [] Start write session. Will connect to endpoint: localhost:5412
2025-11-10T09:39:21.722772Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 grpc read done: success# 1, data# { start_read { topic { path: "topic1" } cluster: "dc1" partition: 1 assign_id: 1 } }
2025-11-10T09:39:21.722943Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 0, commitOffset# 0
2025-11-10T09:39:21.723009Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 grpc read done: success# 1, data# { start_read { topic { path: "topic1" } cluster: "dc1" assign_id: 2 } }
2025-11-10T09:39:21.723112Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 0, commitOffset# 0
2025-11-10T09:39:21.723181Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 Start reading TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-10T09:39:21.723230Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-11-10T09:39:21.723327Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 Start reading TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-10T09:39:21.723350Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 1 from offset 0
2025-11-10T09:39:21.724141Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source0" }
2025-11-10T09:39:21.725071Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:21.725118Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.725138Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:21.725163Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.725180Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:21.725348Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-10T09:39:21.725389Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-10T09:39:21.725795Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source0" }
2025-11-10T09:39:21.725953Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "topic1" message_group_id: "source0" from ipv6:[::1]:41250
2025-11-10T09:39:21.725976Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:41250 proto=v1  topic=topic1 durationSec=0
2025-11-10T09:39:21.725985Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-10T09:39:21.728202Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-10T09:39:21.728375Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-10T09:39:21.728388Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-10T09:39:21.728404Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-10T09:39:21.728428Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7571029028439751389:2494] (SourceId=source0, PreferedPartition=(NULL)) StartKqpSession
2025-11-10T09:39:21.733075Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7571029028439751389:2494] (SourceId=source0, PreferedPartition=(NULL)) Select from the table
2025-11-10T09:39:21.816048Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:21.816101Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.816125Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:21.816152Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.816170Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:21.828012Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:21.828061Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.828084Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:21.828112Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.828131Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:21.916322Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:21.916367Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.916388Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:21.916415Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.916434Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:21.927189Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:21.927236Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.927257Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:21.927279Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:21.927295Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:21.968069Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7571029028439751389:2494] (SourceId=source0, PreferedPartition=(NULL)) RequestPQRB
2025-11-10T09:39:21.969508Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029028439751429:2494] connected; active server actors: 1
2025-11-10T09:39:21.969664Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7571029028439751389:2494] (SourceId=source0, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=source0
2025-11-10T09:39:21.969689Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7571029028439751389:2494] (SourceId=source0, PreferedPartition=(NULL)) Update the table
2025-11-10T09:39:21.973282Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029028439751429:2494] disconnected.
2025-11-10T09:39:21.973329Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029028439751429:2494] disconnected; active server actors: 1
2025-11-10T09:39:21.973357Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029028439751429:2494] disconnected no session
2025-11-10T09:39:22.021070Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.021112Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.021131Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.021155Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.021171Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.029143Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:22.029181Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.029199Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.029222Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.029238Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:22.118550Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [12:7571029032734718747:2494], now have 1 active actors on pipe
2025-11-10T09:39:22.118987Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.116430Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7571029028439751389:2494] (SourceId=source0, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-10T09:39:22.119020Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:22.119111Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source0|a573ffff-a41c608c-8a67f961-ff00e264_0 generated for partition 1 topic 'rt3.dc1--topic1' owner source0
2025-11-10T09:39:22.119157Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.116479Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7571029028439751389:2494] (SourceId=source0, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-11-10T09:39:22.119175Z node 13 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T09:39:22.116509Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7571029028439751389:2494] (SourceId=source0, PreferedPartition=(NULL)) Start idle
2025-11-10T09:39:22.119197Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:22.116548Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-11-10T09:39:22.119219Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.118717Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-11-10T09:39:22.119242Z node 13 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T09:39:22.119295Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:22.120927Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 1 MaxSeqNo: 0 sessionId: source0|a573ffff-a41c608c-8a67f961-ff00e264_0
2025-11-10T09:39:22.119314Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-10T09:39:22.119341Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.119401Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyOwnerOk. Partition: 1
2025-11-10T09:39:22.119483Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:22.120443Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.120487Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:22.120578Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:22.121567Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.121594Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.121615Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.121645Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.121663Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.124878Z :INFO: [] MessageGroupId [source0] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762767562124 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-10T09:39:22.125023Z :INFO: [] MessageGroupId [source0] SessionId [] Write session established. Init response: session_id: "source0|a573ffff-a41c608c-8a67f961-ff00e264_0" topic: "topic1" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-10T09:39:22.125749Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a573ffff-a41c608c-8a67f961-ff00e264_0] Write 1 messages with Id from 1 to 1
2025-11-10T09:39:22.125893Z :INFO: [] MessageGroupId [source0] SessionId [source0|a573ffff-a41c608c-8a67f961-ff00e264_0] Write session: close. Timeout = 10000 ms
2025-11-10T09:39:22.128811Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a573ffff-a41c608c-8a67f961-ff00e264_0] Write session: try to update token
2025-11-10T09:39:22.128871Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a573ffff-a41c608c-8a67f961-ff00e264_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-10T09:39:22.129316Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:22.129360Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.129387Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.129415Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.129433Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:22.130148Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|a573ffff-a41c608c-8a67f961-ff00e264_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-10T09:39:22.130439Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-10T09:39:22.130982Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.131034Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:22.131145Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-11-10T09:39:22.131417Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-11-10T09:39:22.131990Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.132020Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:22.132529Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 1 SourceId: '\0source0' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-10T09:39:22.132603Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][1][StateIdle] Received TPartition::TEvWrite
2025-11-10T09:39:22.132665Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.132700Z node 13 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T09:39:22.132743Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:22.132761Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.132792Z node 13 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T09:39:22.132928Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId '\0source0' seqNo 1 partNo 0
2025-11-10T09:39:22.133878Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId '\0source0' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 173 count 1 nextOffset 1 batches 1
2025-11-10T09:39:22.133942Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:22.133964Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-10T09:39:22.133987Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.134750Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][1][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000001_00000000000000000000_00000_0000000001_00000? size 161 WTime 1762767562131
2025-11-10T09:39:22.134975Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T09:39:22.135147Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 1 offset 0 partNo 0 count 1 size 161
2025-11-10T09:39:22.140292Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 1 offset 0 count 1 size 161 actorID [13:7571029025308237122:2366]
2025-11-10T09:39:22.140380Z node 13 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T09:39:22.140454Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T09:39:22.140496Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyWrite. Partition: 1
2025-11-10T09:39:22.140545Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][1][StateIdle] Answering for message sourceid: '\0source0', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-10T09:39:22.140817Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-10T09:39:22.140818Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 1 offset 0 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-10T09:39:22.140850Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-10T09:39:22.140880Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.140898Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.140917Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.140938Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.140955Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.140990Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-11-10T09:39:22.141039Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 1  requestId: <none> cookie: 1
2025-11-10T09:39:22.141183Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][1][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 1 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-10T09:39:22.141464Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][1][StateIdle] read cookie 3 added 1 blobs, size 161 count 1 last offset 0, current partition end offset: 1
2025-11-10T09:39:22.141489Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][1][StateIdle] Reading cookie 3. Send blob request.
2025-11-10T09:39:22.141728Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-11-10T09:39:22.141536Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 1 offset 0 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-10T09:39:22.000000Z
2025-11-10T09:39:22.141572Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-10T09:39:22.141773Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) ready for read with readOffset 0 endOffset 1
2025-11-10T09:39:22.141617Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-10T09:39:22.141852Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 161
2025-11-10T09:39:22.141795Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-10T09:39:22.141869Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1TEvPartitionReady. Aval parts: 1
2025-11-10T09:39:22.141879Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--topic1' partition 1 user user readTimeStamp done, result 1762767562131 queuesize 0 startOffset 0
2025-11-10T09:39:22.141919Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 performing read request: guid# 6e0564a5-837d5169-26c9a149-1f7fea0b, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-10T09:39:22.142013Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 6e0564a5-837d5169-26c9a149-1f7fea0b
2025-11-10T09:39:22.142794Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 1 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-10T09:39:22.143004Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.143040Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:22.143144Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][1][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 1 user user offset 0 partno 0 count 1 size 193 endOffset 1 max time lag 0ms effective offset 0
2025-11-10T09:39:22.143370Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][1][StateIdle] read cookie 4 added 1 blobs, size 161 count 1 last offset 0, current partition end offset: 1
2025-11-10T09:39:22.143400Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][1][StateIdle] Reading cookie 4. Send blob request.
2025-11-10T09:39:22.143439Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 1 offset 0 partno 0 count 1 parts_count 0 source 1 size 161 accessed 1 times before, last time 2025-11-10T09:39:22.000000Z
2025-11-10T09:39:22.143499Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-10T09:39:22.143539Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-10T09:39:22.143700Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-10T09:39:22.143804Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:22.144015Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-11-10T09:39:22.144571Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 1 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-10T09:39:22.145246Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a573ffff-a41c608c-8a67f961-ff00e264_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false partition_id: 1 write_statistics { persist_duration_ms: 8 }
2025-11-10T09:39:22.145320Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a573ffff-a41c608c-8a67f961-ff00e264_0] Write session: acknoledged message 1
2025-11-10T09:39:22.145015Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 98 bytes ..." SourceId: "\000source0" SeqNo: 1 WriteTimestampMS: 1762767562131 CreateTimestampMS: 1762767562125 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-11-10T09:39:22.145167Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-11-10T09:39:22.145203Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 6e0564a5-837d5169-26c9a149-1f7fea0b has messages 1
2025-11-10T09:39:22.145327Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 read done: guid# 6e0564a5-837d5169-26c9a149-1f7fea0b, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), size# 197
2025-11-10T09:39:22.145352Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 response to read: guid# 6e0564a5-837d5169-26c9a149-1f7fea0b
2025-11-10T09:39:22.145540Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 Process answer. Aval parts: 0
2025-11-10T09:39:22.146329Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-10T09:39:22.146687Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 grpc read done: success# 1, data# { read { } }
2025-11-10T09:39:22.146800Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 got read request: guid# fd4e7224-172c4d64-f87a5f35-fe458d0d
2025-11-10T09:39:22.221976Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.222026Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.222048Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.222076Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.222095Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.229139Z :INFO: [] MessageGroupId [source0] SessionId [source0|a573ffff-a41c608c-8a67f961-ff00e264_0] Write session will now close
2025-11-10T09:39:22.229229Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a573ffff-a41c608c-8a67f961-ff00e264_0] Write session: aborting
2025-11-10T09:39:22.229817Z :INFO: [] MessageGroupId [source0] SessionId [source0|a573ffff-a41c608c-8a67f961-ff00e264_0] Write session: gracefully shut down, all writes complete
2025-11-10T09:39:22.229881Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a573ffff-a41c608c-8a67f961-ff00e264_0] Write session: destroy
2025-11-10T09:39:22.232384Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: try to update token
2025-11-10T09:39:22.232687Z :INFO: [] MessageGroupId [source1] SessionId [] Write session: Do CDS request
2025-11-10T09:39:22.232715Z :INFO: [] MessageGroupId [source1] SessionId [] Start write session. Will connect to endpoint: localhost:5412
2025-11-10T09:39:22.231240Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|a573ffff-a41c608c-8a67f961-ff00e264_0 grpc read done: success: 0 data: 
2025-11-10T09:39:22.231275Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: source0|a573ffff-a41c608c-8a67f961-ff00e264_0 grpc read failed
2025-11-10T09:39:22.231314Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: source0|a573ffff-a41c608c-8a67f961-ff00e264_0 grpc closed
2025-11-10T09:39:22.231342Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: source0|a573ffff-a41c608c-8a67f961-ff00e264_0 is DEAD
2025-11-10T09:39:22.232687Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-11-10T09:39:22.233287Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [12:7571029032734718747:2494] destroyed
2025-11-10T09:39:22.233356Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][1][StateIdle] TPartition::DropOwner.
2025-11-10T09:39:22.233401Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.233423Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.233452Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.233480Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.233507Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.233580Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:22.233606Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.233627Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.233652Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.233672Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:22.244392Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source1" }
2025-11-10T09:39:22.246062Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-10T09:39:22.246100Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-10T09:39:22.246616Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source1" }
2025-11-10T09:39:22.246792Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "topic1" message_group_id: "source1" from ipv6:[::1]:41250
2025-11-10T09:39:22.246816Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:41250 proto=v1  topic=topic1 durationSec=0
2025-11-10T09:39:22.246828Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-10T09:39:22.248863Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-10T09:39:22.249022Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-10T09:39:22.249037Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-10T09:39:22.249054Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-10T09:39:22.249098Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7571029032734718754:2504] (SourceId=source1, PreferedPartition=(NULL)) StartKqpSession
2025-11-10T09:39:22.253896Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7571029032734718754:2504] (SourceId=source1, PreferedPartition=(NULL)) Select from the table
2025-11-10T09:39:22.276555Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7571029032734718754:2504] (SourceId=source1, PreferedPartition=(NULL)) RequestPQRB
2025-11-10T09:39:22.277172Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029032734718773:2504] connected; active server actors: 1
2025-11-10T09:39:22.277310Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7571029032734718754:2504] (SourceId=source1, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source1
2025-11-10T09:39:22.277356Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7571029032734718754:2504] (SourceId=source1, PreferedPartition=(NULL)) Update the table
2025-11-10T09:39:22.278479Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029032734718773:2504] disconnected.
2025-11-10T09:39:22.278520Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029032734718773:2504] disconnected; active server actors: 1
2025-11-10T09:39:22.278542Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029032734718773:2504] disconnected no session
2025-11-10T09:39:22.288620Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7571029032734718754:2504] (SourceId=source1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-10T09:39:22.288677Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7571029032734718754:2504] (SourceId=source1, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-10T09:39:22.288711Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7571029032734718754:2504] (SourceId=source1, PreferedPartition=(NULL)) Start idle
2025-11-10T09:39:22.288755Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-10T09:39:22.293785Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-11-10T09:39:22.293565Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [12:7571029032734718788:2504], now have 1 active actors on pipe
2025-11-10T09:39:22.296539Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: source1|da1d5573-d96da77a-5114b310-faaecfcf_0
2025-11-10T09:39:22.297480Z :INFO: [] MessageGroupId [source1] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762767562297 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-10T09:39:22.297600Z :INFO: [] MessageGroupId [source1] SessionId [] Write session established. Init response: session_id: "source1|da1d5573-d96da77a-5114b310-faaecfcf_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-10T09:39:22.297876Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|da1d5573-d96da77a-5114b310-faaecfcf_0] Write 1 messages with Id from 1 to 1
2025-11-10T09:39:22.297943Z :INFO: [] MessageGroupId [source1] SessionId [source1|da1d5573-d96da77a-5114b310-faaecfcf_0] Write session: close. Timeout = 10000 ms
2025-11-10T09:39:22.298277Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|da1d5573-d96da77a-5114b310-faaecfcf_0] Write session: try to update token
2025-11-10T09:39:22.298333Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|da1d5573-d96da77a-5114b310-faaecfcf_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-10T09:39:22.298817Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|da1d5573-d96da77a-5114b310-faaecfcf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-10T09:39:22.299137Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-10T09:39:22.294797Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.294844Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:22.294967Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source1|da1d5573-d96da77a-5114b310-faaecfcf_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source1
2025-11-10T09:39:22.295019Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:22.295042Z node 13 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T09:39:22.295075Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:22.295098Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.295133Z node 13 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T09:39:22.295175Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:22.295195Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T09:39:22.295222Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:22.295272Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T09:39:22.295336Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:22.296030Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.296061Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:22.296155Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:22.299942Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.299979Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:22.300063Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-10T09:39:22.300634Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-10T09:39:22.301369Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.301424Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:22.301497Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source1' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-10T09:39:22.301572Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T09:39:22.301636Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:22.301657Z node 13 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T09:39:22.301687Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:22.301701Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.301733Z node 13 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T09:39:22.301844Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source1' seqNo 1 partNo 0
2025-11-10T09:39:22.302598Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source1' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 173 count 1 nextOffset 1 batches 1
2025-11-10T09:39:22.302661Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:22.302681Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T09:39:22.302701Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:22.303410Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 161 WTime 1762767562303
2025-11-10T09:39:22.303624Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T09:39:22.303784Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 161
2025-11-10T09:39:22.307100Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 161 actorID [13:7571029025308237122:2366]
2025-11-10T09:39:22.307195Z node 13 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T09:39:22.307283Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T09:39:22.307331Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T09:39:22.307386Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-10T09:39:22.307740Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-10T09:39:22.307774Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-10T09:39:22.307809Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:22.307829Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.307850Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.307872Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.307890Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:22.307931Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T09:39:22.308075Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-10T09:39:22.308763Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-11-10T09:39:22.308804Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) ready for read with readOffset 0 endOffset 1
2025-11-10T09:39:22.308878Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 161
2025-11-10T09:39:22.308895Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1TEvPartitionReady. Aval parts: 1
2025-11-10T09:39:22.308939Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 performing read request: guid# fd4e7224-172c4d64-f87a5f35-fe458d0d, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-10T09:39:22.309252Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-10T09:39:22.309409Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-10T09:39:22.309733Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 161 count 1 last offset 0, current partition end offset: 1
2025-11-10T09:39:22.309759Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-10T09:39:22.309816Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-10T09:39:22.000000Z
2025-11-10T09:39:22.309868Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-10T09:39:22.310602Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-10T09:39:22.309923Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-10T09:39:22.310110Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-10T09:39:22.310201Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp done, result 1762767562301 queuesize 0 startOffset 0
2025-11-10T09:39:22.310391Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-10T09:39:22.311093Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid fd4e7224-172c4d64-f87a5f35-fe458d0d
2025-11-10T09:39:22.311584Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|da1d5573-d96da77a-5114b310-faaecfcf_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-11-10T09:39:22.311647Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|da1d5573-d96da77a-5114b310-faaecfcf_0] Write session: acknoledged message 1
2025-11-10T09:39:22.311702Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.311747Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:22.311859Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 1 size 193 endOffset 1 max time lag 0ms effective offset 0
2025-11-10T09:39:22.312148Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 161 count 1 last offset 0, current partition end offset: 1
2025-11-10T09:39:22.312180Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-10T09:39:22.312231Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 161 accessed 1 times before, last time 2025-11-10T09:39:22.000000Z
2025-11-10T09:39:22.312274Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-10T09:39:22.312320Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-10T09:39:22.312495Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-10T09:39:22.312618Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:22.312652Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-10T09:39:22.313186Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 98 bytes ..." SourceId: "\000source1" SeqNo: 1 WriteTimestampMS: 1762767562301 CreateTimestampMS: 1762767562297 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-11-10T09:39:22.313318Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 2 from offset 1
2025-11-10T09:39:22.313356Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 1 ReadOffset 1 ReadGuid fd4e7224-172c4d64-f87a5f35-fe458d0d has messages 1
2025-11-10T09:39:22.313465Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 read done: guid# fd4e7224-172c4d64-f87a5f35-fe458d0d, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), size# 195
2025-11-10T09:39:22.313493Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 response to read: guid# fd4e7224-172c4d64-f87a5f35-fe458d0d
2025-11-10T09:39:22.313740Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 Process answer. Aval parts: 0
2025-11-10T09:39:22.314435Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-10T09:39:22.314778Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 grpc read done: success# 1, data# { read { } }
2025-11-10T09:39:22.314920Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 got read request: guid# c46b0d67-daa2a768-ce559a7b-5e0f424f
2025-11-10T09:39:22.322561Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.322611Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.322636Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.322665Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.322685Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.334161Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:22.334213Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.334239Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.334267Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.334288Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:22.398065Z :INFO: [] MessageGroupId [source1] SessionId [source1|da1d5573-d96da77a-5114b310-faaecfcf_0] Write session will now close
2025-11-10T09:39:22.398135Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|da1d5573-d96da77a-5114b310-faaecfcf_0] Write session: aborting
2025-11-10T09:39:22.399224Z :INFO: [] MessageGroupId [source1] SessionId [source1|da1d5573-d96da77a-5114b310-faaecfcf_0] Write session: gracefully shut down, all writes complete
2025-11-10T09:39:22.399686Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|da1d5573-d96da77a-5114b310-faaecfcf_0] Write session is aborting and will not restart
2025-11-10T09:39:22.399762Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|da1d5573-d96da77a-5114b310-faaecfcf_0] Write session: destroy
2025-11-10T09:39:22.399179Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|da1d5573-d96da77a-5114b310-faaecfcf_0 grpc read done: success: 0 data: 
2025-11-10T09:39:22.400648Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [12:7571029032734718788:2504] destroyed
2025-11-10T09:39:22.405431Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: try to update token
2025-11-10T09:39:22.399211Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: source1|da1d5573-d96da77a-5114b310-faaecfcf_0 grpc read failed
2025-11-10T09:39:22.399609Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 2 sessionId: source1|da1d5573-d96da77a-5114b310-faaecfcf_0
2025-11-10T09:39:22.400709Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-10T09:39:22.399636Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: source1|da1d5573-d96da77a-5114b310-faaecfcf_0 is DEAD
2025-11-10T09:39:22.400135Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-10T09:39:22.400752Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:22.409603Z :INFO: [] MessageGroupId [source2] SessionId [] Write session: Do CDS request
2025-11-10T09:39:22.409647Z :INFO: [] MessageGroupId [source2] SessionId [] Start write session. Will connect to endpoint: localhost:5412
2025-11-10T09:39:22.400774Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.400790Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.400817Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.400839Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:22.422171Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source2" }
2025-11-10T09:39:22.422520Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-10T09:39:22.422570Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-11-10T09:39:22.422976Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source2" }
2025-11-10T09:39:22.423158Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "topic1" message_group_id: "source2" from ipv6:[::1]:41250
2025-11-10T09:39:22.423195Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:41250 proto=v1  topic=topic1 durationSec=0
2025-11-10T09:39:22.423207Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-10T09:39:22.424262Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.424312Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.424333Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.424354Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.424367Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.424811Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-11-10T09:39:22.424964Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-10T09:39:22.424984Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-10T09:39:22.425002Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-10T09:39:22.425026Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7571029032734718811:2516] (SourceId=source2, PreferedPartition=(NULL)) StartKqpSession
2025-11-10T09:39:22.429176Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7571029032734718811:2516] (SourceId=source2, PreferedPartition=(NULL)) Select from the table
2025-11-10T09:39:22.434433Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:22.434476Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.434497Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.434522Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.434538Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:22.437835Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7571029032734718811:2516] (SourceId=source2, PreferedPartition=(NULL)) RequestPQRB
2025-11-10T09:39:22.438905Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029032734718830:2516] connected; active server actors: 1
2025-11-10T09:39:22.439014Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7571029032734718811:2516] (SourceId=source2, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=source2
2025-11-10T09:39:22.439047Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7571029032734718811:2516] (SourceId=source2, PreferedPartition=(NULL)) Update the table
2025-11-10T09:39:22.440141Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029032734718830:2516] disconnected.
2025-11-10T09:39:22.440181Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029032734718830:2516] disconnected; active server actors: 1
2025-11-10T09:39:22.440206Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029032734718830:2516] disconnected no session
2025-11-10T09:39:22.451513Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7571029032734718811:2516] (SourceId=source2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-10T09:39:22.451562Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7571029032734718811:2516] (SourceId=source2, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-11-10T09:39:22.451591Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7571029032734718811:2516] (SourceId=source2, PreferedPartition=(NULL)) Start idle
2025-11-10T09:39:22.451630Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-11-10T09:39:22.456150Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-11-10T09:39:22.455234Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [12:7571029032734718845:2516], now have 1 active actors on pipe
2025-11-10T09:39:22.456454Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.456488Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:22.456574Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source2|be9897f6-851dc341-f73c72a3-281ba04c_0 generated for partition 1 topic 'rt3.dc1--topic1' owner source2
2025-11-10T09:39:22.456614Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.456636Z node 13 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T09:39:22.456661Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:22.456682Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.456706Z node 13 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T09:39:22.456747Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:22.456765Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-10T09:39:22.456790Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.456838Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyOwnerOk. Partition: 1
2025-11-10T09:39:22.456895Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:22.460437Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.460491Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:22.460640Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:22.461417Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 1 MaxSeqNo: 0 sessionId: source2|be9897f6-851dc341-f73c72a3-281ba04c_0
2025-11-10T09:39:22.462445Z :INFO: [] MessageGroupId [source2] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762767562462 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-10T09:39:22.462604Z :INFO: [] MessageGroupId [source2] SessionId [] Write session established. Init response: session_id: "source2|be9897f6-851dc341-f73c72a3-281ba04c_0" topic: "topic1" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-10T09:39:22.462893Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|be9897f6-851dc341-f73c72a3-281ba04c_0] Write 1 messages with Id from 1 to 1
2025-11-10T09:39:22.462962Z :INFO: [] MessageGroupId [source2] SessionId [source2|be9897f6-851dc341-f73c72a3-281ba04c_0] Write session: close. Timeout = 10000 ms
2025-11-10T09:39:22.463353Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|be9897f6-851dc341-f73c72a3-281ba04c_0] Write session: try to update token
2025-11-10T09:39:22.463400Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|be9897f6-851dc341-f73c72a3-281ba04c_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-10T09:39:22.463858Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|be9897f6-851dc341-f73c72a3-281ba04c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-10T09:39:22.464073Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-10T09:39:22.464923Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-11-10T09:39:22.464630Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.464671Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:22.464753Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-11-10T09:39:22.465233Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.465248Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:22.465298Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 1 SourceId: '\0source2' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-10T09:39:22.465341Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][1][StateIdle] Received TPartition::TEvWrite
2025-11-10T09:39:22.465381Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.465399Z node 13 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T09:39:22.465434Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:22.465451Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.465482Z node 13 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T09:39:22.465605Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId '\0source2' seqNo 1 partNo 0
2025-11-10T09:39:22.466560Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId '\0source2' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 173 count 1 nextOffset 2 batches 1
2025-11-10T09:39:22.466617Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:22.466637Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-10T09:39:22.466661Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.467362Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][1][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000001_00000000000000000001_00000_0000000001_00000? size 161 WTime 1762767562465
2025-11-10T09:39:22.467590Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T09:39:22.467759Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 1 offset 1 partNo 0 count 1 size 161
2025-11-10T09:39:22.471139Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 1 offset 1 count 1 size 161 actorID [13:7571029025308237122:2366]
2025-11-10T09:39:22.471218Z node 13 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T09:39:22.471293Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T09:39:22.471332Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyWrite. Partition: 1
2025-11-10T09:39:22.471393Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][1][StateIdle] Answering for message sourceid: '\0source2', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-11-10T09:39:22.471686Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.471706Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.471723Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.471740Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.471756Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.471769Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 1 offset 1 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-10T09:39:22.471793Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-11-10T09:39:22.472038Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-11-10T09:39:22.472074Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) ready for read with readOffset 1 endOffset 2
2025-11-10T09:39:22.472121Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 1, endOffset# 2, WTime# 1762767562131, sizeLag# 161
2025-11-10T09:39:22.472137Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1TEvPartitionReady. Aval parts: 1
2025-11-10T09:39:22.472177Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 performing read request: guid# c46b0d67-daa2a768-ce559a7b-5e0f424f, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-10T09:39:22.472226Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid c46b0d67-daa2a768-ce559a7b-5e0f424f
2025-11-10T09:39:22.473347Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-11-10T09:39:22.473159Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 1  requestId: <none> cookie: 1
2025-11-10T09:39:22.473330Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.473363Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:22.473477Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][1][StateIdle] read cookie 5 Topic 'rt3.dc1--topic1' partition 1 user user offset 1 partno 0 count 1 size 193 endOffset 2 max time lag 0ms effective offset 1
2025-11-10T09:39:22.473768Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][1][StateIdle] read cookie 5 added 1 blobs, size 161 count 1 last offset 1, current partition end offset: 2
2025-11-10T09:39:22.473793Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][1][StateIdle] Reading cookie 5. Send blob request.
2025-11-10T09:39:22.473852Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 1 offset 1 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-10T09:39:22.000000Z
2025-11-10T09:39:22.473899Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-11-10T09:39:22.473953Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-10T09:39:22.474953Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|be9897f6-851dc341-f73c72a3-281ba04c_0] Write session got write response: sequence_numbers: 1 offsets: 1 already_written: false partition_id: 1 write_statistics { persist_duration_ms: 6 }
2025-11-10T09:39:22.473961Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 1 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-10T09:39:22.474119Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-10T09:39:22.474235Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-11-10T09:39:22.475020Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|be9897f6-851dc341-f73c72a3-281ba04c_0] Write session: acknoledged message 1
2025-11-10T09:39:22.474662Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 98 bytes ..." SourceId: "\000source2" SeqNo: 1 WriteTimestampMS: 1762767562465 CreateTimestampMS: 1762767562462 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-11-10T09:39:22.474760Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 3 from offset 2
2025-11-10T09:39:22.474788Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid c46b0d67-daa2a768-ce559a7b-5e0f424f has messages 1
2025-11-10T09:39:22.474950Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 read done: guid# c46b0d67-daa2a768-ce559a7b-5e0f424f, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), size# 199
2025-11-10T09:39:22.474976Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 response to read: guid# c46b0d67-daa2a768-ce559a7b-5e0f424f
2025-11-10T09:39:22.475173Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 Process answer. Aval parts: 0
2025-11-10T09:39:22.475701Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-10T09:39:22.477167Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 grpc read done: success# 1, data# { read { } }
2025-11-10T09:39:22.477291Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 got read request: guid# 24a6dc12-480fca1b-fb9a16a8-d55ec209
2025-11-10T09:39:22.524553Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.524596Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.524615Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.524641Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.524658Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.534794Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:22.534838Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.534874Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.534900Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.534917Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:22.563091Z :INFO: [] MessageGroupId [source2] SessionId [source2|be9897f6-851dc341-f73c72a3-281ba04c_0] Write session will now close
2025-11-10T09:39:22.563144Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|be9897f6-851dc341-f73c72a3-281ba04c_0] Write session: aborting
2025-11-10T09:39:22.563599Z :INFO: [] MessageGroupId [source2] SessionId [source2|be9897f6-851dc341-f73c72a3-281ba04c_0] Write session: gracefully shut down, all writes complete
2025-11-10T09:39:22.563636Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|be9897f6-851dc341-f73c72a3-281ba04c_0] Write session: destroy
2025-11-10T09:39:22.564595Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: try to update token
2025-11-10T09:39:22.564979Z :INFO: [] MessageGroupId [source3] SessionId [] Write session: Do CDS request
2025-11-10T09:39:22.565014Z :INFO: [] MessageGroupId [source3] SessionId [] Start write session. Will connect to endpoint: localhost:5412
2025-11-10T09:39:22.569040Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|be9897f6-851dc341-f73c72a3-281ba04c_0 grpc read done: success: 0 data: 
2025-11-10T09:39:22.569086Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: source2|be9897f6-851dc341-f73c72a3-281ba04c_0 grpc read failed
2025-11-10T09:39:22.569125Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: source2|be9897f6-851dc341-f73c72a3-281ba04c_0 grpc closed
2025-11-10T09:39:22.569148Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: source2|be9897f6-851dc341-f73c72a3-281ba04c_0 is DEAD
2025-11-10T09:39:22.569755Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source3" }
2025-11-10T09:39:22.569800Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-11-10T09:39:22.570277Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [12:7571029032734718845:2516] destroyed
2025-11-10T09:39:22.570342Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][1][StateIdle] TPartition::DropOwner.
2025-11-10T09:39:22.570394Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.570413Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.570429Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.570451Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.570471Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.573224Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-10T09:39:22.573259Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-11-10T09:39:22.573642Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source3" }
2025-11-10T09:39:22.573796Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "topic1" message_group_id: "source3" from ipv6:[::1]:41250
2025-11-10T09:39:22.573817Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:41250 proto=v1  topic=topic1 durationSec=0
2025-11-10T09:39:22.573830Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-10T09:39:22.575792Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-11-10T09:39:22.575949Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-10T09:39:22.575962Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-10T09:39:22.575977Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-10T09:39:22.576001Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7571029032734718856:2521] (SourceId=source3, PreferedPartition=(NULL)) StartKqpSession
2025-11-10T09:39:22.580801Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7571029032734718856:2521] (SourceId=source3, PreferedPartition=(NULL)) Select from the table
2025-11-10T09:39:22.593579Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7571029032734718856:2521] (SourceId=source3, PreferedPartition=(NULL)) RequestPQRB
2025-11-10T09:39:22.594387Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029032734718875:2521] connected; active server actors: 1
2025-11-10T09:39:22.594456Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7571029032734718856:2521] (SourceId=source3, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source3
2025-11-10T09:39:22.594483Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7571029032734718856:2521] (SourceId=source3, PreferedPartition=(NULL)) Update the table
2025-11-10T09:39:22.594943Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029032734718875:2521] disconnected.
2025-11-10T09:39:22.594974Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029032734718875:2521] disconnected; active server actors: 1
2025-11-10T09:39:22.594998Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029032734718875:2521] disconnected no session
2025-11-10T09:39:22.604125Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7571029032734718856:2521] (SourceId=source3, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-10T09:39:22.604176Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7571029032734718856:2521] (SourceId=source3, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-10T09:39:22.604203Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7571029032734718856:2521] (SourceId=source3, PreferedPartition=(NULL)) Start idle
2025-11-10T09:39:22.604244Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-10T09:39:22.606067Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-11-10T09:39:22.606660Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [12:7571029032734718889:2521], now have 1 active actors on pipe
2025-11-10T09:39:22.606753Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.606777Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:22.606847Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source3|e358cbe-eeb5529b-801f61cd-bf577c37_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source3
2025-11-10T09:39:22.606892Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:22.606914Z node 13 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T09:39:22.606935Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:22.606955Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.606987Z node 13 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T09:39:22.607025Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:22.607044Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T09:39:22.607077Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:22.607123Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T09:39:22.607178Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:22.607759Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.607803Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:22.607877Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:22.608176Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 0 sessionId: source3|e358cbe-eeb5529b-801f61cd-bf577c37_0
2025-11-10T09:39:22.608982Z :INFO: [] MessageGroupId [source3] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762767562608 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-10T09:39:22.609147Z :INFO: [] MessageGroupId [source3] SessionId [] Write session established. Init response: session_id: "source3|e358cbe-eeb5529b-801f61cd-bf577c37_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-10T09:39:22.609543Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|e358cbe-eeb5529b-801f61cd-bf577c37_0] Write 1 messages with Id from 1 to 1
2025-11-10T09:39:22.609625Z :INFO: [] MessageGroupId [source3] SessionId [source3|e358cbe-eeb5529b-801f61cd-bf577c37_0] Write session: close. Timeout = 10000 ms
2025-11-10T09:39:22.610648Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|e358cbe-eeb5529b-801f61cd-bf577c37_0] Write session: try to update token
2025-11-10T09:39:22.610708Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|e358cbe-eeb5529b-801f61cd-bf577c37_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-10T09:39:22.611468Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|e358cbe-eeb5529b-801f61cd-bf577c37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-10T09:39:22.611818Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-10T09:39:22.613316Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.613366Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:22.613468Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-10T09:39:22.614123Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.614157Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:22.614224Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source3' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-10T09:39:22.614287Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T09:39:22.614335Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:22.614353Z node 13 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T09:39:22.614381Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:22.614393Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.614415Z node 13 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T09:39:22.614517Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source3' seqNo 1 partNo 0
2025-11-10T09:39:22.613723Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-10T09:39:22.681795Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source3' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 173 count 1 nextOffset 2 batches 1
2025-11-10T09:39:22.681873Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:22.681896Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T09:39:22.681929Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:22.683277Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 161 WTime 1762767562683
2025-11-10T09:39:22.683625Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.683651Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.683670Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.683691Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.683708Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.683747Z node 13 :PERSQUEUE DEBUG: partition.cpp:2286: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-10T09:39:22.683775Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T09:39:22.683939Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 161
2025-11-10T09:39:22.689312Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 161 actorID [13:7571029025308237122:2366]
2025-11-10T09:39:22.689401Z node 13 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T09:39:22.689480Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T09:39:22.689526Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T09:39:22.689584Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source3', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-11-10T09:39:22.689874Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:22.689899Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.689918Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.689940Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.689944Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-10T09:39:22.689957Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:22.689996Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T09:39:22.690049Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-10T09:39:22.690742Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:topic1:0:2:0:0 null:topic1:1:1:1:0
2025-11-10T09:39:22.690810Z :INFO: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1006 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 81 BytesInflightTotal: 81 MessagesInflight: 3 }
2025-11-10T09:39:22.690399Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-11-10T09:39:22.690436Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) ready for read with readOffset 1 endOffset 2
2025-11-10T09:39:22.690493Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-10T09:39:22.690958Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 1, endOffset# 2, WTime# 1762767562301, sizeLag# 161
2025-11-10T09:39:22.690976Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1TEvPartitionReady. Aval parts: 1
2025-11-10T09:39:22.691019Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 performing read request: guid# 24a6dc12-480fca1b-fb9a16a8-d55ec209, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-10T09:39:22.691070Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 24a6dc12-480fca1b-fb9a16a8-d55ec209
2025-11-10T09:39:22.691578Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|e358cbe-eeb5529b-801f61cd-bf577c37_0] Write session got write response: sequence_numbers: 1 offsets: 1 already_written: false write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 67 }
2025-11-10T09:39:22.691644Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|e358cbe-eeb5529b-801f61cd-bf577c37_0] Write session: acknoledged message 1
2025-11-10T09:39:22.692048Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.692095Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:22.692231Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--topic1' partition 0 user user offset 1 partno 0 count 1 size 193 endOffset 2 max time lag 0ms effective offset 1
2025-11-10T09:39:22.692526Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 161 count 1 last offset 1, current partition end offset: 2
2025-11-10T09:39:22.692552Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-11-10T09:39:22.692605Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-10T09:39:22.000000Z
2025-11-10T09:39:22.692653Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-11-10T09:39:22.692704Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-10T09:39:22.692731Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-10T09:39:22.692877Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-10T09:39:22.693001Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-10T09:39:22.693543Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 98 bytes ..." SourceId: "\000source3" SeqNo: 1 WriteTimestampMS: 1762767562614 CreateTimestampMS: 1762767562609 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-11-10T09:39:22.693670Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 3 from offset 2
2025-11-10T09:39:22.693709Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 2 ReadOffset 2 ReadGuid 24a6dc12-480fca1b-fb9a16a8-d55ec209 has messages 1
2025-11-10T09:39:22.693832Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 read done: guid# 24a6dc12-480fca1b-fb9a16a8-d55ec209, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), size# 197
2025-11-10T09:39:22.693861Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 response to read: guid# 24a6dc12-480fca1b-fb9a16a8-d55ec209
2025-11-10T09:39:22.694103Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 Process answer. Aval parts: 0
2025-11-10T09:39:22.697879Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-10T09:39:22.701654Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 grpc read done: success# 1, data# { read { } }
2025-11-10T09:39:22.701822Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 got read request: guid# 68f2f365-db237ddf-1642421-302873b5
2025-11-10T09:39:22.715375Z :INFO: [] MessageGroupId [source3] SessionId [source3|e358cbe-eeb5529b-801f61cd-bf577c37_0] Write session will now close
2025-11-10T09:39:22.715439Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|e358cbe-eeb5529b-801f61cd-bf577c37_0] Write session: aborting
2025-11-10T09:39:22.716936Z :INFO: [] MessageGroupId [source3] SessionId [source3|e358cbe-eeb5529b-801f61cd-bf577c37_0] Write session: gracefully shut down, all writes complete
2025-11-10T09:39:22.716798Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|e358cbe-eeb5529b-801f61cd-bf577c37_0 grpc read done: success: 0 data: 
2025-11-10T09:39:22.716827Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: source3|e358cbe-eeb5529b-801f61cd-bf577c37_0 grpc read failed
2025-11-10T09:39:22.717262Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 4 sessionId: source3|e358cbe-eeb5529b-801f61cd-bf577c37_0
2025-11-10T09:39:22.717291Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: source3|e358cbe-eeb5529b-801f61cd-bf577c37_0 is DEAD
2025-11-10T09:39:22.717807Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-10T09:39:22.718195Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|e358cbe-eeb5529b-801f61cd-bf577c37_0] Write session is aborting and will not restart
2025-11-10T09:39:22.718409Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|e358cbe-eeb5529b-801f61cd-bf577c37_0] Write session: destroy
2025-11-10T09:39:22.718961Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [12:7571029032734718889:2521] destroyed
2025-11-10T09:39:22.719025Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-10T09:39:22.719071Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:22.719090Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.719118Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.719142Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.719164Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:22.723211Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: try to update token
2025-11-10T09:39:22.723682Z :INFO: [] MessageGroupId [source4] SessionId [] Write session: Do CDS request
2025-11-10T09:39:22.723712Z :INFO: [] MessageGroupId [source4] SessionId [] Start write session. Will connect to endpoint: localhost:5412
2025-11-10T09:39:22.728466Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source4" }
2025-11-10T09:39:22.729407Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-10T09:39:22.729442Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-11-10T09:39:22.729896Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source4" }
2025-11-10T09:39:22.730035Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "topic1" message_group_id: "source4" from ipv6:[::1]:41250
2025-11-10T09:39:22.730057Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:41250 proto=v1  topic=topic1 durationSec=0
2025-11-10T09:39:22.730066Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-10T09:39:22.732574Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-11-10T09:39:22.732753Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-10T09:39:22.732766Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-10T09:39:22.732782Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-10T09:39:22.732804Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7571029032734718894:2525] (SourceId=source4, PreferedPartition=(NULL)) StartKqpSession
2025-11-10T09:39:22.736680Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7571029032734718894:2525] (SourceId=source4, PreferedPartition=(NULL)) Select from the table
2025-11-10T09:39:22.745632Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7571029032734718894:2525] (SourceId=source4, PreferedPartition=(NULL)) RequestPQRB
2025-11-10T09:39:22.747108Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029032734718913:2525] connected; active server actors: 1
2025-11-10T09:39:22.747275Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7571029032734718894:2525] (SourceId=source4, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=source4
2025-11-10T09:39:22.747301Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7571029032734718894:2525] (SourceId=source4, PreferedPartition=(NULL)) Update the table
2025-11-10T09:39:22.748448Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029032734718913:2525] disconnected.
2025-11-10T09:39:22.748482Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029032734718913:2525] disconnected; active server actors: 1
2025-11-10T09:39:22.748505Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029032734718913:2525] disconnected no session
2025-11-10T09:39:22.756877Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7571029032734718894:2525] (SourceId=source4, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-10T09:39:22.756922Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7571029032734718894:2525] (SourceId=source4, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-11-10T09:39:22.756948Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7571029032734718894:2525] (SourceId=source4, PreferedPartition=(NULL)) Start idle
2025-11-10T09:39:22.756981Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-11-10T09:39:22.758880Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [12:7571029032734718927:2525], now have 1 active actors on pipe
2025-11-10T09:39:22.759374Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.759422Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:22.759511Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source4|662de181-8c067b60-37f544e7-a13108b_0 generated for partition 1 topic 'rt3.dc1--topic1' owner source4
2025-11-10T09:39:22.759543Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.759561Z node 13 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T09:39:22.759584Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:22.759602Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.759627Z node 13 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T09:39:22.759659Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:22.759675Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-10T09:39:22.759698Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.759742Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyOwnerOk. Partition: 1
2025-11-10T09:39:22.759795Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:22.760267Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.760299Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:22.760370Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:22.759138Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-11-10T09:39:22.760650Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 1 MaxSeqNo: 0 sessionId: source4|662de181-8c067b60-37f544e7-a13108b_0
2025-11-10T09:39:22.761386Z :INFO: [] MessageGroupId [source4] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762767562761 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-10T09:39:22.761522Z :INFO: [] MessageGroupId [source4] SessionId [] Write session established. Init response: session_id: "source4|662de181-8c067b60-37f544e7-a13108b_0" topic: "topic1" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-10T09:39:22.761758Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|662de181-8c067b60-37f544e7-a13108b_0] Write 1 messages with Id from 1 to 1
2025-11-10T09:39:22.761820Z :INFO: [] MessageGroupId [source4] SessionId [source4|662de181-8c067b60-37f544e7-a13108b_0] Write session: close. Timeout = 10000 ms
2025-11-10T09:39:22.762197Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|662de181-8c067b60-37f544e7-a13108b_0] Write session: try to update token
2025-11-10T09:39:22.762243Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|662de181-8c067b60-37f544e7-a13108b_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-10T09:39:22.762829Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|662de181-8c067b60-37f544e7-a13108b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-10T09:39:22.763189Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-10T09:39:22.763510Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.763542Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:22.763607Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-11-10T09:39:22.763878Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-11-10T09:39:22.764184Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.764207Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:22.764264Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 1 SourceId: '\0source4' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-10T09:39:22.764310Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][1][StateIdle] Received TPartition::TEvWrite
2025-11-10T09:39:22.764367Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.764390Z node 13 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T09:39:22.764423Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:22.764439Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.764466Z node 13 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T09:39:22.764571Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId '\0source4' seqNo 1 partNo 0
2025-11-10T09:39:22.765431Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId '\0source4' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 173 count 1 nextOffset 3 batches 1
2025-11-10T09:39:22.765480Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:22.765497Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-10T09:39:22.765519Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.766158Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][1][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000001_00000000000000000002_00000_0000000001_00000? size 161 WTime 1762767562765
2025-11-10T09:39:22.766347Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T09:39:22.766505Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 1 offset 2 partNo 0 count 1 size 161
2025-11-10T09:39:22.769227Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 1 offset 2 count 1 size 161 actorID [13:7571029025308237122:2366]
2025-11-10T09:39:22.769295Z node 13 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T09:39:22.769361Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T09:39:22.769405Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyWrite. Partition: 1
2025-11-10T09:39:22.769454Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][1][StateIdle] Answering for message sourceid: '\0source4', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 2 is stored on disk
2025-11-10T09:39:22.769690Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.769713Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.769729Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.769748Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.769765Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.769783Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 1 offset 2 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-10T09:39:22.769794Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-11-10T09:39:22.769836Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 1  requestId: <none> cookie: 1
2025-11-10T09:39:22.770046Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-11-10T09:39:22.770080Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) ready for read with readOffset 2 endOffset 3
2025-11-10T09:39:22.770122Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-11-10T09:39:22.770496Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 2, endOffset# 3, WTime# 1762767562465, sizeLag# 161
2025-11-10T09:39:22.770520Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1TEvPartitionReady. Aval parts: 1
2025-11-10T09:39:22.770561Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 performing read request: guid# 68f2f365-db237ddf-1642421-302873b5, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-10T09:39:22.770607Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid 68f2f365-db237ddf-1642421-302873b5
2025-11-10T09:39:22.771103Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|662de181-8c067b60-37f544e7-a13108b_0] Write session got write response: sequence_numbers: 1 offsets: 2 already_written: false partition_id: 1 write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 4 }
2025-11-10T09:39:22.771162Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|662de181-8c067b60-37f544e7-a13108b_0] Write session: acknoledged message 1
2025-11-10T09:39:22.772516Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 98 bytes ..." SourceId: "\000source4" SeqNo: 1 WriteTimestampMS: 1762767562760 CreateTimestampMS: 1762767562761 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-11-10T09:39:22.772628Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 4 from offset 3
2025-11-10T09:39:22.772669Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 3 ReadOffset 3 ReadGuid 68f2f365-db237ddf-1642421-302873b5 has messages 1
2025-11-10T09:39:22.772768Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 read done: guid# 68f2f365-db237ddf-1642421-302873b5, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), size# 199
2025-11-10T09:39:22.772797Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 response to read: guid# 68f2f365-db237ddf-1642421-302873b5
2025-11-10T09:39:22.772973Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 Process answer. Aval parts: 0
2025-11-10T09:39:22.771218Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.771254Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:22.771353Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][1][StateIdle] read cookie 6 Topic 'rt3.dc1--topic1' partition 1 user user offset 2 partno 0 count 1 size 193 endOffset 3 max time lag 0ms effective offset 2
2025-11-10T09:39:22.771626Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][1][StateIdle] read cookie 6 added 1 blobs, size 161 count 1 last offset 2, current partition end offset: 3
2025-11-10T09:39:22.771648Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][1][StateIdle] Reading cookie 6. Send blob request.
2025-11-10T09:39:22.771696Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 1 offset 2 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-10T09:39:22.000000Z
2025-11-10T09:39:22.771736Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-11-10T09:39:22.771777Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-10T09:39:22.771926Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-10T09:39:22.773760Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-10T09:39:22.772029Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 2
2025-11-10T09:39:22.772198Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 1 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-10T09:39:22.773942Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 grpc read done: success# 1, data# { read { } }
2025-11-10T09:39:22.774050Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 got read request: guid# e788b58b-f1d4cc0-cc58220-8a9435c9
2025-11-10T09:39:22.783808Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.783849Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.783868Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.783891Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.783908Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.783954Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:22.783965Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.783975Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.783987Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.783996Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:22.863465Z :INFO: [] MessageGroupId [source4] SessionId [source4|662de181-8c067b60-37f544e7-a13108b_0] Write session will now close
2025-11-10T09:39:22.863516Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|662de181-8c067b60-37f544e7-a13108b_0] Write session: aborting
2025-11-10T09:39:22.863890Z :INFO: [] MessageGroupId [source4] SessionId [source4|662de181-8c067b60-37f544e7-a13108b_0] Write session: gracefully shut down, all writes complete
2025-11-10T09:39:22.863924Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|662de181-8c067b60-37f544e7-a13108b_0] Write session: destroy
2025-11-10T09:39:22.864853Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|662de181-8c067b60-37f544e7-a13108b_0 grpc read done: success: 0 data: 
2025-11-10T09:39:22.864888Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 5 sessionId: source4|662de181-8c067b60-37f544e7-a13108b_0 grpc read failed
2025-11-10T09:39:22.864922Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 5 sessionId: source4|662de181-8c067b60-37f544e7-a13108b_0 grpc closed
2025-11-10T09:39:22.864943Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: source4|662de181-8c067b60-37f544e7-a13108b_0 is DEAD
2025-11-10T09:39:22.865866Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-11-10T09:39:22.866273Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [12:7571029032734718927:2525] destroyed
2025-11-10T09:39:22.866330Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][1][StateIdle] TPartition::DropOwner.
2025-11-10T09:39:22.866364Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.866380Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.866399Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.866418Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.866445Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.869631Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: try to update token
2025-11-10T09:39:22.869909Z :INFO: [] MessageGroupId [source5] SessionId [] Write session: Do CDS request
2025-11-10T09:39:22.869937Z :INFO: [] MessageGroupId [source5] SessionId [] Start write session. Will connect to endpoint: localhost:5412
2025-11-10T09:39:22.875154Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source5" }
2025-11-10T09:39:22.875657Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-10T09:39:22.875690Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-11-10T09:39:22.876014Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source5" }
2025-11-10T09:39:22.876150Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "topic1" message_group_id: "source5" from ipv6:[::1]:41250
2025-11-10T09:39:22.876170Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:41250 proto=v1  topic=topic1 durationSec=0
2025-11-10T09:39:22.876180Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-10T09:39:22.878228Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-11-10T09:39:22.878406Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-10T09:39:22.878420Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-10T09:39:22.878437Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-10T09:39:22.878461Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7571029032734718956:2534] (SourceId=source5, PreferedPartition=(NULL)) StartKqpSession
2025-11-10T09:39:22.884025Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.884072Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.884090Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.884113Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.884129Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.884186Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:22.884198Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.884207Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.884218Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.884227Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:22.883946Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7571029032734718956:2534] (SourceId=source5, PreferedPartition=(NULL)) Select from the table
2025-11-10T09:39:22.893005Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7571029032734718956:2534] (SourceId=source5, PreferedPartition=(NULL)) RequestPQRB
2025-11-10T09:39:22.893635Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029032734718983:2534] connected; active server actors: 1
2025-11-10T09:39:22.893759Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7571029032734718956:2534] (SourceId=source5, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source5
2025-11-10T09:39:22.893790Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7571029032734718956:2534] (SourceId=source5, PreferedPartition=(NULL)) Update the table
2025-11-10T09:39:22.894211Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029032734718983:2534] disconnected.
2025-11-10T09:39:22.894247Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029032734718983:2534] disconnected; active server actors: 1
2025-11-10T09:39:22.894270Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029032734718983:2534] disconnected no session
2025-11-10T09:39:22.903905Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7571029032734718956:2534] (SourceId=source5, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-10T09:39:22.903959Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7571029032734718956:2534] (SourceId=source5, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-10T09:39:22.903986Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7571029032734718956:2534] (SourceId=source5, PreferedPartition=(NULL)) Start idle
2025-11-10T09:39:22.904027Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 6 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-10T09:39:22.905365Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [12:7571029032734718998:2534], now have 1 active actors on pipe
2025-11-10T09:39:22.905739Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-11-10T09:39:22.906023Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.906069Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:22.906156Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source5|c9ad41cc-c75566a-f6398156-48ff0035_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source5
2025-11-10T09:39:22.906200Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:22.906221Z node 13 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T09:39:22.906245Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:22.906265Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.906290Z node 13 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T09:39:22.906325Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:22.906351Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T09:39:22.906377Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:22.906422Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T09:39:22.906483Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:22.907020Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.907051Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:22.907144Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:22.907501Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 6 partition: 0 MaxSeqNo: 0 sessionId: source5|c9ad41cc-c75566a-f6398156-48ff0035_0
2025-11-10T09:39:22.909230Z :INFO: [] MessageGroupId [source5] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762767562909 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-10T09:39:22.909375Z :INFO: [] MessageGroupId [source5] SessionId [] Write session established. Init response: session_id: "source5|c9ad41cc-c75566a-f6398156-48ff0035_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-10T09:39:22.910590Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|c9ad41cc-c75566a-f6398156-48ff0035_0] Write 1 messages with Id from 1 to 1
2025-11-10T09:39:22.910675Z :INFO: [] MessageGroupId [source5] SessionId [source5|c9ad41cc-c75566a-f6398156-48ff0035_0] Write session: close. Timeout = 10000 ms
2025-11-10T09:39:22.913477Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|c9ad41cc-c75566a-f6398156-48ff0035_0] Write session: try to update token
2025-11-10T09:39:22.913537Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|c9ad41cc-c75566a-f6398156-48ff0035_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-10T09:39:22.914188Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|c9ad41cc-c75566a-f6398156-48ff0035_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-10T09:39:22.914483Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-10T09:39:22.915494Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-10T09:39:22.915064Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.915119Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:22.915199Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-10T09:39:22.915890Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.915910Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:22.915976Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source5' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-10T09:39:22.916029Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T09:39:22.916079Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:22.916109Z node 13 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T09:39:22.916147Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:22.916165Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.916197Z node 13 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T09:39:22.916318Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source5' seqNo 1 partNo 0
2025-11-10T09:39:22.917193Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source5' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 173 count 1 nextOffset 3 batches 1
2025-11-10T09:39:22.917244Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:22.917264Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T09:39:22.917288Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:22.918023Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 161 WTime 1762767562917
2025-11-10T09:39:22.918225Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T09:39:22.918390Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 161
2025-11-10T09:39:22.925736Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 161 actorID [13:7571029025308237122:2366]
2025-11-10T09:39:22.925826Z node 13 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T09:39:22.925899Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T09:39:22.925943Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T09:39:22.925998Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source5', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 2 is stored on disk
2025-11-10T09:39:22.926290Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:22.926310Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.926328Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.926349Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.926368Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:22.926402Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T09:39:22.926449Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-10T09:39:22.926874Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-10T09:39:22.927087Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-11-10T09:39:22.927123Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) ready for read with readOffset 2 endOffset 3
2025-11-10T09:39:22.927171Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 2, endOffset# 3, WTime# 1762767562614, sizeLag# 161
2025-11-10T09:39:22.927176Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-10T09:39:22.927187Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1TEvPartitionReady. Aval parts: 1
2025-11-10T09:39:22.927230Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 performing read request: guid# e788b58b-f1d4cc0-cc58220-8a9435c9, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-10T09:39:22.927278Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid e788b58b-f1d4cc0-cc58220-8a9435c9
2025-11-10T09:39:22.928084Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|c9ad41cc-c75566a-f6398156-48ff0035_0] Write session got write response: sequence_numbers: 1 offsets: 2 already_written: false write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 1 }
2025-11-10T09:39:22.928142Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|c9ad41cc-c75566a-f6398156-48ff0035_0] Write session: acknoledged message 1
2025-11-10T09:39:22.928231Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:22.928273Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:22.928385Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--topic1' partition 0 user user offset 2 partno 0 count 1 size 193 endOffset 3 max time lag 0ms effective offset 2
2025-11-10T09:39:22.928696Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 161 count 1 last offset 2, current partition end offset: 3
2025-11-10T09:39:22.928721Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-11-10T09:39:22.928770Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-10T09:39:22.000000Z
2025-11-10T09:39:22.928814Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-11-10T09:39:22.928862Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-10T09:39:22.929035Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-10T09:39:22.929159Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-11-10T09:39:22.929371Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-10T09:39:22.933446Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 98 bytes ..." SourceId: "\000source5" SeqNo: 1 WriteTimestampMS: 1762767562916 CreateTimestampMS: 1762767562910 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-11-10T09:39:22.933578Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 4 from offset 3
2025-11-10T09:39:22.933619Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 3 ReadOffset 3 ReadGuid e788b58b-f1d4cc0-cc58220-8a9435c9 has messages 1
2025-11-10T09:39:22.933749Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 read done: guid# e788b58b-f1d4cc0-cc58220-8a9435c9, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), size# 197
2025-11-10T09:39:22.933775Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 response to read: guid# e788b58b-f1d4cc0-cc58220-8a9435c9
2025-11-10T09:39:22.934008Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 Process answer. Aval parts: 0
2025-11-10T09:39:22.935105Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-10T09:39:22.935460Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 grpc read done: success# 1, data# { read { } }
2025-11-10T09:39:22.935557Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 got read request: guid# f7710149-b784611e-66439c2c-63ed748a
2025-11-10T09:39:22.985187Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:22.985239Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.985262Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.985291Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.985311Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:22.985361Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:22.985375Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.985385Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:22.985400Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:22.985413Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:23.010852Z :INFO: [] MessageGroupId [source5] SessionId [source5|c9ad41cc-c75566a-f6398156-48ff0035_0] Write session will now close
2025-11-10T09:39:23.010912Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|c9ad41cc-c75566a-f6398156-48ff0035_0] Write session: aborting
2025-11-10T09:39:23.011337Z :INFO: [] MessageGroupId [source5] SessionId [source5|c9ad41cc-c75566a-f6398156-48ff0035_0] Write session: gracefully shut down, all writes complete
2025-11-10T09:39:23.011375Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|c9ad41cc-c75566a-f6398156-48ff0035_0] Write session: destroy
2025-11-10T09:39:23.013927Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|c9ad41cc-c75566a-f6398156-48ff0035_0 grpc read done: success: 0 data: 
2025-11-10T09:39:23.013957Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 6 sessionId: source5|c9ad41cc-c75566a-f6398156-48ff0035_0 grpc read failed
2025-11-10T09:39:23.013994Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 6 sessionId: source5|c9ad41cc-c75566a-f6398156-48ff0035_0 grpc closed
2025-11-10T09:39:23.014018Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId: source5|c9ad41cc-c75566a-f6398156-48ff0035_0 is DEAD
2025-11-10T09:39:23.014808Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-10T09:39:23.015493Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: try to update token
2025-11-10T09:39:23.015777Z :INFO: [] MessageGroupId [source6] SessionId [] Write session: Do CDS request
2025-11-10T09:39:23.015803Z :INFO: [] MessageGroupId [source6] SessionId [] Start write session. Will connect to endpoint: localhost:5412
2025-11-10T09:39:23.016999Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [12:7571029032734718998:2534] destroyed
2025-11-10T09:39:23.017075Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-10T09:39:23.017119Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:23.017140Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.017154Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.017180Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.017200Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:23.022209Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source6" }
2025-11-10T09:39:23.022865Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-10T09:39:23.022899Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-11-10T09:39:23.025519Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source6" }
2025-11-10T09:39:23.025746Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "topic1" message_group_id: "source6" from ipv6:[::1]:41250
2025-11-10T09:39:23.025775Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:41250 proto=v1  topic=topic1 durationSec=0
2025-11-10T09:39:23.025798Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-10T09:39:23.027920Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-11-10T09:39:23.028098Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-10T09:39:23.028117Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-10T09:39:23.028135Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-10T09:39:23.028161Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7571029037029686300:2540] (SourceId=source6, PreferedPartition=(NULL)) StartKqpSession
2025-11-10T09:39:23.032707Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7571029037029686300:2540] (SourceId=source6, PreferedPartition=(NULL)) Select from the table
2025-11-10T09:39:23.047543Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7571029037029686300:2540] (SourceId=source6, PreferedPartition=(NULL)) RequestPQRB
2025-11-10T09:39:23.047995Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029037029686319:2540] connected; active server actors: 1
2025-11-10T09:39:23.048143Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7571029037029686300:2540] (SourceId=source6, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=source6
2025-11-10T09:39:23.048180Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7571029037029686300:2540] (SourceId=source6, PreferedPartition=(NULL)) Update the table
2025-11-10T09:39:23.048983Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029037029686319:2540] disconnected.
2025-11-10T09:39:23.049024Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029037029686319:2540] disconnected; active server actors: 1
2025-11-10T09:39:23.049049Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029037029686319:2540] disconnected no session
2025-11-10T09:39:23.058781Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7571029037029686300:2540] (SourceId=source6, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-10T09:39:23.059716Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [12:7571029037029686334:2540], now have 1 active actors on pipe
2025-11-10T09:39:23.058834Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7571029037029686300:2540] (SourceId=source6, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-11-10T09:39:23.058863Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7571029037029686300:2540] (SourceId=source6, PreferedPartition=(NULL)) Start idle
2025-11-10T09:39:23.058904Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-11-10T09:39:23.059771Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-11-10T09:39:23.060053Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:23.060087Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:23.060168Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source6|82bc529d-344e80ff-e51a2d0-efc50ff_0 generated for partition 1 topic 'rt3.dc1--topic1' owner source6
2025-11-10T09:39:23.060205Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:23.060228Z node 13 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T09:39:23.060249Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:23.060270Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.060297Z node 13 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T09:39:23.060333Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:23.060352Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-10T09:39:23.060378Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:23.060428Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyOwnerOk. Partition: 1
2025-11-10T09:39:23.060483Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:23.060991Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:23.061018Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:23.061117Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:23.061494Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 1 MaxSeqNo: 0 sessionId: source6|82bc529d-344e80ff-e51a2d0-efc50ff_0
2025-11-10T09:39:23.062327Z :INFO: [] MessageGroupId [source6] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762767563062 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-10T09:39:23.062475Z :INFO: [] MessageGroupId [source6] SessionId [] Write session established. Init response: session_id: "source6|82bc529d-344e80ff-e51a2d0-efc50ff_0" topic: "topic1" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-10T09:39:23.062769Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|82bc529d-344e80ff-e51a2d0-efc50ff_0] Write 1 messages with Id from 1 to 1
2025-11-10T09:39:23.062843Z :INFO: [] MessageGroupId [source6] SessionId [source6|82bc529d-344e80ff-e51a2d0-efc50ff_0] Write session: close. Timeout = 10000 ms
2025-11-10T09:39:23.063254Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|82bc529d-344e80ff-e51a2d0-efc50ff_0] Write session: try to update token
2025-11-10T09:39:23.063303Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|82bc529d-344e80ff-e51a2d0-efc50ff_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-10T09:39:23.063876Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|82bc529d-344e80ff-e51a2d0-efc50ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-10T09:39:23.064204Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-10T09:39:23.064622Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:23.064661Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:23.064736Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-11-10T09:39:23.065040Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-11-10T09:39:23.068038Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:23.068084Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:23.068155Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 1 SourceId: '\0source6' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-10T09:39:23.068214Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][1][StateIdle] Received TPartition::TEvWrite
2025-11-10T09:39:23.068272Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:23.068299Z node 13 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T09:39:23.068335Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:23.068354Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.068386Z node 13 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T09:39:23.068509Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId '\0source6' seqNo 1 partNo 0
2025-11-10T09:39:23.069378Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId '\0source6' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 173 count 1 nextOffset 4 batches 1
2025-11-10T09:39:23.069422Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:23.069443Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-10T09:39:23.069469Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:23.070208Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][1][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000001_00000000000000000003_00000_0000000001_00000? size 161 WTime 1762767563069
2025-11-10T09:39:23.070408Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T09:39:23.070584Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 1 offset 3 partNo 0 count 1 size 161
2025-11-10T09:39:23.075490Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 1 offset 3 count 1 size 161 actorID [13:7571029025308237122:2366]
2025-11-10T09:39:23.075580Z node 13 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T09:39:23.075670Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T09:39:23.075713Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyWrite. Partition: 1
2025-11-10T09:39:23.075770Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][1][StateIdle] Answering for message sourceid: '\0source6', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 3 is stored on disk
2025-11-10T09:39:23.076069Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:23.076091Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.076111Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.076132Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.076151Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:23.076202Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-11-10T09:39:23.076259Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 1  requestId: <none> cookie: 1
2025-11-10T09:39:23.076830Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 1 offset 3 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-10T09:39:23.077291Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait for data done:  readOffset 3 EndOffset 3 newEndOffset 4 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-11-10T09:39:23.077292Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-11-10T09:39:23.077335Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) ready for read with readOffset 3 endOffset 4
2025-11-10T09:39:23.077567Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 3, endOffset# 4, WTime# 1762767562760, sizeLag# 161
2025-11-10T09:39:23.077588Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1TEvPartitionReady. Aval parts: 1
2025-11-10T09:39:23.077632Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 performing read request: guid# f7710149-b784611e-66439c2c-63ed748a, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-10T09:39:23.077696Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid f7710149-b784611e-66439c2c-63ed748a
2025-11-10T09:39:23.078222Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|82bc529d-344e80ff-e51a2d0-efc50ff_0] Write session got write response: sequence_numbers: 1 offsets: 3 already_written: false partition_id: 1 write_statistics { persist_duration_ms: 6 }
2025-11-10T09:39:23.078293Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|82bc529d-344e80ff-e51a2d0-efc50ff_0] Write session: acknoledged message 1
2025-11-10T09:39:23.078243Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:23.078285Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:23.078395Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][1][StateIdle] read cookie 7 Topic 'rt3.dc1--topic1' partition 1 user user offset 3 partno 0 count 1 size 193 endOffset 4 max time lag 0ms effective offset 3
2025-11-10T09:39:23.078712Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][1][StateIdle] read cookie 7 added 1 blobs, size 161 count 1 last offset 3, current partition end offset: 4
2025-11-10T09:39:23.078736Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][1][StateIdle] Reading cookie 7. Send blob request.
2025-11-10T09:39:23.078790Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 1 offset 3 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-10T09:39:23.000000Z
2025-11-10T09:39:23.078836Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-11-10T09:39:23.078890Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-10T09:39:23.079011Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 1 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-11-10T09:39:23.079059Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 3 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-10T09:39:23.079169Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 3
2025-11-10T09:39:23.080173Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 3 Data: "... 98 bytes ..." SourceId: "\000source6" SeqNo: 1 WriteTimestampMS: 1762767563068 CreateTimestampMS: 1762767563062 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 3 }
2025-11-10T09:39:23.080300Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 5 from offset 4
2025-11-10T09:39:23.080336Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 4 ReadOffset 4 ReadGuid f7710149-b784611e-66439c2c-63ed748a has messages 1
2025-11-10T09:39:23.080484Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 read done: guid# f7710149-b784611e-66439c2c-63ed748a, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), size# 199
2025-11-10T09:39:23.080518Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 response to read: guid# f7710149-b784611e-66439c2c-63ed748a
2025-11-10T09:39:23.080725Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 Process answer. Aval parts: 0
2025-11-10T09:39:23.081788Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-10T09:39:23.082169Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 grpc read done: success# 1, data# { read { } }
2025-11-10T09:39:23.082307Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 got read request: guid# 70be737-23c55a37-db9731ab-31d94023
2025-11-10T09:39:23.085230Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:23.085281Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.085315Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.085346Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.085370Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:23.085664Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:23.085697Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.085723Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.085743Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.085756Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:23.162988Z :INFO: [] MessageGroupId [source6] SessionId [source6|82bc529d-344e80ff-e51a2d0-efc50ff_0] Write session will now close
2025-11-10T09:39:23.163050Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|82bc529d-344e80ff-e51a2d0-efc50ff_0] Write session: aborting
2025-11-10T09:39:23.164306Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|82bc529d-344e80ff-e51a2d0-efc50ff_0 grpc read done: success: 0 data: 
2025-11-10T09:39:23.164337Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 7 sessionId: source6|82bc529d-344e80ff-e51a2d0-efc50ff_0 grpc read failed
2025-11-10T09:39:23.164374Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 7 sessionId: source6|82bc529d-344e80ff-e51a2d0-efc50ff_0 grpc closed
2025-11-10T09:39:23.164398Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: source6|82bc529d-344e80ff-e51a2d0-efc50ff_0 is DEAD
2025-11-10T09:39:23.165568Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-11-10T09:39:23.165921Z :INFO: [] MessageGroupId [source6] SessionId [source6|82bc529d-344e80ff-e51a2d0-efc50ff_0] Write session: gracefully shut down, all writes complete
2025-11-10T09:39:23.166121Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [12:7571029037029686334:2540] destroyed
2025-11-10T09:39:23.166176Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][1][StateIdle] TPartition::DropOwner.
2025-11-10T09:39:23.166215Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:23.166236Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.166251Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.166277Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.166299Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:23.167302Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|82bc529d-344e80ff-e51a2d0-efc50ff_0] Write session is aborting and will not restart
2025-11-10T09:39:23.167398Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|82bc529d-344e80ff-e51a2d0-efc50ff_0] Write session: destroy
2025-11-10T09:39:23.169865Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: try to update token
2025-11-10T09:39:23.170162Z :INFO: [] MessageGroupId [source7] SessionId [] Write session: Do CDS request
2025-11-10T09:39:23.170191Z :INFO: [] MessageGroupId [source7] SessionId [] Start write session. Will connect to endpoint: localhost:5412
2025-11-10T09:39:23.174982Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source7" }
2025-11-10T09:39:23.175216Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-10T09:39:23.175248Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 8
2025-11-10T09:39:23.175862Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source7" }
2025-11-10T09:39:23.176022Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 8 topic: "topic1" message_group_id: "source7" from ipv6:[::1]:41250
2025-11-10T09:39:23.176038Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:41250 proto=v1  topic=topic1 durationSec=0
2025-11-10T09:39:23.176047Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-10T09:39:23.177930Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 8 sessionId:  describe result for acl check
2025-11-10T09:39:23.178100Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-10T09:39:23.178115Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-10T09:39:23.178133Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-10T09:39:23.178156Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7571029037029686340:2544] (SourceId=source7, PreferedPartition=(NULL)) StartKqpSession
2025-11-10T09:39:23.182579Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7571029037029686340:2544] (SourceId=source7, PreferedPartition=(NULL)) Select from the table
2025-11-10T09:39:23.185562Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:23.185608Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.185631Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.185658Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.185679Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:23.186486Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:23.186510Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.186523Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.186541Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.186562Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:23.193700Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7571029037029686340:2544] (SourceId=source7, PreferedPartition=(NULL)) RequestPQRB
2025-11-10T09:39:23.194209Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029037029686359:2544] connected; active server actors: 1
2025-11-10T09:39:23.194354Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7571029037029686340:2544] (SourceId=source7, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source7
2025-11-10T09:39:23.194384Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7571029037029686340:2544] (SourceId=source7, PreferedPartition=(NULL)) Update the table
2025-11-10T09:39:23.195634Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029037029686359:2544] disconnected.
2025-11-10T09:39:23.195672Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029037029686359:2544] disconnected; active server actors: 1
2025-11-10T09:39:23.195696Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029037029686359:2544] disconnected no session
2025-11-10T09:39:23.207720Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7571029037029686340:2544] (SourceId=source7, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-10T09:39:23.207770Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7571029037029686340:2544] (SourceId=source7, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-10T09:39:23.207799Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7571029037029686340:2544] (SourceId=source7, PreferedPartition=(NULL)) Start idle
2025-11-10T09:39:23.207838Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 8 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-10T09:39:23.210833Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [12:7571029037029686373:2544], now have 1 active actors on pipe
2025-11-10T09:39:23.210683Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-11-10T09:39:23.211199Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:23.211236Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:23.211317Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source7|7acfb503-1dbc795f-40494c62-e367eb50_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source7
2025-11-10T09:39:23.211354Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:23.211374Z node 13 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T09:39:23.211395Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:23.211416Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.211458Z node 13 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T09:39:23.211494Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:23.211514Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T09:39:23.211540Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:23.211586Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T09:39:23.211645Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:23.212440Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:23.212467Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:23.212553Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:23.212966Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 8 partition: 0 MaxSeqNo: 0 sessionId: source7|7acfb503-1dbc795f-40494c62-e367eb50_0
2025-11-10T09:39:23.213851Z :INFO: [] MessageGroupId [source7] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762767563213 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-10T09:39:23.214001Z :INFO: [] MessageGroupId [source7] SessionId [] Write session established. Init response: session_id: "source7|7acfb503-1dbc795f-40494c62-e367eb50_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-10T09:39:23.214267Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|7acfb503-1dbc795f-40494c62-e367eb50_0] Write 1 messages with Id from 1 to 1
2025-11-10T09:39:23.214333Z :INFO: [] MessageGroupId [source7] SessionId [source7|7acfb503-1dbc795f-40494c62-e367eb50_0] Write session: close. Timeout = 10000 ms
2025-11-10T09:39:23.214787Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|7acfb503-1dbc795f-40494c62-e367eb50_0] Write session: try to update token
2025-11-10T09:39:23.214858Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|7acfb503-1dbc795f-40494c62-e367eb50_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-10T09:39:23.215414Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|7acfb503-1dbc795f-40494c62-e367eb50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-10T09:39:23.215706Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-10T09:39:23.216223Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:23.216258Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:23.216327Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-10T09:39:23.216584Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-10T09:39:23.216999Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:23.217024Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:23.217099Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source7' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-10T09:39:23.217150Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T09:39:23.217199Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:23.217231Z node 13 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T09:39:23.217267Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:23.217285Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.217318Z node 13 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T09:39:23.217436Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source7' seqNo 1 partNo 0
2025-11-10T09:39:23.298400Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source7' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 173 count 1 nextOffset 4 batches 1
2025-11-10T09:39:23.298480Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:23.298503Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T09:39:23.298530Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:23.299290Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00000? size 161 WTime 1762767563298
2025-11-10T09:39:23.299558Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:23.299593Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.299613Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.299636Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.299650Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:23.299688Z node 13 :PERSQUEUE DEBUG: partition.cpp:2286: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-10T09:39:23.299714Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T09:39:23.299890Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 161
2025-11-10T09:39:23.310054Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 161 actorID [13:7571029025308237122:2366]
2025-11-10T09:39:23.310149Z node 13 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T09:39:23.310229Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T09:39:23.310272Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T09:39:23.310327Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source7', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 3 is stored on disk
2025-11-10T09:39:23.310635Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:23.310656Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.310674Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.310695Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.310713Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:23.310751Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T09:39:23.310806Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-10T09:39:23.311101Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-10T09:39:23.314550Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait for data done:  readOffset 3 EndOffset 3 newEndOffset 4 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-11-10T09:39:23.314595Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) ready for read with readOffset 3 endOffset 4
2025-11-10T09:39:23.314664Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-10T09:39:23.315171Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 3, endOffset# 4, WTime# 1762767562916, sizeLag# 161
2025-11-10T09:39:23.315189Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1TEvPartitionReady. Aval parts: 1
2025-11-10T09:39:23.315236Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 performing read request: guid# 70be737-23c55a37-db9731ab-31d94023, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-10T09:39:23.315293Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid 70be737-23c55a37-db9731ab-31d94023
2025-11-10T09:39:23.316221Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|7acfb503-1dbc795f-40494c62-e367eb50_0] Write session got write response: sequence_numbers: 1 offsets: 3 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 81 }
2025-11-10T09:39:23.316306Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|7acfb503-1dbc795f-40494c62-e367eb50_0] Write session: acknoledged message 1
2025-11-10T09:39:23.316420Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:23.316460Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:23.316557Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--topic1' partition 0 user user offset 3 partno 0 count 1 size 193 endOffset 4 max time lag 0ms effective offset 3
2025-11-10T09:39:23.316811Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 161 count 1 last offset 3, current partition end offset: 4
2025-11-10T09:39:23.316829Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-11-10T09:39:23.316868Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-10T09:39:23.000000Z
2025-11-10T09:39:23.316903Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-11-10T09:39:23.316936Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-10T09:39:23.317110Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 3 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-10T09:39:23.317206Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-11-10T09:39:23.317828Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 3 Data: "... 98 bytes ..." SourceId: "\000source7" SeqNo: 1 WriteTimestampMS: 1762767563217 CreateTimestampMS: 1762767563214 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 3 }
2025-11-10T09:39:23.317910Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 5 from offset 4
2025-11-10T09:39:23.317935Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 4 ReadOffset 4 ReadGuid 70be737-23c55a37-db9731ab-31d94023 has messages 1
2025-11-10T09:39:23.318005Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 read done: guid# 70be737-23c55a37-db9731ab-31d94023, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), size# 197
2025-11-10T09:39:23.318023Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 response to read: guid# 70be737-23c55a37-db9731ab-31d94023
2025-11-10T09:39:23.318163Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 Process answer. Aval parts: 0
2025-11-10T09:39:23.318740Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-10T09:39:23.317457Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-11-10T09:39:23.325311Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 grpc read done: success# 1, data# { read { } }
2025-11-10T09:39:23.325502Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 got read request: guid# c1ea105d-17f93990-46577861-4ab417e7
2025-11-10T09:39:23.400096Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:23.400157Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.400180Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.400211Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.400229Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:23.400283Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:23.400296Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.400308Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.400324Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.400336Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:23.415055Z :INFO: [] MessageGroupId [source7] SessionId [source7|7acfb503-1dbc795f-40494c62-e367eb50_0] Write session will now close
2025-11-10T09:39:23.415106Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|7acfb503-1dbc795f-40494c62-e367eb50_0] Write session: aborting
2025-11-10T09:39:23.415432Z :INFO: [] MessageGroupId [source7] SessionId [source7|7acfb503-1dbc795f-40494c62-e367eb50_0] Write session: gracefully shut down, all writes complete
2025-11-10T09:39:23.415469Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|7acfb503-1dbc795f-40494c62-e367eb50_0] Write session: destroy
2025-11-10T09:39:23.416561Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: try to update token
2025-11-10T09:39:23.418144Z :INFO: [] MessageGroupId [source8] SessionId [] Write session: Do CDS request
2025-11-10T09:39:23.418196Z :INFO: [] MessageGroupId [source8] SessionId [] Start write session. Will connect to endpoint: localhost:5412
2025-11-10T09:39:23.419565Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|7acfb503-1dbc795f-40494c62-e367eb50_0 grpc read done: success: 0 data: 
2025-11-10T09:39:23.419600Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 8 sessionId: source7|7acfb503-1dbc795f-40494c62-e367eb50_0 grpc read failed
2025-11-10T09:39:23.419642Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 8 sessionId: source7|7acfb503-1dbc795f-40494c62-e367eb50_0 grpc closed
2025-11-10T09:39:23.419669Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 8 sessionId: source7|7acfb503-1dbc795f-40494c62-e367eb50_0 is DEAD
2025-11-10T09:39:23.420939Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-10T09:39:23.421480Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [12:7571029037029686373:2544] destroyed
2025-11-10T09:39:23.421536Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-10T09:39:23.421585Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:23.421607Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.421629Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.421651Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.421673Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:23.423174Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source8" }
2025-11-10T09:39:23.423404Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-10T09:39:23.423447Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 9
2025-11-10T09:39:23.423787Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source8" }
2025-11-10T09:39:23.423950Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 9 topic: "topic1" message_group_id: "source8" from ipv6:[::1]:41250
2025-11-10T09:39:23.423976Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=9 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:41250 proto=v1  topic=topic1 durationSec=0
2025-11-10T09:39:23.423987Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-10T09:39:23.426072Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 9 sessionId:  describe result for acl check
2025-11-10T09:39:23.426245Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-10T09:39:23.426260Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-10T09:39:23.426276Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-10T09:39:23.426300Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7571029037029686385:2550] (SourceId=source8, PreferedPartition=(NULL)) StartKqpSession
2025-11-10T09:39:23.430691Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7571029037029686385:2550] (SourceId=source8, PreferedPartition=(NULL)) Select from the table
2025-11-10T09:39:23.438984Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7571029037029686385:2550] (SourceId=source8, PreferedPartition=(NULL)) RequestPQRB
2025-11-10T09:39:23.439895Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029037029686404:2550] connected; active server actors: 1
2025-11-10T09:39:23.439962Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7571029037029686385:2550] (SourceId=source8, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source8
2025-11-10T09:39:23.439995Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7571029037029686385:2550] (SourceId=source8, PreferedPartition=(NULL)) Update the table
2025-11-10T09:39:23.440482Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029037029686404:2550] disconnected.
2025-11-10T09:39:23.440514Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029037029686404:2550] disconnected; active server actors: 1
2025-11-10T09:39:23.440544Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029037029686404:2550] disconnected no session
2025-11-10T09:39:23.455935Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7571029037029686385:2550] (SourceId=source8, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-10T09:39:23.455990Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7571029037029686385:2550] (SourceId=source8, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-10T09:39:23.456020Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7571029037029686385:2550] (SourceId=source8, PreferedPartition=(NULL)) Start idle
2025-11-10T09:39:23.456060Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 9 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-10T09:39:23.457812Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [12:7571029037029686418:2550], now have 1 active actors on pipe
2025-11-10T09:39:23.458031Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-11-10T09:39:23.458339Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:23.458379Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:23.458463Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source8|e4ce4f9a-fe3df40-a0d8fbca-289640e7_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source8
2025-11-10T09:39:23.458511Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:23.458538Z node 13 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T09:39:23.458560Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:23.458585Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.458610Z node 13 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T09:39:23.458649Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:23.458672Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T09:39:23.458698Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:23.458746Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T09:39:23.458805Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:23.459295Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:23.459321Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:23.459408Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:23.459724Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 9 partition: 0 MaxSeqNo: 0 sessionId: source8|e4ce4f9a-fe3df40-a0d8fbca-289640e7_0
2025-11-10T09:39:23.460565Z :INFO: [] MessageGroupId [source8] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762767563460 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-10T09:39:23.460748Z :INFO: [] MessageGroupId [source8] SessionId [] Write session established. Init response: session_id: "source8|e4ce4f9a-fe3df40-a0d8fbca-289640e7_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-10T09:39:23.462810Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|e4ce4f9a-fe3df40-a0d8fbca-289640e7_0] Write 1 messages with Id from 1 to 1
2025-11-10T09:39:23.462902Z :INFO: [] MessageGroupId [source8] SessionId [source8|e4ce4f9a-fe3df40-a0d8fbca-289640e7_0] Write session: close. Timeout = 10000 ms
2025-11-10T09:39:23.463247Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|e4ce4f9a-fe3df40-a0d8fbca-289640e7_0] Write session: try to update token
2025-11-10T09:39:23.463292Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|e4ce4f9a-fe3df40-a0d8fbca-289640e7_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-10T09:39:23.463916Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|e4ce4f9a-fe3df40-a0d8fbca-289640e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-10T09:39:23.464213Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-10T09:39:23.464729Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:23.464781Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:23.464887Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-10T09:39:23.466267Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:23.466319Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:23.466411Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source8' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-10T09:39:23.466500Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T09:39:23.466573Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:23.466606Z node 13 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T09:39:23.466649Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:23.466676Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.466711Z node 13 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T09:39:23.466860Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source8' seqNo 1 partNo 0
2025-11-10T09:39:23.467809Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source8' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 173 count 1 nextOffset 5 batches 1
2025-11-10T09:39:23.467870Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:23.467893Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T09:39:23.467920Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:23.465501Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-10T09:39:23.469438Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00000? size 161 WTime 1762767563469
2025-11-10T09:39:23.469708Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T09:39:23.469907Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 161
2025-11-10T09:39:23.474990Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 161 actorID [13:7571029025308237122:2366]
2025-11-10T09:39:23.475090Z node 13 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T09:39:23.475179Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T09:39:23.475235Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T09:39:23.475293Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source8', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 4 is stored on disk
2025-11-10T09:39:23.475626Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:23.475654Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-10T09:39:23.475657Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.475678Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.475701Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.475720Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:23.475762Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T09:39:23.475822Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-10T09:39:23.476258Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait for data done:  readOffset 4 EndOffset 4 newEndOffset 5 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-11-10T09:39:23.476293Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) ready for read with readOffset 4 endOffset 5
2025-11-10T09:39:23.476354Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 4, endOffset# 5, WTime# 1762767563217, sizeLag# 161
2025-11-10T09:39:23.476372Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1TEvPartitionReady. Aval parts: 1
2025-11-10T09:39:23.476419Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 performing read request: guid# c1ea105d-17f93990-46577861-4ab417e7, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-10T09:39:23.476468Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid c1ea105d-17f93990-46577861-4ab417e7
2025-11-10T09:39:23.476888Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-10T09:39:23.476918Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:23.476965Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T09:39:23.477116Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--topic1' partition 0 user user offset 4 partno 0 count 1 size 193 endOffset 5 max time lag 0ms effective offset 4
2025-11-10T09:39:23.477455Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 161 count 1 last offset 4, current partition end offset: 5
2025-11-10T09:39:23.477487Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-11-10T09:39:23.477541Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-10T09:39:23.000000Z
2025-11-10T09:39:23.477590Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-11-10T09:39:23.477660Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-10T09:39:23.477669Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-11-10T09:39:23.477846Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 4 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-10T09:39:23.477974Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-11-10T09:39:23.478543Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 4 Data: "... 98 bytes ..." SourceId: "\000source8" SeqNo: 1 WriteTimestampMS: 1762767563466 CreateTimestampMS: 1762767563462 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 4 }
2025-11-10T09:39:23.478683Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 6 from offset 5
2025-11-10T09:39:23.478724Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 5 ReadOffset 5 ReadGuid c1ea105d-17f93990-46577861-4ab417e7 has messages 1
2025-11-10T09:39:23.478855Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 read done: guid# c1ea105d-17f93990-46577861-4ab417e7, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), size# 197
2025-11-10T09:39:23.478885Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 response to read: guid# c1ea105d-17f93990-46577861-4ab417e7
2025-11-10T09:39:23.479081Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 Process answer. Aval parts: 0
2025-11-10T09:39:23.479339Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|e4ce4f9a-fe3df40-a0d8fbca-289640e7_0] Write session got write response: sequence_numbers: 1 offsets: 4 already_written: false write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 1 }
2025-11-10T09:39:23.479408Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|e4ce4f9a-fe3df40-a0d8fbca-289640e7_0] Write session: acknoledged message 1
2025-11-10T09:39:23.479991Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-10T09:39:23.480147Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 grpc read done: success# 1, data# { read { } }
2025-11-10T09:39:23.480249Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 got read request: guid# addaaac9-a9f09e55-2ed80ec4-6724bd3f
2025-11-10T09:39:23.501523Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:23.501588Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.501625Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.501656Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.501676Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:23.501731Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:23.501746Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.501757Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.501771Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.501784Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:23.564184Z :INFO: [] MessageGroupId [source8] SessionId [source8|e4ce4f9a-fe3df40-a0d8fbca-289640e7_0] Write session will now close
2025-11-10T09:39:23.564240Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|e4ce4f9a-fe3df40-a0d8fbca-289640e7_0] Write session: aborting
2025-11-10T09:39:23.565490Z :INFO: [] MessageGroupId [source8] SessionId [source8|e4ce4f9a-fe3df40-a0d8fbca-289640e7_0] Write session: gracefully shut down, all writes complete
2025-11-10T09:39:23.565962Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|e4ce4f9a-fe3df40-a0d8fbca-289640e7_0] Write session is aborting and will not restart
2025-11-10T09:39:23.566212Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|e4ce4f9a-fe3df40-a0d8fbca-289640e7_0] Write session: destroy
2025-11-10T09:39:23.567848Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: try to update token
2025-11-10T09:39:23.568186Z :INFO: [] MessageGroupId [source9] SessionId [] Write session: Do CDS request
2025-11-10T09:39:23.568220Z :INFO: [] MessageGroupId [source9] SessionId [] Start write session. Will connect to endpoint: localhost:5412
2025-11-10T09:39:23.569133Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|e4ce4f9a-fe3df40-a0d8fbca-289640e7_0 grpc read done: success: 0 data: 
2025-11-10T09:39:23.569165Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 9 sessionId: source8|e4ce4f9a-fe3df40-a0d8fbca-289640e7_0 grpc read failed
2025-11-10T09:39:23.569211Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 9 sessionId: source8|e4ce4f9a-fe3df40-a0d8fbca-289640e7_0 grpc closed
2025-11-10T09:39:23.569236Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 9 sessionId: source8|e4ce4f9a-fe3df40-a0d8fbca-289640e7_0 is DEAD
2025-11-10T09:39:23.570591Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-10T09:39:23.571011Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [12:7571029037029686418:2550] destroyed
2025-11-10T09:39:23.571089Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-10T09:39:23.571133Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:23.571161Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.571177Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.571202Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.571223Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:23.573873Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source9" }
2025-11-10T09:39:23.574120Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-10T09:39:23.574152Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 10
2025-11-10T09:39:23.574617Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source9" }
2025-11-10T09:39:23.574794Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 10 topic: "topic1" message_group_id: "source9" from ipv6:[::1]:41250
2025-11-10T09:39:23.574824Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=10 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:41250 proto=v1  topic=topic1 durationSec=0
2025-11-10T09:39:23.574836Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-10T09:39:23.576904Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 10 sessionId:  describe result for acl check
2025-11-10T09:39:23.577110Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-10T09:39:23.577125Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-10T09:39:23.577142Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-10T09:39:23.577167Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7571029037029686428:2554] (SourceId=source9, PreferedPartition=(NULL)) StartKqpSession
2025-11-10T09:39:23.581265Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7571029037029686428:2554] (SourceId=source9, PreferedPartition=(NULL)) Select from the table
2025-11-10T09:39:23.589607Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7571029037029686428:2554] (SourceId=source9, PreferedPartition=(NULL)) RequestPQRB
2025-11-10T09:39:23.589917Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029037029686447:2554] connected; active server actors: 1
2025-11-10T09:39:23.589975Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7571029037029686428:2554] (SourceId=source9, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=source9
2025-11-10T09:39:23.590001Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7571029037029686428:2554] (SourceId=source9, PreferedPartition=(NULL)) Update the table
2025-11-10T09:39:23.590917Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029037029686447:2554] disconnected.
2025-11-10T09:39:23.590947Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029037029686447:2554] disconnected; active server actors: 1
2025-11-10T09:39:23.590967Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [12:7571029037029686447:2554] disconnected no session
2025-11-10T09:39:23.601818Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:23.601861Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.601882Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.601909Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.601929Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:23.601977Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:23.601988Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.601998Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.602026Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.602036Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:23.603808Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7571029037029686428:2554] (SourceId=source9, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-10T09:39:23.603863Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7571029037029686428:2554] (SourceId=source9, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-11-10T09:39:23.603896Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7571029037029686428:2554] (SourceId=source9, PreferedPartition=(NULL)) Start idle
2025-11-10T09:39:23.603940Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 10 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-11-10T09:39:23.604847Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [12:7571029037029686462:2554], now have 1 active actors on pipe
2025-11-10T09:39:23.605080Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-11-10T09:39:23.605447Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:23.605499Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:23.605600Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source9|e7a32a15-aa69737b-2bc9fccf-8dd0dbb1_0 generated for partition 1 topic 'rt3.dc1--topic1' owner source9
2025-11-10T09:39:23.605658Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:23.605680Z node 13 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T09:39:23.605710Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:23.605735Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.605762Z node 13 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T09:39:23.605809Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:23.605835Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-10T09:39:23.605861Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:23.605919Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyOwnerOk. Partition: 1
2025-11-10T09:39:23.606003Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:23.606500Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:23.606534Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:23.606624Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T09:39:23.607001Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 10 partition: 1 MaxSeqNo: 0 sessionId: source9|e7a32a15-aa69737b-2bc9fccf-8dd0dbb1_0
2025-11-10T09:39:23.607842Z :INFO: [] MessageGroupId [source9] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762767563607 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-10T09:39:23.608048Z :INFO: [] MessageGroupId [source9] SessionId [] Write session established. Init response: session_id: "source9|e7a32a15-aa69737b-2bc9fccf-8dd0dbb1_0" topic: "topic1" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-10T09:39:23.608336Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|e7a32a15-aa69737b-2bc9fccf-8dd0dbb1_0] Write 1 messages with Id from 1 to 1
2025-11-10T09:39:23.608419Z :INFO: [] MessageGroupId [source9] SessionId [source9|e7a32a15-aa69737b-2bc9fccf-8dd0dbb1_0] Write session: close. Timeout = 10000 ms
2025-11-10T09:39:23.608809Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|e7a32a15-aa69737b-2bc9fccf-8dd0dbb1_0] Write session: try to update token
2025-11-10T09:39:23.608878Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|e7a32a15-aa69737b-2bc9fccf-8dd0dbb1_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-10T09:39:23.610518Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|e7a32a15-aa69737b-2bc9fccf-8dd0dbb1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-10T09:39:23.610880Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-10T09:39:23.611287Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:23.611339Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:23.611427Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-11-10T09:39:23.611626Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-11-10T09:39:23.616071Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:23.616140Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:23.616225Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 1 SourceId: '\0source9' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-10T09:39:23.616315Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][1][StateIdle] Received TPartition::TEvWrite
2025-11-10T09:39:23.616388Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:23.616421Z node 13 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T09:39:23.616467Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T09:39:23.616492Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.616535Z node 13 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T09:39:23.616692Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId '\0source9' seqNo 1 partNo 0
2025-11-10T09:39:23.659683Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId '\0source9' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 173 count 1 nextOffset 5 batches 1
2025-11-10T09:39:23.659765Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T09:39:23.659788Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-10T09:39:23.659816Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:23.660879Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][1][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000001_00000000000000000004_00000_0000000001_00000? size 161 WTime 1762767563660
2025-11-10T09:39:23.661175Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T09:39:23.662027Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 1 offset 4 partNo 0 count 1 size 161
2025-11-10T09:39:23.674071Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 1 offset 4 count 1 size 161 actorID [13:7571029025308237122:2366]
2025-11-10T09:39:23.674172Z node 13 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T09:39:23.674256Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T09:39:23.674303Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyWrite. Partition: 1
2025-11-10T09:39:23.674344Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][1][StateIdle] Answering for message sourceid: '\0source9', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 4 is stored on disk
2025-11-10T09:39:23.674594Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:23.674610Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.674626Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.674641Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.674657Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:23.674687Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-11-10T09:39:23.674727Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 1  requestId: <none> cookie: 1
2025-11-10T09:39:23.675468Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait for data done:  readOffset 4 EndOffset 4 newEndOffset 5 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-11-10T09:39:23.675505Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) ready for read with readOffset 4 endOffset 5
2025-11-10T09:39:23.675564Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-11-10T09:39:23.675645Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 4, endOffset# 5, WTime# 1762767563068, sizeLag# 161
2025-11-10T09:39:23.675678Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1TEvPartitionReady. Aval parts: 1
2025-11-10T09:39:23.675723Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 performing read request: guid# addaaac9-a9f09e55-2ed80ec4-6724bd3f, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-10T09:39:23.675788Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid addaaac9-a9f09e55-2ed80ec4-6724bd3f
2025-11-10T09:39:23.675219Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 1 offset 4 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-10T09:39:23.676589Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T09:39:23.676640Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-10T09:39:23.676778Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][1][StateIdle] read cookie 8 Topic 'rt3.dc1--topic1' partition 1 user user offset 4 partno 0 count 1 size 193 endOffset 5 max time lag 0ms effective offset 4
2025-11-10T09:39:23.677142Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][1][StateIdle] read cookie 8 added 1 blobs, size 161 count 1 last offset 4, current partition end offset: 5
2025-11-10T09:39:23.677173Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][1][StateIdle] Reading cookie 8. Send blob request.
2025-11-10T09:39:23.677233Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 1 offset 4 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-10T09:39:23.000000Z
2025-11-10T09:39:23.677283Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-11-10T09:39:23.677353Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-10T09:39:23.677544Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 4 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-10T09:39:23.677678Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 4
2025-11-10T09:39:23.677941Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 1 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-11-10T09:39:23.678448Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 4 Data: "... 98 bytes ..." SourceId: "\000source9" SeqNo: 1 WriteTimestampMS: 1762767563616 CreateTimestampMS: 1762767563608 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 4 }
2025-11-10T09:39:23.679873Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|e7a32a15-aa69737b-2bc9fccf-8dd0dbb1_0] Write session got write response: sequence_numbers: 1 offsets: 4 already_written: false partition_id: 1 write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 43 }
2025-11-10T09:39:23.678597Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 6 from offset 5
2025-11-10T09:39:23.678638Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 5 ReadOffset 5 ReadGuid addaaac9-a9f09e55-2ed80ec4-6724bd3f has messages 1
2025-11-10T09:39:23.679956Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|e7a32a15-aa69737b-2bc9fccf-8dd0dbb1_0] Write session: acknoledged message 1
2025-11-10T09:39:23.678751Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 read done: guid# addaaac9-a9f09e55-2ed80ec4-6724bd3f, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), size# 199
2025-11-10T09:39:23.678784Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 response to read: guid# addaaac9-a9f09e55-2ed80ec4-6724bd3f
2025-11-10T09:39:23.679065Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 Process answer. Aval parts: 0
2025-11-10T09:39:23.680578Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-10T09:39:23.680852Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 grpc read done: success# 1, data# { read { } }
2025-11-10T09:39:23.681020Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 got read request: guid# 8b4c7613-f076c15a-d5a8c805-5fc450e
2025-11-10T09:39:23.702622Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:23.702674Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.702702Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.702735Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.702758Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:23.702811Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T09:39:23.702824Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.702848Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.702864Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.702876Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T09:39:23.708569Z :INFO: [] MessageGroupId [source9] SessionId [source9|e7a32a15-aa69737b-2bc9fccf-8dd0dbb1_0] Write session will now close
2025-11-10T09:39:23.708634Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|e7a32a15-aa69737b-2bc9fccf-8dd0dbb1_0] Write session: aborting
2025-11-10T09:39:23.709229Z :INFO: [] MessageGroupId [source9] SessionId [source9|e7a32a15-aa69737b-2bc9fccf-8dd0dbb1_0] Write session: gracefully shut down, all writes complete
2025-11-10T09:39:23.709270Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|e7a32a15-aa69737b-2bc9fccf-8dd0dbb1_0] Write session: destroy
===== Write =====
MessagesInflight: 10
BytesInflightUncompressed: 0
BytesInflightCompressed: 270
BytesInflightTotal: 270
============
===== StartFuncs-1 =====
MessagesInflight: 10
BytesInflightUncompressed: 0
BytesInflightCompressed: 270
BytesInflightTotal: 270
============
2025-11-10T09:39:23.713903Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|e7a32a15-aa69737b-2bc9fccf-8dd0dbb1_0 grpc read done: success: 0 data: 
2025-11-10T09:39:23.713953Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 10 sessionId: source9|e7a32a15-aa69737b-2bc9fccf-8dd0dbb1_0 grpc read failed
2025-11-10T09:39:23.714440Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 10 sessionId: source9|e7a32a15-aa69737b-2bc9fccf-8dd0dbb1_0
2025-11-10T09:39:23.714471Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 10 sessionId: source9|e7a32a15-aa69737b-2bc9fccf-8dd0dbb1_0 is DEAD
2025-11-10T09:39:23.715020Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-11-10T09:39:23.717435Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [12:7571029037029686462:2554] destroyed
2025-11-10T09:39:23.717507Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][1][StateIdle] TPartition::DropOwner.
2025-11-10T09:39:23.717564Z node 13 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-10T09:39:23.717585Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.717603Z node 13 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-10T09:39:23.717628Z node 13 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T09:39:23.717651Z node 13 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-10T09:39:23.721245Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-11-10T09:39:23.725335Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-11-10T09:39:23.725408Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (1-1)
2025-11-10T09:39:23.725471Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 1 (2-2)
2025-11-10T09:39:23.725774Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-11-10T09:39:23.725943Z :DEBUG: [] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-10T09:39:23.726022Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] The application data is transferred to the client. Number of messages 1, size 15 bytes
Got message: DataReceived { PartitionStreamId: 2 PartitionId: 0 Message { Data: ..15 bytes.. Partition stream id: 2 Cluster: "dc1". Topic: "topic1" Partition: 0 PartitionKey: "" Information: { Offset: 0 SeqNo: 1 MessageGroupId: "source1" CreateTime: 2025-11-10T09:39:22.297000Z WriteTime: 2025-11-10T09:39:22.301000Z Ip: "ipv6:[::1]:41250" UncompressedSize: 15 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:41250" } } } }
2025-11-10T09:39:23.726313Z :DEBUG: [] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-11-10T09:39:23.726388Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] The application data is transferred to the client. Number of messages 1, size 15 bytes
Got message: DataReceived { PartitionStreamId: 2 PartitionId: 0 Message { Data: ..15 bytes.. Partition stream id: 2 Cluster: "dc1". Topic: "topic1" Partition: 0 PartitionKey: "" Information: { Offset: 1 SeqNo: 1 MessageGroupId: "source3" CreateTime: 2025-11-10T09:39:22.609000Z WriteTime: 2025-11-10T09:39:22.614000Z Ip: "ipv6:[::1]:41250" UncompressedSize: 15 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:41250" } } } }
2025-11-10T09:39:23.726641Z :DEBUG: [] Take Data. Partition 1. Read: {0, 0} (0-0)
2025-11-10T09:39:23.726722Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] The application data is transferred to the client. Number of messages 1, size 15 bytes
Got message: DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..15 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "topic1" Partition: 1 PartitionKey: "" Information: { Offset: 0 SeqNo: 1 MessageGroupId: "source0" CreateTime: 2025-11-10T09:39:22.125000Z WriteTime: 2025-11-10T09:39:22.131000Z Ip: "ipv6:[::1]:41250" UncompressedSize: 15 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:41250" } } } }
2025-11-10T09:39:23.726974Z :DEBUG: [] Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-10T09:39:23.727034Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] The application data is transferred to the client. Number of messages 1, size 15 bytes
Got message: DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..15 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "topic1" Partition: 1 PartitionKey: "" Information: { Offset: 1 SeqNo: 1 MessageGroupId: "source2" CreateTime: 2025-11-10T09:39:22.462000Z WriteTime: 2025-11-10T09:39:22.465000Z Ip: "ipv6:[::1]:41250" UncompressedSize: 15 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:41250" } } } }
2025-11-10T09:39:23.727287Z :DEBUG: [] Take Data. Partition 1. Read: {0, 0} (2-2)
2025-11-10T09:39:23.727361Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] The application data is transferred to the client. Number of messages 1, size 15 bytes
Got message: DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..15 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "topic1" Partition: 1 PartitionKey: "" Information: { Offset: 2 SeqNo: 1 MessageGroupId: "source4" CreateTime: 2025-11-10T09:39:22.761000Z WriteTime: 2025-11-10T09:39:22.760000Z Ip: "ipv6:[::1]:41250" UncompressedSize: 15 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:41250" } } } }
===== doRead(5) =====
MessagesInflight: 5
BytesInflightUncompressed: 0
BytesInflightCompressed: 135
BytesInflightTotal: 135
============
>>>> Delete topic
CallPersQueueGRPC request to localhost:5412
MetaRequest {
  CmdDeleteTopic {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-10T09:39:23.731250Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpDropPersQueueGroup, opId: 281474976710695:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_drop_pq.cpp:422)
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710695
  SchemeShardTabletId: 72057594046644480
}
ErrorCode: OK
2025-11-10T09:39:23.739493Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1523: [PQ: 72075186224037892] Handle TEvPersQueue::TEvDropTablet
2025-11-10T09:39:23.747947Z node 12 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [12:7571029037029686484:3698] txid# 281474976710696, issues: { message: "Path does not exist" issue_code: 200200 severity: 1 }
RemoveTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; DELETE FROM `/Root/PQ/Config/V2/Topics` WHERE path = $path AND dc = $cluster; UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-11-10T09:39:23.757349Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1766: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 balancer dead, restarting all from topic: topic# Topic rt3.dc1--topic1 in dc dc1 in database: Root
2025-11-10T09:39:23.757356Z node 12 :HIVE WARN: hive_impl.cpp:516: HIVE#72057594037968897 Handle TEvLocal::TEvTabletStatus from node 12, TabletId: 72075186224037893 not found
2025-11-10T09:39:23.757701Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1721: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)
2025-11-10T09:39:23.757740Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1639: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 released: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)
2025-11-10T09:39:23.757856Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1721: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)
2025-11-10T09:39:23.757880Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1639: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 released: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)
2025-11-10T09:39:23.757988Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 register session: topic# rt3.dc1--topic1
2025-11-10T09:39:23.759324Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [12:7571029028439751266:2474] destroyed
2025-11-10T09:39:23.759372Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_12_1_421379334442898555_v1
2025-11-10T09:39:23.759405Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [12:7571029028439751385:2493] destroyed
2025-11-10T09:39:23.759423Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_12_1_421379334442898555_v1
2025-11-10T09:39:23.759461Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [12:7571029028439751383:2492] destroyed
2025-11-10T09:39:23.759532Z node 13 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_12_1_421379334442898555_v1
2025-11-10T09:39:23.759551Z node 13 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_12_1_421379334442898555_v1
2025-11-10T09:39:23.764687Z node 12 :HIVE WARN: hive_impl.cpp:516: HIVE#72057594037968897 Handle TEvLocal::TEvTabletStatus from node 13, TabletId: 72075186224037892 not found
2025-11-10T09:39:23.995753Z node 12 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710697. Ctx: { TraceId: 01k9pj4tzz0k9q44gz5gkb8aad, Database: , SessionId: ydb://session/3?node_id=12&id=MTJjODQ0OWEtNDMyZDE3ZDItY2Y2ZmI3NGYtODVmODc5MDQ=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
CallPersQueueGRPC request to localhost:5412
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-10T09:39:24.052288Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
>>>> Topic deleted
Got message: PartitionStreamClosed { PartitionStreamId: 2 PartitionId: 0 Reason: Lost }
Got message: PartitionStreamClosed { PartitionStreamId: 1 PartitionId: 1 Reason: Lost }
===== StartFuncs-2 =====
MessagesInflight: 5
BytesInflightUncompressed: 0
BytesInflightCompressed: 135
BytesInflightTotal: 135
============
2025-11-10T09:39:29.062703Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-11-10T09:39:29.062732Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 1 (3-3)
2025-11-10T09:39:29.062879Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (4-4)
2025-11-10T09:39:29.062897Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (3-3)
2025-11-10T09:39:29.063010Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 1 (4-4)
===== End =====
MessagesInflight: 0
BytesInflightUncompressed: 0
BytesInflightCompressed: 0
BytesInflightTotal: 0
============
2025-11-10T09:39:30.064214Z :INFO: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] Closing read session. Close timeout: 0.000000s
2025-11-10T09:39:30.064301Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-11-10T09:39:30.064361Z :INFO: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] Counters: { Errors: 0 CurrentSessionLifetimeMs: 8379 BytesRead: 150 MessagesRead: 10 BytesReadCompressed: 270 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-10T09:39:30.064512Z :NOTICE: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-10T09:39:30.064580Z :DEBUG: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] [null] Abort session to cluster
2025-11-10T09:39:30.065256Z :NOTICE: [] [] [61cd90f6-183f69de-35024454-3b9afcf7] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-10T09:39:30.068895Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 grpc read done: success# 0, data# {  }
2025-11-10T09:39:30.068929Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 grpc read failed
2025-11-10T09:39:30.068959Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 grpc closed
2025-11-10T09:39:30.068989Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_12_1_421379334442898555_v1 is DEAD
