Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
151 commits
Select commit Hold shift + click to select a range
826e446
More work
cheatfate Aug 12, 2025
2c98420
More changes.
cheatfate Aug 20, 2025
5f59c4b
Add sync access to engine events.
cheatfate Aug 21, 2025
9ffb068
Add groupSidecars(DataColumnsByRootIdentifier).
cheatfate Aug 25, 2025
ca729e7
Addressing some TODOs in overseer.
cheatfate Aug 25, 2025
52f3060
Add missing shortLog()
cheatfate Aug 25, 2025
6a61ba4
Replace one more TODO.
cheatfate Aug 25, 2025
08ca9d7
Addressing column intersection TODO.
cheatfate Aug 25, 2025
c41acfa
Add event handlers.
cheatfate Aug 25, 2025
f392978
Update events implementation.
cheatfate Aug 26, 2025
0cb709c
Add some debugging logs.
cheatfate Aug 26, 2025
b61dec6
Fix crash.
cheatfate Aug 26, 2025
ced8eb3
Fix some issues and add some more debug logging.
cheatfate Aug 27, 2025
e421dd7
Move all the blocks received on `range` step to the BlockBuffer.
cheatfate Aug 27, 2025
c2c8f9f
Upgrade BlockBuffer.
cheatfate Sep 1, 2025
0ed267a
Fix assertion crash.
cheatfate Sep 1, 2025
70458c5
Fix how sidecars checking procedures.
cheatfate Sep 2, 2025
343be1b
Do fixes of byroot sync.
cheatfate Sep 2, 2025
ad4dc38
Fix compilation issues.
cheatfate Sep 2, 2025
8f2d512
Add loop pause when there is no work to do.
cheatfate Sep 3, 2025
5f70013
Fix incremental math.
cheatfate Sep 3, 2025
61cf6ba
Make blobs and columns lists in logs smaller.
cheatfate Sep 3, 2025
6b0be06
Actively reload how columns/blobs are logged.
cheatfate Sep 3, 2025
eb30616
Investigation of peer's endless loop issue.
cheatfate Sep 3, 2025
83fdb20
Add performance meters.
cheatfate Sep 4, 2025
f967656
Fix performance counter issues.
cheatfate Sep 4, 2025
eaa966b
Add finalization event pruning.
cheatfate Sep 5, 2025
3b3d8da
Post rebase fixes.
cheatfate Sep 5, 2025
9f9112d
Add more conditions to peerPause.
cheatfate Sep 5, 2025
1a44b0c
Fix missing dag access.
cheatfate Sep 5, 2025
9c01085
Add earliest_available_slot handling.
cheatfate Sep 8, 2025
9ad0fd4
Add some debugging logs.
cheatfate Sep 8, 2025
38faaf2
Fix compilation issue.
cheatfate Sep 8, 2025
c2424a4
Add more debugging statements.
cheatfate Sep 8, 2025
30e8e23
Move debugging statements.
cheatfate Sep 8, 2025
ad6fbf6
Add some more information to debug logging.
cheatfate Sep 8, 2025
bcd07a5
Change SyncQueue[T].push method to return number of slots advanced.
cheatfate Sep 9, 2025
83a3d40
Add debug information about current checkpoints stored in dag.
cheatfate Sep 10, 2025
45a287c
Restore inclusion proof verifications.
cheatfate Sep 10, 2025
12850a5
Fix blob quarantine.
cheatfate Sep 15, 2025
840b7c9
Add async control to block buffer.
cheatfate Sep 15, 2025
4c608df
Do not enter block range downloading in case when block buffer is alm…
cheatfate Sep 15, 2025
bc91e96
One more attempt to catch blob_quarantine issue.
cheatfate Sep 15, 2025
4ba2b0e
Attempt to fix blob_quarantine issue.
cheatfate Sep 15, 2025
8bdbbea
Add more debugging on RangeBuffer.
cheatfate Sep 15, 2025
3ea27e0
Use RangeBuffer shortLog.
cheatfate Sep 15, 2025
3f5f08e
Fix block buffer advance when empty responses being processed.
cheatfate Sep 15, 2025
0ed389a
More fixes to blob_quarantine.
cheatfate Sep 16, 2025
f5eced8
Fix imports in blob_quarantine
cheatfate Sep 16, 2025
4244d53
Fix sync_queue cyrillic C characters.
cheatfate Sep 16, 2025
d2eaaa7
Remove block_buffer asynchronous handlers.
cheatfate Sep 16, 2025
d371ed3
Removal of Checkpoints from SyncDag, maintain single Queues structure.
cheatfate Sep 18, 2025
0118cfa
Removal of checkpoints part 2.
cheatfate Sep 18, 2025
3807adb
Fix pruning for blockBuffer and blobQuarantine.
cheatfate Sep 18, 2025
e7bcd2e
Add more debugging statements.
cheatfate Sep 18, 2025
a3cac3f
Add logs for investigation lighthouse issue with range response.
cheatfate Sep 18, 2025
ec5f117
Fix getSidecarSlot().
cheatfate Sep 18, 2025
a39b8a7
More changes in getSidecarSlot().
cheatfate Sep 20, 2025
e41ea11
Address runtime crash.
cheatfate Sep 20, 2025
303e514
Make SyncQueue return negative integer when rewind is happen.
cheatfate Sep 21, 2025
d167815
Address all the warnings.
cheatfate Sep 21, 2025
7a4ef5c
Validate early empty sidecar responses.
cheatfate Sep 21, 2025
46fa1be
Add more debugging output.
cheatfate Sep 22, 2025
86410cd
More debugging output.
cheatfate Sep 22, 2025
2224ff0
Add SyncQueue synchronization after rewinds.
cheatfate Sep 22, 2025
8d16042
Make block_buffer accept blocks before initSlot.
cheatfate Sep 22, 2025
1f8d523
VerifierError.MissingSidecars should not affect failures count.
cheatfate Sep 23, 2025
11c2399
Disable byRoot syncing while rangeSync is active.
cheatfate Sep 23, 2025
4a75a37
Post-rebase fixes.
cheatfate Sep 23, 2025
4aa69ff
Fix peer management in Overseer.
cheatfate Sep 23, 2025
60612a2
Update pause detector.
cheatfate Sep 23, 2025
ed08809
Fix block_buffer.peekRange() returns incorrect number of blocks.
cheatfate Sep 24, 2025
2453e02
Fix compilation.
cheatfate Sep 24, 2025
94b6f6b
More fixes to block_buffer.peekRange().
cheatfate Sep 24, 2025
77061ff
Add parent_root into slimLog(blocks).
cheatfate Sep 25, 2025
ea76950
Add SyncQueue synchronization for blocks loop.
cheatfate Sep 26, 2025
82e328b
Fix sidecars step should not be active when sidecars are not needed.
cheatfate Sep 26, 2025
27ef403
Sidecars check should be done before request has been made.
cheatfate Sep 26, 2025
6b2a044
Remove initSlot from BlockRangeBuffer.
cheatfate Sep 29, 2025
68f4116
Fix blocks queue should not rewind sidecars queue, if its not running…
cheatfate Sep 29, 2025
1512168
Add SyncPushResponse result for SyncQueue.push().
cheatfate Sep 29, 2025
dc0776a
Add one more step in debugging MissingParent error returned by BlockP…
cheatfate Sep 30, 2025
67892d3
Add more debugging statements to SyncQueue.
cheatfate Sep 30, 2025
a22de47
Make requests non-relevant more strict.
cheatfate Oct 1, 2025
f291fc2
Add more debug statements to verifiers.
cheatfate Oct 1, 2025
8d46c3b
Fix compilation issue.
cheatfate Oct 1, 2025
9c64b8c
Add blob index checking to response utils.
cheatfate Oct 1, 2025
4db5d62
Disable blob/column quarantine pruning in sidecars step.
cheatfate Oct 1, 2025
f34b1d8
Add blob_quarantine logging.
cheatfate Oct 2, 2025
4af3e12
Disable rewind syncing for blocks step.
cheatfate Oct 3, 2025
e6b96c2
Add blob/column quarantine pruning for failing/empty requests.
cheatfate Oct 4, 2025
8a555d0
Add more debug logging to blob/column quarantine.
cheatfate Oct 4, 2025
d2e77f2
Store blobs/columns in quarantine right before pushing request to avo…
cheatfate Oct 5, 2025
c81101c
Dissect ColumnMap from blob_quarantine to its own module.
cheatfate Oct 5, 2025
a768726
Move BlockBuffer tests to test suite.
cheatfate Oct 6, 2025
7290569
Add BlockBuffer invalidation.
cheatfate Oct 6, 2025
b2cc8b6
Update backfill queues in updateQueues().
cheatfate Oct 7, 2025
5ea8faf
Post-rebase fixes.
cheatfate Oct 7, 2025
32f056f
MissingSidecars should not affect rewinds.
cheatfate Oct 7, 2025
058ff33
Add more debugging values to overseer.
cheatfate Oct 7, 2025
0eb74d3
Remove sync_dag debugging logs.
cheatfate Oct 7, 2025
663a335
Start root sync earlier.
cheatfate Oct 7, 2025
90ed67b
Fix issue with block validation response check.
cheatfate Oct 7, 2025
00d6a12
Update performance counters.
cheatfate Oct 7, 2025
616268d
Fix crash.
cheatfate Oct 7, 2025
eebf0c2
Remove code duplicates from performance counters.
cheatfate Oct 8, 2025
da623dd
Some fixes for roots syncing.
cheatfate Oct 8, 2025
1d1e1c3
Add peerLog logging.
cheatfate Oct 8, 2025
26c0f85
Fix sidecars syncer conditions.
cheatfate Oct 9, 2025
acb60a5
Remove peer_log.
cheatfate Oct 9, 2025
5814588
Remove some debugging log statements.
cheatfate Oct 9, 2025
35647ab
Missing sidecars helper functions.
cheatfate Oct 10, 2025
925da31
Simplify getMissingSidecarIndices(columns).
cheatfate Oct 13, 2025
5f6b2e3
Post rebase fixes.
cheatfate Oct 13, 2025
aef5ea6
Add missing sidecar indices to logs, so it possible to track columns …
cheatfate Oct 13, 2025
f1c9997
Fix test_quarantine.
cheatfate Oct 13, 2025
6c432e9
Add some columns debugging statements.
cheatfate Oct 13, 2025
53d87be
Attempt to fix weird chronicles assertion.
cheatfate Oct 14, 2025
94164c0
Fix column distribution and rate logging.
cheatfate Oct 14, 2025
3d5faba
Fix `You should not pop so many requests` assertion crash and start u…
cheatfate Oct 14, 2025
49386a0
Add quarantine shortLog to check what is happening.
cheatfate Oct 14, 2025
59e0a12
Add shortLog(columns).
cheatfate Oct 14, 2025
4e716d9
Do not request columns if we already have it.
cheatfate Oct 14, 2025
67969f4
Fix new columns calculations.
cheatfate Oct 14, 2025
28654a1
One more fix.
cheatfate Oct 14, 2025
e11ee23
Optimize getMissingSidecarIndices() and introduce getMissingColumnsMa…
cheatfate Oct 15, 2025
3cec075
Some updates to blob_quarantine.
cheatfate Oct 15, 2025
0fc8531
Add SyncDag path to main debug log statement.
cheatfate Oct 15, 2025
2a0d603
Investigating blobs in columns age, more logs and fixes.
cheatfate Oct 16, 2025
7967732
Still unclear where columns are lost.
cheatfate Oct 16, 2025
097e0fc
Remove blob quarantine processing after finalization.
cheatfate Oct 16, 2025
29d935b
Fix: Do not remove blobs/columns on MissingSidecars/MissingParent err…
cheatfate Oct 16, 2025
7316129
Fix compilation issue.
cheatfate Oct 16, 2025
119c12f
Log full root map to understand why there missing blocks.
cheatfate Oct 17, 2025
55cd647
Fix use sidecarless quarantine as source of blocks too.
cheatfate Oct 19, 2025
4f22e81
Fix BlockBuffer not properly handles MissingParent detection.
cheatfate Oct 20, 2025
3de55da
Fix not-in-range detection for sidecars queue.
cheatfate Oct 20, 2025
6867407
Fix compilation problem.
cheatfate Oct 20, 2025
ac0d35f
Enable earliest_avalailable_slot check.
cheatfate Oct 20, 2025
1975b84
Add peer_map to by root sidecars requests.
cheatfate Oct 20, 2025
181ddb1
Earliest available slot is only for columns, not blocks.
cheatfate Oct 20, 2025
3c64c02
Post-rebase fixes.
cheatfate Oct 21, 2025
01c32e6
Add MissingSidecars cleanups.
cheatfate Oct 21, 2025
693c890
Fix pruning errors.
cheatfate Oct 21, 2025
4c0e7d6
Proper backfill check.
cheatfate Oct 21, 2025
f6de3b5
One more fix to backfill detection algorithm.
cheatfate Oct 22, 2025
91bac5f
Update backfill queue limits calculation.
cheatfate Oct 22, 2025
e79fae5
Fix compilation error.
cheatfate Oct 22, 2025
755159e
One more calculation update.
cheatfate Oct 22, 2025
789f3e4
Refactor sidecars queue limits calculation methods.
cheatfate Oct 22, 2025
a3d04ac
Add edge cases handling.
cheatfate Oct 22, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 4 additions & 3 deletions beacon_chain/beacon_node.nim
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ import
./spec/datatypes/[base, altair],
./spec/eth2_apis/dynamic_fee_recipients,
./spec/signatures_batch,
./sync/[sync_manager, request_manager, sync_types, validator_custody],
./sync/[sync_overseer2, sync_manager, request_manager, sync_types, validator_custody],
./validators/[
action_tracker, message_router, validator_monitor, validator_pool,
keystore_management],
Expand All @@ -41,13 +41,14 @@ export
eth2_network, el_manager, request_manager, sync_manager,
eth2_processor, optimistic_processor, blockchain_dag, block_quarantine,
base, message_router, validator_monitor, validator_pool,
consensus_manager, dynamic_fee_recipients, sync_types
consensus_manager, dynamic_fee_recipients, sync_types, sync_overseer2

type
EventBus* = object
headQueue*: AsyncEventQueue[HeadChangeInfoObject]
blocksQueue*: AsyncEventQueue[EventBeaconBlockObject]
blockGossipQueue*: AsyncEventQueue[EventBeaconBlockGossipObject]
blockGossipPeerQueue*: AsyncEventQueue[EventBeaconBlockGossipPeerObject]
phase0AttestQueue*: AsyncEventQueue[phase0.Attestation]
singleAttestQueue*: AsyncEventQueue[SingleAttestation]
exitQueue*: AsyncEventQueue[SignedVoluntaryExit]
Expand Down Expand Up @@ -100,7 +101,7 @@ type
syncManager*: SyncManager[Peer, PeerId]
backfiller*: SyncManager[Peer, PeerId]
untrustedManager*: SyncManager[Peer, PeerId]
syncOverseer*: SyncOverseerRef
syncOverseer*: SyncOverseerRef2
processor*: ref Eth2Processor
batchVerifier*: ref BatchVerifier
blockProcessor*: ref BlockProcessor
Expand Down
2 changes: 1 addition & 1 deletion beacon_chain/beacon_node_light_client.nim
Original file line number Diff line number Diff line change
Expand Up @@ -54,7 +54,7 @@ proc initLightClient*(
optimisticProcessor = initOptimisticProcessor(
cfg.time, getBeaconTime, optimisticHandler)

shouldInhibitSync = func(): bool =
shouldInhibitSync = proc(): bool =
if isNil(node.syncOverseer):
false
else:
Expand Down
Loading