Implement PeerDAS

[nalepae]

Remaining tasks:

• Initial sync: Allow syncing for non super-nodes.
• Initial sync: Backfill data columns when starting from a checkpoint.
• Initial sync: Do not request more than 64 data columns: Request 64 data columns then reconstruct the rest.
• Implement validator custody.
• ⚠️ Integrate the output of sampling in the forkchoice ⚠️
• Check why we cannot run initial sync when starting a node during epoch 0, in slot [1, 31]. (Starting a node since genesis works, starting a node from epoch 1 and later works.) Note: This issue may be already here with blobs (without data columns.)
• Indroduce a nasty peer flag that holds AND/OR (both are important) alterate data columns on RPC responses.
• Add unit tests where they are not yet added.
• Replace the cKZG library by the goKZGone (when available) - In progress.
• Implement Add MetadataV3 with custody_subnet_count ethereum/consensus-specs#3821.
• ⚠️ Implement number of blobs as a CL parameter. ⚠️
• Decouple network subnets from Core methods as referenced.
• Data columns verification: Implement it once, and use it everywhere.
• ⚠️ Implement /eth/v1/beacon/blob_sidecars/{block_id}
• Update to latest config values in the spec. ⚠️ In progress here
• Rewrite sampling tests to allow for a subnet count larger than 32, this is currently hardcoded for it.
• Sampling: Find more peers if a column has no corresponding peers. (Can do like in internalBroadcastDataColumn)
• Add PeerDAS specific metrics
• (Not especially peerDAS related): Make consistent DEBUG p2p: Peer connected activePeers=2 log with INFO p2p: Connected peers log.
• Clarify usage of --minimum-peers-per-subnet=<n>
• Should we downscore peer on sampling? (Maybe the peer does not see the block)
• Should we stop using a peer when failed on sampling? (To avoid DDoS)
• A node should always serve data columns it has, even if it does not custody it. (Particularly, when proposing a block.)
• Check metadataV3 interop with other clients if before EIP-7594
• Refactor code where GetValidCustodyPeers is used. ==> We need to fetch data from peers that are not super nodes.
• After a fork, for some reason, data columns by root requests are done more than once. (It may be normal if done to multiple peers, but we have to check.)
• prysmctl: Implement byRoot and byRange data columns requests
• Fix E2E tests
• Using subnet sampling only: Should, when using data columns by root requests (and also by range, during initial sync), the node request only custody columns, or custody columns + extra subnet sampling columns? If requesting only custody columns, then a strange situation arises: When receiving a block with a extra subnet sampling column missing, then the node will ignore the block. A few sec after, when requesting the blocks and the associated columns, the node won't need the subnet sampling extra columns to import the block.
• Find why sometimes ENR records are not correctly updated via discovery.
• Find why, with Grandine in the mix, discv5 iterator.Next is soooo slow.
• Test with only one bootnode (and not all nodes)
• Initial sync: Save data columns? (Are blobs saved during initial sync?)
• peersWithDataColumn: Select only peers capable to serve up to the target slot. Previously, we used f.pep.Peers().ChainState(peer).HeadSlot, but this info is only updated twice per epoch via status P2P messages. ==> Find a good way to do it. (Maybe send status message just before checking?)
• Initial sync: How to handle orphaned blocks (Not to be stuck)?
• By range (and by root) requests: Run verifications for finalized blocks?
• ByRoot requests: choose all peers like on ByRange requests, not only super nodes.