p2p, p2p/discover: add dial metrics #27621
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
lightclient
requested review from
holiman,
karalabe and
rjl493456442
as code owners
Member
Author
|
Okay I ended up realizing I could just make some measurements from the eth handshake and subtract those from the p2p dial "successes" to determine the number of peers we dial that turn into useful peers. |
lightclient
force-pushed
the
disc-metrics
branch
from
de7e5d7 to
2465a30
Compare
lightclient
force-pushed
the
disc-metrics
branch
from
2465a30 to
111fa80
Compare
|
This PR sucks. It should be closed immediately. |
Contributor
|
Don't be impolite @anti-fjl! The PR is decent, just needs a bit of work to be fully correct. |
fjl
requested changes
Jun 30, 2023
Contributor
|
I think there is some confusion about the term 'dial' here. In package p2p, when we say 'dial' we exclusively mean 'outbound connections created by us'. So the terms 'ingress' 'egress' cannot be applied to a dialed connection. |
lightclient
force-pushed
the
disc-metrics
branch
from
5bf3938 to
18c0cc7
Compare
Member
Author
|
Good point on the confusion of "dial" and ingress/egress. I've updated it in the PR and it should be fixed now. |
devopsbo3
pushed a commit
to HorizenOfficial/go-ethereum
that referenced
this pull request
Nov 10, 2023
This PR adds metrics for p2p dialing, which gives us visibility into the quality of the dial candidates returned by our discovery methods.
devopsbo3
added a commit
to HorizenOfficial/go-ethereum
that referenced
this pull request
Nov 10, 2023
This reverts commit 463ad60.
devopsbo3
added a commit
to HorizenOfficial/go-ethereum
that referenced
this pull request
Nov 10, 2023
This reverts commit 463ad60.
4 tasks
nibty
pushed a commit
to FairCrypto/go-ethereum
that referenced
this pull request
Apr 10, 2024
This PR adds metrics for p2p dialing, which gives us visibility into the quality of the dial candidates returned by our discovery methods.
JukLee0ira
added a commit
to JukLee0ira/XDPoSChain
that referenced
this pull request
Feb 18, 2025
gzliudan
pushed a commit
to XinFinOrg/XDPoSChain
that referenced
this pull request
Feb 18, 2025
fjl
added a commit
that referenced
this pull request
Apr 15, 2025
Our metrics related to dial errors were off. The original error was not wrapped, so the caller function had no chance of picking it up. Therefore the most common error, which is "TooManyPeers", was not correctly counted. The metrics were originally introduced in #27621 I was thinking of various possible solutions. - the one proposed here wraps both the new error and the origial error. It is not a pattern we use in other parts of the code, but works. This is maybe the smallest possible change. - as an alternate, I could write a proper `errProtoHandshakeError` with it's own wrapped error - finally, I'm not even sure we need `errProtoHandshakeError`, maybe we could just pass up the original error. --------- Signed-off-by: Csaba Kiraly <[email protected]> Co-authored-by: Felix Lange <[email protected]>
sivaratrisrinivas
pushed a commit
to sivaratrisrinivas/go-ethereum
that referenced
this pull request
Apr 21, 2025
Our metrics related to dial errors were off. The original error was not wrapped, so the caller function had no chance of picking it up. Therefore the most common error, which is "TooManyPeers", was not correctly counted. The metrics were originally introduced in ethereum#27621 I was thinking of various possible solutions. - the one proposed here wraps both the new error and the origial error. It is not a pattern we use in other parts of the code, but works. This is maybe the smallest possible change. - as an alternate, I could write a proper `errProtoHandshakeError` with it's own wrapped error - finally, I'm not even sure we need `errProtoHandshakeError`, maybe we could just pass up the original error. --------- Signed-off-by: Csaba Kiraly <[email protected]> Co-authored-by: Felix Lange <[email protected]>
0g-wh
pushed a commit
to 0gfoundation/0g-geth
that referenced
this pull request
Apr 22, 2025
Our metrics related to dial errors were off. The original error was not wrapped, so the caller function had no chance of picking it up. Therefore the most common error, which is "TooManyPeers", was not correctly counted. The metrics were originally introduced in ethereum#27621 I was thinking of various possible solutions. - the one proposed here wraps both the new error and the origial error. It is not a pattern we use in other parts of the code, but works. This is maybe the smallest possible change. - as an alternate, I could write a proper `errProtoHandshakeError` with it's own wrapped error - finally, I'm not even sure we need `errProtoHandshakeError`, maybe we could just pass up the original error. --------- Signed-off-by: Csaba Kiraly <[email protected]> Co-authored-by: Felix Lange <[email protected]>
jakub-freebit
pushed a commit
to fblch/go-ethereum
that referenced
this pull request
Jul 3, 2025
Our metrics related to dial errors were off. The original error was not wrapped, so the caller function had no chance of picking it up. Therefore the most common error, which is "TooManyPeers", was not correctly counted. The metrics were originally introduced in ethereum#27621 I was thinking of various possible solutions. - the one proposed here wraps both the new error and the origial error. It is not a pattern we use in other parts of the code, but works. This is maybe the smallest possible change. - as an alternate, I could write a proper `errProtoHandshakeError` with it's own wrapped error - finally, I'm not even sure we need `errProtoHandshakeError`, maybe we could just pass up the original error. --------- Signed-off-by: Csaba Kiraly <[email protected]> Co-authored-by: Felix Lange <[email protected]>
jakub-freebit
pushed a commit
to fblch/go-ethereum
that referenced
this pull request
Jul 3, 2025
This PR adds metrics for p2p dialing, which gives us visibility into the quality of the dial candidates returned by our discovery methods.
jakub-freebit
pushed a commit
to fblch/go-ethereum
that referenced
this pull request
Jul 23, 2025
Our metrics related to dial errors were off. The original error was not wrapped, so the caller function had no chance of picking it up. Therefore the most common error, which is "TooManyPeers", was not correctly counted. The metrics were originally introduced in ethereum#27621 I was thinking of various possible solutions. - the one proposed here wraps both the new error and the origial error. It is not a pattern we use in other parts of the code, but works. This is maybe the smallest possible change. - as an alternate, I could write a proper `errProtoHandshakeError` with it's own wrapped error - finally, I'm not even sure we need `errProtoHandshakeError`, maybe we could just pass up the original error. --------- Signed-off-by: Csaba Kiraly <[email protected]> Co-authored-by: Felix Lange <[email protected]>
howjmay
pushed a commit
to iotaledger/go-ethereum
that referenced
this pull request
Aug 27, 2025
Our metrics related to dial errors were off. The original error was not wrapped, so the caller function had no chance of picking it up. Therefore the most common error, which is "TooManyPeers", was not correctly counted. The metrics were originally introduced in ethereum#27621 I was thinking of various possible solutions. - the one proposed here wraps both the new error and the origial error. It is not a pattern we use in other parts of the code, but works. This is maybe the smallest possible change. - as an alternate, I could write a proper `errProtoHandshakeError` with it's own wrapped error - finally, I'm not even sure we need `errProtoHandshakeError`, maybe we could just pass up the original error. --------- Signed-off-by: Csaba Kiraly <[email protected]> Co-authored-by: Felix Lange <[email protected]>
qianhh
pushed a commit
to bane-labs/go-ethereum
that referenced
this pull request
Sep 1, 2025
Our metrics related to dial errors were off. The original error was not wrapped, so the caller function had no chance of picking it up. Therefore the most common error, which is "TooManyPeers", was not correctly counted. The metrics were originally introduced in ethereum/go-ethereum#27621 I was thinking of various possible solutions. - the one proposed here wraps both the new error and the origial error. It is not a pattern we use in other parts of the code, but works. This is maybe the smallest possible change. - as an alternate, I could write a proper `errProtoHandshakeError` with it's own wrapped error - finally, I'm not even sure we need `errProtoHandshakeError`, maybe we could just pass up the original error. --------- Signed-off-by: Csaba Kiraly <[email protected]> Co-authored-by: Felix Lange <[email protected]>
jakub-freebit
pushed a commit
to fblch/go-ethereum
that referenced
this pull request
Sep 3, 2025
This PR adds metrics for p2p dialing, which gives us visibility into the quality of the dial candidates returned by our discovery methods.
jakub-freebit
pushed a commit
to fblch/go-ethereum
that referenced
this pull request
Sep 3, 2025
Our metrics related to dial errors were off. The original error was not wrapped, so the caller function had no chance of picking it up. Therefore the most common error, which is "TooManyPeers", was not correctly counted. The metrics were originally introduced in ethereum#27621 I was thinking of various possible solutions. - the one proposed here wraps both the new error and the origial error. It is not a pattern we use in other parts of the code, but works. This is maybe the smallest possible change. - as an alternate, I could write a proper `errProtoHandshakeError` with it's own wrapped error - finally, I'm not even sure we need `errProtoHandshakeError`, maybe we could just pass up the original error. --------- Signed-off-by: Csaba Kiraly <[email protected]> Co-authored-by: Felix Lange <[email protected]>
jakub-freebit
pushed a commit
to fblch/go-ethereum
that referenced
this pull request
Sep 4, 2025
This PR adds metrics for p2p dialing, which gives us visibility into the quality of the dial candidates returned by our discovery methods.
jakub-freebit
pushed a commit
to fblch/go-ethereum
that referenced
this pull request
Sep 4, 2025
Our metrics related to dial errors were off. The original error was not wrapped, so the caller function had no chance of picking it up. Therefore the most common error, which is "TooManyPeers", was not correctly counted. The metrics were originally introduced in ethereum#27621 I was thinking of various possible solutions. - the one proposed here wraps both the new error and the origial error. It is not a pattern we use in other parts of the code, but works. This is maybe the smallest possible change. - as an alternate, I could write a proper `errProtoHandshakeError` with it's own wrapped error - finally, I'm not even sure we need `errProtoHandshakeError`, maybe we could just pass up the original error. --------- Signed-off-by: Csaba Kiraly <[email protected]> Co-authored-by: Felix Lange <[email protected]>
gballet
pushed a commit
to gballet/go-ethereum
that referenced
this pull request
Sep 11, 2025
Our metrics related to dial errors were off. The original error was not wrapped, so the caller function had no chance of picking it up. Therefore the most common error, which is "TooManyPeers", was not correctly counted. The metrics were originally introduced in ethereum#27621 I was thinking of various possible solutions. - the one proposed here wraps both the new error and the origial error. It is not a pattern we use in other parts of the code, but works. This is maybe the smallest possible change. - as an alternate, I could write a proper `errProtoHandshakeError` with it's own wrapped error - finally, I'm not even sure we need `errProtoHandshakeError`, maybe we could just pass up the original error. --------- Signed-off-by: Csaba Kiraly <[email protected]> Co-authored-by: Felix Lange <[email protected]>
qianhh
pushed a commit
to bane-labs/go-ethereum
that referenced
this pull request
Sep 16, 2025
Our metrics related to dial errors were off. The original error was not wrapped, so the caller function had no chance of picking it up. Therefore the most common error, which is "TooManyPeers", was not correctly counted. The metrics were originally introduced in ethereum/go-ethereum#27621 I was thinking of various possible solutions. - the one proposed here wraps both the new error and the origial error. It is not a pattern we use in other parts of the code, but works. This is maybe the smallest possible change. - as an alternate, I could write a proper `errProtoHandshakeError` with it's own wrapped error - finally, I'm not even sure we need `errProtoHandshakeError`, maybe we could just pass up the original error. --------- Signed-off-by: Csaba Kiraly <[email protected]> Co-authored-by: Felix Lange <[email protected]>
jakub-freebit
pushed a commit
to fblch/go-ethereum
that referenced
this pull request
Sep 16, 2025
This PR adds metrics for p2p dialing, which gives us visibility into the quality of the dial candidates returned by our discovery methods.
jakub-freebit
pushed a commit
to fblch/go-ethereum
that referenced
this pull request
Sep 16, 2025
Our metrics related to dial errors were off. The original error was not wrapped, so the caller function had no chance of picking it up. Therefore the most common error, which is "TooManyPeers", was not correctly counted. The metrics were originally introduced in ethereum#27621 I was thinking of various possible solutions. - the one proposed here wraps both the new error and the origial error. It is not a pattern we use in other parts of the code, but works. This is maybe the smallest possible change. - as an alternate, I could write a proper `errProtoHandshakeError` with it's own wrapped error - finally, I'm not even sure we need `errProtoHandshakeError`, maybe we could just pass up the original error. --------- Signed-off-by: Csaba Kiraly <[email protected]> Co-authored-by: Felix Lange <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR adds metrics for the p2p dialer, which gives us visibility into the quality of the dial candidates given to us by our discovery methods. This isn't quite a full picture though, because often once the dial completes, the subprotocols will then perform their handshakes. These frequently fail for a multitude of reasons: wrong chain, too many peers, etc. That isn't shown with these metrics.
This is the reason the "success" rate seems very high for a rather low peer count. Using discv4, around 28% we can connect to on RLPx, but many of them immediately disconnect during(fixed by tracking errors during handshake). With DNS discovery, the number is much lower because (presumably) they're already maxed out on peers due to the constant barrage of ingress connection requests they receive. So it takes longer to find a node with a free peer slot.ethhandshakingThe one notable change here other than the new metrics is moving
p2p/dialsandp2p/servesoutside ofmeteredConn. This seems to be nice because it reduces the noise of dialing on the metrics. Connections are only counted now if they reach the "peer added" checkpoint.Added Metrics
discover/bucket/{index}/count- the number of nodes in bucketindexeth/protocols/eth/{ingress|egress}/handshake/error/peer- unexpected peer behavioreth/protocols/eth/{ingress|egress}/handshake/error/timeout- handshake timeouteth/protocols/eth/{ingress|egress}/handshake/error/network- wrong network ideth/protocols/eth/{ingress|egress}/handshake/error/version- wrong protocol versioneth/protocols/eth/{ingress|egress}/handshake/error/genesis- wrong genesiseth/protocols/eth/{ingress|egress}/handshake/error/forkid- wrong forkideth/protocols/snap/{ingress|egress}/registration/error- error registering snap protocol (usually snap, but no eth)p2p/dials/success- the total number of dials that result in a peer being added to the peersetp2p/dials/error/connection- unable to initiate TCP connection to targetp2p/dials/error/saturated- local client is already connected to its maximum number of peersp2p/dials/error/known- dialing an already connected peerp2p/dials/error/self- dialing the local node's idp2p/dials/error/useless- dialing a peer that doesn't share an capabilities with the local nodep2p/dials/error/id/unexpected- dialed peer repsoned with different id than expectedp2p/dials/error/rlpx/enc- error negotiating the rlpx encryption during dialp2p/dials/error/rlpx/proto- error during rlpx protocol handshake`Mainnet (discv4 only)
Sepolia (discv4 only)
Dashboard
JSON
{ "annotations": { "list": [ { "builtIn": 1, "datasource": { "type": "datasource", "uid": "grafana" }, "enable": true, "hide": true, "iconColor": "rgba(0, 211, 255, 1)", "name": "Annotations & Alerts", "target": { "limit": 100, "matchAny": false, "tags": [], "type": "dashboard" }, "type": "dashboard" } ] }, "description": "A Prometheus metric dashboard for go-ethereum, supports all blockchains compatible with go-ethereum", "editable": true, "fiscalYearStartMonth": 0, "gnetId": 18463, "graphTooltip": 0, "id": 1, "links": [], "liveNow": false, "panels": [ { "collapsed": false, "gridPos": { "h": 1, "w": 24, "x": 0, "y": 0 }, "id": 157, "panels": [], "title": "Discovery", "type": "row" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "max": 0.5, "noValue": "0", "thresholds": { "mode": "absolute", "steps": [ { "color": "red", "value": null }, { "color": "#EAB839", "value": 0.15 }, { "color": "green", "value": 0.3 } ] }, "unit": "percentunit" }, "overrides": [] }, "gridPos": { "h": 5, "w": 5, "x": 0, "y": 1 }, "id": 159, "options": { "orientation": "auto", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "showThresholdLabels": false, "showThresholdMarkers": true }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "(rate(p2p_dials_success{chain=\"$chain\", instance=~\"$instance\"}[5m]) - rate(eth_protocols_eth_egress_handshake_error_forkid{chain=\"$chain\", instance=~\"$instance\"}[5m]) - rate(eth_protocols_eth_egress_handshake_error_genesis{chain=\"$chain\", instance=~\"$instance\"}[5m]) - rate(eth_protocols_eth_egress_handshake_error_network{chain=\"$chain\", instance=~\"$instance\"}[5m]) - rate(eth_protocols_eth_egress_handshake_error_peer{chain=\"$chain\", instance=~\"$instance\"}[5m]) - rate(eth_protocols_eth_egress_handshake_error_timeout{chain=\"$chain\", instance=~\"$instance\"}[5m]) - rate(eth_protocols_snap_egress_registration_error{chain=\"$chain\", instance=~\"$instance\"}[5m])) / rate(p2p_dials{chain=\"$chain\", instance=~\"$instance\"}[5m])", "legendFormat": "__auto", "range": true, "refId": "A" } ], "title": "Dial Quality (5m)", "type": "gauge" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "right", "axisSoftMax": 0.5, "axisSoftMin": 0, "barAlignment": 0, "drawStyle": "line", "fillOpacity": 5, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineStyle": { "fill": "solid" }, "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": false, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null }, { "color": "red", "value": 80 } ] }, "unit": "none" }, "overrides": [ { "matcher": { "id": "byName", "options": "connect rate" }, "properties": [ { "id": "custom.axisPlacement", "value": "left" }, { "id": "unit", "value": "percentunit" } ] } ] }, "gridPos": { "h": 11, "w": 12, "x": 5, "y": 1 }, "id": 158, "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "(rate(p2p_dials_success{chain=\"$chain\", instance=~\"$instance\"}[1m]) - rate(eth_protocols_eth_egress_handshake_error_forkid{chain=\"$chain\", instance=~\"$instance\"}[1m]) - rate(eth_protocols_eth_egress_handshake_error_genesis{chain=\"$chain\", instance=~\"$instance\"}[1m]) - rate(eth_protocols_eth_egress_handshake_error_network{chain=\"$chain\", instance=~\"$instance\"}[1m]) - rate(eth_protocols_eth_egress_handshake_error_peer{chain=\"$chain\", instance=~\"$instance\"}[1m]) - rate(eth_protocols_eth_egress_handshake_error_timeout{chain=\"$chain\", instance=~\"$instance\"}[1m]) - rate(eth_protocols_eth_egress_handshake_error_version{chain=\"$chain\", instance=~\"$instance\"}[1m]) - rate(eth_protocols_snap_egress_registration_error{chain=\"$chain\", instance=~\"$instance\"}[1m])) / rate(p2p_dials{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "instant": false, "interval": "", "legendFormat": "connect rate", "range": true, "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "rate(p2p_dials{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "attempts", "range": true, "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_peers{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "peers", "range": true, "refId": "C" } ], "title": "Dial Quality", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "hideFrom": { "legend": false, "tooltip": false, "viz": false } }, "mappings": [] }, "overrides": [ { "matcher": { "id": "byName", "options": "rlpx proto error" }, "properties": [ { "id": "color", "value": { "fixedColor": "dark-purple", "mode": "fixed" } } ] }, { "matcher": { "id": "byName", "options": "peer error" }, "properties": [ { "id": "color", "value": { "fixedColor": "dark-blue", "mode": "fixed" } } ] }, { "matcher": { "id": "byName", "options": "wrong network id" }, "properties": [ { "id": "color", "value": { "fixedColor": "dark-red", "mode": "fixed" } } ] }, { "matcher": { "id": "byName", "options": "connection error" }, "properties": [ { "id": "color", "value": { "fixedColor": "semi-dark-orange", "mode": "fixed" } } ] }, { "matcher": { "id": "byName", "options": "useless" }, "properties": [ { "id": "color", "value": { "fixedColor": "dark-yellow", "mode": "fixed" } } ] }, { "__systemRef": "hideSeriesFrom", "matcher": { "id": "byNames", "options": { "mode": "exclude", "names": [ "success", "already connected", "too many local peers", "useless", "self dial", "rlpx enc error", "rlpx proto error", "wrong genesis", "wrong network id", "eth handshake timeout", "wrong protocol version", "connection error" ], "prefix": "All except:", "readOnly": true } }, "properties": [ { "id": "custom.hideFrom", "value": { "legend": false, "tooltip": false, "viz": true } } ] }, { "matcher": { "id": "byName", "options": "already connected" }, "properties": [ { "id": "color", "value": { "fixedColor": "super-light-green", "mode": "fixed" } } ] } ] }, "gridPos": { "h": 11, "w": 7, "x": 17, "y": 1 }, "id": 161, "options": { "displayLabels": [ "percent" ], "legend": { "displayMode": "list", "placement": "bottom", "showLegend": true }, "pieType": "pie", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "tooltip": { "mode": "single", "sort": "none" } }, "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_dials_success{chain=\"$chain\", instance=~\"$instance\"} - eth_protocols_eth_egress_handshake_error_forkid{chain=\"$chain\", instance=~\"$instance\"} - eth_protocols_eth_egress_handshake_error_genesis{chain=\"$chain\", instance=~\"$instance\"} - eth_protocols_eth_egress_handshake_error_network{chain=\"$chain\", instance=~\"$instance\"} - eth_protocols_eth_egress_handshake_error_peer{chain=\"$chain\", instance=~\"$instance\"} - eth_protocols_eth_egress_handshake_error_timeout{chain=\"$chain\", instance=~\"$instance\"} - eth_protocols_eth_egress_handshake_error_version{chain=\"$chain\", instance=~\"$instance\"} -\neth_protocols_snap_egress_registration_error{chain=\"$chain\", instance=~\"$instance\"}", "legendFormat": "success", "range": true, "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_dials_error_known{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "already connected", "range": true, "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_dials_error_saturated{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "too many local peers", "range": true, "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_dials_error_useless{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "useless", "range": true, "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_dials_error_self{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "self dial", "range": true, "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_dials_error_rlpx_enc{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "rlpx enc error", "range": true, "refId": "F" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_dials_error_rlpx_proto{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "rlpx proto error", "range": true, "refId": "G" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_dials_error_connection{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "connection error", "range": true, "refId": "H" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "eth_protocols_eth_egress_handshake_error_forkid{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "wrong forkid", "range": true, "refId": "I" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "eth_protocols_eth_egress_handshake_error_genesis{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "wrong genesis", "range": true, "refId": "J" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "eth_protocols_eth_egress_handshake_error_network{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "wrong network id", "range": true, "refId": "K" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "eth_protocols_eth_egress_handshake_error_peer{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "peer error", "range": true, "refId": "L" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "eth_protocols_eth_egress_handshake_error_timeout{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "eth handshake timeout", "range": true, "refId": "M" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "eth_protocols_eth_egress_handshake_error_version{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "wrong protocol version", "range": true, "refId": "N" } ], "title": "Dial Results", "type": "piechart" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "red", "value": null }, { "color": "yellow", "value": 5 }, { "color": "green", "value": 15 }, { "color": "blue", "value": 30 } ] } }, "overrides": [] }, "gridPos": { "h": 5, "w": 5, "x": 0, "y": 6 }, "id": 160, "options": { "orientation": "auto", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "showThresholdLabels": false, "showThresholdMarkers": true }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_peers{chain=\"$chain\", instance=~\"$instance\"}", "legendFormat": "__auto", "range": true, "refId": "A" } ], "title": "Peers", "type": "gauge" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null }, { "color": "red", "value": 80 } ] } }, "overrides": [] }, "gridPos": { "h": 10, "w": 9, "x": 0, "y": 12 }, "id": 154, "options": { "displayMode": "gradient", "minVizHeight": 10, "minVizWidth": 0, "orientation": "auto", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "showUnfilled": true, "valueMode": "color" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_0_count{chain=\"$chain\", instance=~\"$instance\"}", "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "0", "range": false, "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_1_count{chain=\"$chain\", instance=~\"$instance\"}", "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "1", "range": false, "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_2_count{chain=\"$chain\", instance=~\"$instance\"}", "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "2", "range": false, "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_3_count{chain=\"$chain\", instance=~\"$instance\"}", "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "3", "range": false, "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_4_count{chain=\"$chain\", instance=~\"$instance\"}", "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "4", "range": false, "refId": "I" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_5_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "5", "range": false, "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_6_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "6", "range": false, "refId": "F" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_7_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "7", "range": false, "refId": "G" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_8_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "8", "range": false, "refId": "H" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_9_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "9", "range": false, "refId": "J" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_10_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "10", "range": false, "refId": "K" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_11_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "11", "range": false, "refId": "L" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_12_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "12", "range": false, "refId": "M" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_13_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "13", "range": false, "refId": "N" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_14_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "14", "range": false, "refId": "O" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_15_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "15", "range": false, "refId": "P" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_16_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "16", "range": false, "refId": "Q" } ], "title": "kbuckets", "type": "bargauge" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null }, { "color": "red", "value": 80 } ] }, "unit": "Bps" }, "overrides": [ { "matcher": { "id": "byRegexp", "options": ".*-flow$" }, "properties": [ { "id": "unit", "value": "decbytes" }, { "id": "custom.axisPlacement", "value": "right" } ] } ] }, "gridPos": { "h": 10, "w": 15, "x": 9, "y": 12 }, "id": 156, "links": [], "options": { "legend": { "calcs": [ "mean", "max" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "rate(discover_ingress{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "ingress-rate", "range": true, "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "rate(discover_egress{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "egress-rate", "range": true, "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "discover_ingress{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "igress-flow", "range": true, "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "discover_egress{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "egress-flow", "range": true, "refId": "D" } ], "title": "Traffic", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 0, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "auto", "spanNulls": false, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null }, { "color": "red", "value": 80 } ] } }, "overrides": [] }, "gridPos": { "h": 10, "w": 9, "x": 0, "y": 22 }, "id": 155, "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_0_count{chain=\"$chain\", instance=~\"$instance\"}", "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "0", "range": true, "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_1_count{chain=\"$chain\", instance=~\"$instance\"}", "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "1", "range": true, "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_2_count{chain=\"$chain\", instance=~\"$instance\"}", "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "2", "range": true, "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_3_count{chain=\"$chain\", instance=~\"$instance\"}", "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "3", "range": true, "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_4_count{chain=\"$chain\", instance=~\"$instance\"}", "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "4", "range": true, "refId": "I" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_5_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "5", "range": true, "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_6_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "6", "range": true, "refId": "F" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_7_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "7", "range": true, "refId": "G" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_8_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "8", "range": true, "refId": "H" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_9_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "9", "range": true, "refId": "J" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_10_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "10", "range": true, "refId": "K" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_11_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "11", "range": true, "refId": "L" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_12_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "12", "range": true, "refId": "M" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_13_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "13", "range": true, "refId": "N" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_14_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "14", "range": true, "refId": "O" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_15_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "15", "range": true, "refId": "P" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_16_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "16", "range": true, "refId": "Q" } ], "title": "kbuckets", "type": "timeseries" }, { "collapsed": false, "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "gridPos": { "h": 1, "w": 24, "x": 0, "y": 32 }, "id": 4, "panels": [], "targets": [ { "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "refId": "A" } ], "title": "Blockchain", "type": "row" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [ { "options": { "match": "null", "result": { "text": "N/A" } }, "type": "special" } ], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null } ] }, "unit": "locale" }, "overrides": [] }, "gridPos": { "h": 2, "w": 3, "x": 0, "y": 33 }, "id": 109, "links": [], "maxDataPoints": 100, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "horizontal", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "text": {}, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "chain_head_block{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "", "refId": "A" } ], "title": "Latest block", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null }, { "color": "red", "value": 80 } ] }, "unit": "short" }, "overrides": [] }, "gridPos": { "h": 6, "w": 7, "x": 3, "y": 33 }, "id": 110, "links": [], "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "chain_head_header{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "header", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "chain_head_receipt{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "receipt", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "chain_head_block{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "block", "refId": "C" } ], "title": "Chain head", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "mappings": [ { "options": { "match": "null", "result": { "text": "N/A" } }, "type": "special" } ], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null } ] }, "unit": "locale" }, "overrides": [] }, "gridPos": { "h": 3, "w": 2, "x": 10, "y": 33 }, "id": 152, "links": [], "maxDataPoints": 100, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "horizontal", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "text": {}, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "chain_reorg_add{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "range": true, "refId": "A" } ], "title": "Chain Reorg Add", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "mappings": [ { "options": { "match": "null", "result": { "text": "N/A" } }, "type": "special" } ], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null } ] }, "unit": "locale" }, "overrides": [] }, "gridPos": { "h": 2, "w": 3, "x": 12, "y": 33 }, "id": 113, "links": [], "maxDataPoints": 100, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "horizontal", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "text": {}, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "txpool_pending{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "refId": "A" } ], "title": "Executable transactions", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null }, { "color": "red", "value": 80 } ] }, "unit": "short" }, "overrides": [] }, "gridPos": { "h": 6, "w": 9, "x": 15, "y": 33 }, "id": 116, "links": [], "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "txpool_pending{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "executable", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "txpool_queued{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "gapped", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "txpool_local{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "local", "refId": "C" } ], "title": "Transaction pool", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [ { "options": { "match": "null", "result": { "text": "N/A" } }, "type": "special" } ], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null } ] }, "unit": "locale" }, "overrides": [] }, "gridPos": { "h": 2, "w": 3, "x": 0, "y": 35 }, "id": 108, "links": [], "maxDataPoints": 100, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "horizontal", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "text": {}, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "chain_head_header{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "", "range": true, "refId": "A" } ], "title": "Latest header", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [ { "options": { "match": "null", "result": { "text": "N/A" } }, "type": "special" } ], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null } ] }, "unit": "locale" }, "overrides": [] }, "gridPos": { "h": 2, "w": 3, "x": 12, "y": 35 }, "id": 115, "links": [], "maxDataPoints": 100, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "horizontal", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "text": {}, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "txpool_local{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "refId": "A" } ], "title": "Local transactions", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "mappings": [ { "options": { "match": "null", "result": { "text": "N/A" } }, "type": "special" } ], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null } ] }, "unit": "locale" }, "overrides": [] }, "gridPos": { "h": 3, "w": 2, "x": 10, "y": 36 }, "id": 153, "links": [], "maxDataPoints": 100, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "horizontal", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "text": {}, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "chain_reorg_drop{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "range": true, "refId": "A" } ], "title": "Chain Reorg Drop", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [ { "options": { "match": "null", "result": { "text": "N/A" } }, "type": "special" } ], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null } ] }, "unit": "locale" }, "overrides": [] }, "gridPos": { "h": 2, "w": 3, "x": 0, "y": 37 }, "id": 111, "links": [], "maxDataPoints": 100, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "horizontal", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "text": {}, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "chain_head_receipt{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "", "refId": "A" } ], "title": "Latest receipt", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [ { "options": { "match": "null", "result": { "text": "N/A" } }, "type": "special" } ], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null } ] }, "unit": "locale" }, "overrides": [] }, "gridPos": { "h": 2, "w": 3, "x": 12, "y": 37 }, "id": 114, "links": [], "maxDataPoints": 100, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "horizontal", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "text": {}, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "txpool_queued{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "refId": "A" } ], "title": "Gapped transactions", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "normal" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "ns" }, "overrides": [] }, "gridPos": { "h": 8, "w": 12, "x": 0, "y": 39 }, "id": 112, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "chain_execution{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "execution (q=$quantile)", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "chain_validation{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "validation (q=$quantile)", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "chain_write{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "hide": false, "intervalFactor": 1, "legendFormat": "commit (q=$quantile)", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "chain_account_reads{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "account read (q=$quantile)", "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "chain_account_updates{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "account update (q=$quantile)", "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "chain_account_hashes{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "account hashe (q=$quantile)", "refId": "F" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "chain_account_commits{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "account commit (q=$quantile)", "refId": "G" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "chain_storage_reads{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "storage read (q=$quantile)", "refId": "H" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "chain_storage_updates{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "storage update (q=$quantile)", "refId": "I" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "chain_storage_hashes{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "storage hashe (q=$quantile)", "refId": "J" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "chain_storage_commits{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "storage commit (q=$quantile)", "refId": "K" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "chain_snapshot_commits{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "hide": false, "interval": "", "legendFormat": "snapshot commit (q=$quantile)", "refId": "L" } ], "title": "Block processing", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "none" }, "overrides": [] }, "gridPos": { "h": 8, "w": 12, "x": 12, "y": 39 }, "id": 117, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_valid{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "intervalFactor": 1, "legendFormat": "valid", "refId": "K" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_invalid{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "intervalFactor": 1, "legendFormat": "invalid", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_underpriced{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "underpriced", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_pending_discard{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "intervalFactor": 1, "legendFormat": "executable discard", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_pending_replace{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "intervalFactor": 1, "legendFormat": "executable replace", "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_pending_ratelimit{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "intervalFactor": 1, "legendFormat": "executable ratelimit", "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_pending_nofunds{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "intervalFactor": 1, "legendFormat": "executable nofunds", "refId": "F" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_queued_discard{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "intervalFactor": 1, "legendFormat": "gapped discard", "refId": "G" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_queued_replace{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "intervalFactor": 1, "legendFormat": "gapped replace", "refId": "H" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_queued_ratelimit{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "intervalFactor": 1, "legendFormat": "gapped ratelimit", "refId": "I" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_queued_nofunds{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "intervalFactor": 1, "legendFormat": "gapped nofunds", "refId": "J" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "rate(txpool_known{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "legendFormat": "known", "range": true, "refId": "L" } ], "title": "Transaction propagation", "type": "timeseries" }, { "collapsed": true, "gridPos": { "h": 1, "w": 24, "x": 0, "y": 47 }, "id": 149, "panels": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "description": "", "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "smooth", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "reqps" }, "overrides": [ { "matcher": { "id": "byRegexp", "options": ".*(timeout|drop)" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" }, { "id": "custom.axisSoftMax", "value": 100 }, { "id": "unit", "value": "short" } ] } ] }, "gridPos": { "h": 8, "w": 12, "x": 0, "y": 82 }, "id": 150, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true, "sortBy": "Mean", "sortDesc": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "sum(rate(geth_rpc_requests_success_count{instance=\"$instance\"}[5m])) by (chain, instance, method)", "hide": false, "interval": "", "legendFormat": "{{method}}", "range": true, "refId": "A" } ], "title": "Success RPC QPS", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "description": "", "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "smooth", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "reqps" }, "overrides": [ { "matcher": { "id": "byRegexp", "options": ".*(timeout|drop)" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" }, { "id": "custom.axisSoftMax", "value": 100 }, { "id": "unit", "value": "short" } ] } ] }, "gridPos": { "h": 8, "w": 12, "x": 12, "y": 82 }, "id": 147, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true, "sortBy": "Mean", "sortDesc": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "sum(rate(geth_rpc_requests_failure_count{instance=\"$instance\"}[5m])) by (chain, instance, method)", "hide": false, "interval": "", "legendFormat": "{{method}}", "range": true, "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "hide": false, "refId": "B" } ], "title": "Failure RPC QPS", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "description": "", "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "smooth", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": false, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" } ] }, "unit": "dtdurations" }, "overrides": [ { "matcher": { "id": "byName", "options": "debug_traceBlockByNumber" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" } ] } ] }, "gridPos": { "h": 8, "w": 12, "x": 0, "y": 90 }, "id": 146, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true, "sortBy": "Mean", "sortDesc": true }, "tooltip": { "mode": "multi", "sort": "asc" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "sum(rate(geth_rpc_requests_success{quantile='$quantile', instance=\"$instance\"}[5m])) by (chain, instance, method) \n/ \nsum(rate(geth_rpc_requests_success_count{instance=\"$instance\"}[5m])) by (chain, instance, method) /1e6 \n< 1e200", "hide": false, "interval": "", "legendFormat": "{{method}}", "range": true, "refId": "A" } ], "title": "Success RPC Latency", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "description": "", "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "smooth", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "dtdurations" }, "overrides": [ { "matcher": { "id": "byRegexp", "options": ".*(timeout|drop)" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" }, { "id": "custom.axisSoftMax", "value": 100 }, { "id": "unit", "value": "short" } ] } ] }, "gridPos": { "h": 8, "w": 12, "x": 12, "y": 90 }, "id": 151, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true, "sortBy": "Mean", "sortDesc": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "sum(rate(geth_rpc_requests_failure{quantile='$quantile', instance=\"$instance\"}[5m])) by (chain, instance, method) / sum(rate(geth_rpc_requests_failure_count{instance=\"$instance\"}[5m])) by (chain, instance, method) /1e6", "hide": false, "interval": "", "legendFormat": "{{method}}", "range": true, "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "hide": false, "refId": "B" } ], "title": "Failure RPC Latency", "type": "timeseries" } ], "title": "RPC", "type": "row" }, { "collapsed": true, "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "gridPos": { "h": 1, "w": 24, "x": 0, "y": 48 }, "id": 82, "panels": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "percent" }, "overrides": [ { "matcher": { "id": "byName", "options": "goroutines" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" }, { "id": "unit", "value": "short" } ] }, { "matcher": { "id": "byName", "options": "threads" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" }, { "id": "unit", "value": "short" } ] } ] }, "gridPos": { "h": 6, "w": 8, "x": 0, "y": 83 }, "id": 106, "links": [], "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "avg(system_cpu_sysload{chain=\"$chain\", instance=~\"$instance\"}) by (instance)", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "system", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "avg(system_cpu_syswait{chain=\"$chain\", instance=~\"$instance\"}) by (instance)", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "iowait", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "avg(system_cpu_procload{chain=\"$chain\", instance=~\"$instance\"}) by (instance)", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "geth", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "avg(system_cpu_goroutines{chain=\"$chain\", instance=~\"$instance\"}) by (instance)", "hide": false, "interval": "", "legendFormat": "goroutines", "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "avg(system_cpu_threads{chain=\"$chain\", instance=~\"$instance\"}) by (instance)", "hide": false, "interval": "", "legendFormat": "threads", "refId": "E" } ], "title": "CPU", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "smooth", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "decbytes" }, "overrides": [ { "__systemRef": "hideSeriesFrom", "matcher": { "id": "byNames", "options": { "mode": "exclude", "names": [ "used" ], "prefix": "All except:", "readOnly": true } }, "properties": [ { "id": "custom.hideFrom", "value": { "legend": false, "tooltip": false, "viz": true } } ] } ] }, "gridPos": { "h": 6, "w": 8, "x": 8, "y": 83 }, "id": 86, "links": [], "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(system_memory_allocs{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "alloc", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "system_memory_used{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "used", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "system_memory_held{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "held", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "system_memory_frees{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "interval": "", "legendFormat": "free", "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "system_memory_pauses{chain=\"$chain\", instance=~\"$instance\"}", "hide": true, "interval": "", "legendFormat": "pause", "refId": "E" } ], "title": "Memory", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "Bps" }, "overrides": [] }, "gridPos": { "h": 6, "w": 8, "x": 16, "y": 83 }, "id": 85, "links": [], "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(system_disk_readbytes{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "read", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(system_disk_writebytes{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "write", "refId": "B" } ], "title": "Disk", "type": "timeseries" } ], "targets": [ { "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "refId": "A" } ], "title": "System", "type": "row" }, { "collapsed": true, "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "gridPos": { "h": 1, "w": 24, "x": 0, "y": 49 }, "id": 75, "panels": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "Bps" }, "overrides": [ { "matcher": { "id": "byRegexp", "options": ".*-flow$" }, "properties": [ { "id": "unit", "value": "decbytes" }, { "id": "custom.axisPlacement", "value": "right" } ] } ] }, "gridPos": { "h": 6, "w": 12, "x": 0, "y": 84 }, "id": 96, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "rate(p2p_ingress{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "ingress-rate", "range": true, "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "rate(p2p_egress{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "egress-rate", "range": true, "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_ingress{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "igress-flow", "range": true, "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_egress{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "egress-flow", "range": true, "refId": "D" } ], "title": "Traffic", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "none" }, "overrides": [] }, "gridPos": { "h": 6, "w": 12, "x": 12, "y": 84 }, "id": 77, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "p2p_peers{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "peers", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(p2p_dials{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "dials", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(p2p_serves{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "serves", "refId": "C" } ], "title": "Peers", "type": "timeseries" } ], "targets": [ { "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "refId": "A" } ], "title": "Network", "type": "row" }, { "collapsed": true, "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "gridPos": { "h": 1, "w": 24, "x": 0, "y": 50 }, "id": 136, "panels": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "description": "Measured in #peers per second", "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "#EAB839", "value": 30 }, { "color": "#6ED0E0", "value": 50 } ] }, "unit": "cps" }, "overrides": [ { "matcher": { "id": "byRegexp", "options": ".*(timeout|drop)" }, "properties": [ { "id": "unit", "value": "short" } ] } ] }, "gridPos": { "h": 6, "w": 6, "x": 0, "y": 85 }, "id": 129, "links": [], "options": { "colorMode": "value", "graphMode": "area", "justifyMode": "auto", "orientation": "auto", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_downloader_throttle{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "", "refId": "B" } ], "title": "Throttle", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "description": "Measured in blocks per second", "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "smooth", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "reqps" }, "overrides": [ { "matcher": { "id": "byRegexp", "options": ".*(timeout|drop)" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" }, { "id": "custom.axisSoftMax", "value": 100 }, { "id": "unit", "value": "short" } ] } ] }, "gridPos": { "h": 6, "w": 12, "x": 12, "y": 85 }, "id": 144, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_throttle{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "hide": true, "interval": "", "intervalFactor": 1, "legendFormat": "throttle peers", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_downloader_bodies_in{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "bodies in", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_downloader_headers_in{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "headers in", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_downloader_receipts_in{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "receipts in", "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_bodies_drop{chain=\"$chain\", instance=~\"$instance\"}", "hide": true, "interval": "", "legendFormat": "bodies drop", "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_headers_drop{chain=\"$chain\", instance=~\"$instance\"}", "hide": true, "interval": "", "legendFormat": "headers drop", "refId": "F" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_receipts_drop{chain=\"$chain\", instance=~\"$instance\"}", "hide": true, "interval": "", "legendFormat": "receipts drop", "refId": "G" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_bodies_timeout{chain=\"$chain\", instance=~\"$instance\"}", "hide": true, "interval": "", "legendFormat": "bodies timeout", "refId": "H" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_headers_timeout{chain=\"$chain\", instance=~\"$instance\"}", "hide": true, "interval": "", "legendFormat": "headers timeout", "refId": "I" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_receipts_timeout{chain=\"$chain\", instance=~\"$instance\"}", "hide": true, "interval": "", "legendFormat": "receipts timeout", "refId": "J" } ], "title": "QPS", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "description": "Measured in blocks per second", "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "smooth", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "reqps" }, "overrides": [] }, "gridPos": { "h": 6, "w": 12, "x": 0, "y": 91 }, "id": 145, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_throttle{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "hide": true, "interval": "", "intervalFactor": 1, "legendFormat": "throttle peers", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_downloader_bodies_in{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": true, "interval": "", "legendFormat": "bodies in", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_downloader_headers_in{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": true, "interval": "", "legendFormat": "headers in", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_downloader_receipts_in{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": true, "interval": "", "legendFormat": "receipts in", "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_bodies_drop{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "interval": "", "legendFormat": "bodies drop", "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_headers_drop{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "interval": "", "legendFormat": "headers drop", "refId": "F" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_receipts_drop{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "interval": "", "legendFormat": "receipts drop", "refId": "G" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_bodies_timeout{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "interval": "", "legendFormat": "bodies timeout", "refId": "H" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_headers_timeout{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "interval": "", "legendFormat": "headers timeout", "refId": "I" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_receipts_timeout{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "interval": "", "legendFormat": "receipts timeout", "refId": "J" } ], "title": "Abnormal QPS", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "smooth", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "ns" }, "overrides": [] }, "gridPos": { "h": 6, "w": 12, "x": 12, "y": 91 }, "id": 130, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_downloader_bodies_req{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}[1m])", "hide": false, "interval": "", "legendFormat": "bodies(q={{quantile}})", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_downloader_headers_req{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}[1m])", "hide": false, "interval": "", "legendFormat": "headers(q={{quantile}})", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_downloader_receipts_req{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}[1m])", "hide": false, "interval": "", "legendFormat": "receipts(q={{quantile}})", "refId": "D" } ], "title": "Latency", "type": "timeseries" } ], "targets": [ { "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "refId": "A" } ], "title": "Downloader", "type": "row" }, { "collapsed": true, "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "gridPos": { "h": 1, "w": 24, "x": 0, "y": 51 }, "id": 134, "panels": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] } }, "overrides": [] }, "gridPos": { "h": 4, "w": 2, "x": 0, "y": 86 }, "id": 138, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "auto", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_fetcher_transaction_waiting_peers{chain=\"$chain\", instance=~\"$instance\"}", "interval": "", "legendFormat": "", "refId": "A" } ], "title": "Waiting Peers", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] } }, "overrides": [] }, "gridPos": { "h": 4, "w": 2, "x": 2, "y": 86 }, "id": 141, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "auto", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_fetcher_transaction_waiting_hashes{chain=\"$chain\", instance=~\"$instance\"}", "interval": "", "legendFormat": "", "refId": "A" } ], "title": "Waiting Hashes", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] } }, "overrides": [] }, "gridPos": { "h": 4, "w": 2, "x": 4, "y": 86 }, "id": 140, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "auto", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_fetcher_transaction_queueing_peers{chain=\"$chain\", instance=~\"$instance\"}", "interval": "", "legendFormat": "", "refId": "A" } ], "title": "Queueing Peers", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" } ] } }, "overrides": [] }, "gridPos": { "h": 4, "w": 2, "x": 6, "y": 86 }, "id": 139, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "auto", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_fetcher_transaction_queueing_hashes{chain=\"$chain\", instance=~\"$instance\"}", "interval": "", "legendFormat": "", "refId": "A" } ], "title": "Queueing Hashes", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] } }, "overrides": [] }, "gridPos": { "h": 4, "w": 2, "x": 8, "y": 86 }, "id": 142, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "auto", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_fetcher_transaction_fetching_peers{chain=\"$chain\", instance=~\"$instance\"}", "interval": "", "legendFormat": "", "refId": "A" } ], "title": "Fetching Peers", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" } ] } }, "overrides": [] }, "gridPos": { "h": 4, "w": 2, "x": 10, "y": 86 }, "id": 143, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "auto", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_fetcher_transaction_fetching_hashes{chain=\"$chain\", instance=~\"$instance\"}", "interval": "", "legendFormat": "", "refId": "A" } ], "title": "Fetching Hashes", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "description": "Measured in blocks per second", "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "smooth", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "reqps" }, "overrides": [] }, "gridPos": { "h": 12, "w": 12, "x": 12, "y": 86 }, "id": 132, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_transaction_request_out{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "request out", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_transaction_request_fail{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "request fail", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_transaction_request_done{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "request done", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_transaction_request_timeout{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "request timeout", "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_transaction_replies_in{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "replies in", "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_transaction_replies_known{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "replies known", "refId": "F" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_transaction_replies_underpriced{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "replies underpriced", "refId": "G" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_transaction_replies_otherreject{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "replies otherreject", "refId": "H" } ], "title": "QPS of Transaction", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "description": "Measured in blocks per second", "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "smooth", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "reqps" }, "overrides": [ { "matcher": { "id": "byRegexp", "options": ".*(timeout|drop)" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" }, { "id": "custom.axisSoftMax", "value": 100 }, { "id": "unit", "value": "short" } ] } ] }, "gridPos": { "h": 8, "w": 12, "x": 0, "y": 90 }, "id": 131, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_block_bodies{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "bodies", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_block_headers{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "headers", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_block_filter_headers_in{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "filter headers in", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_block_filter_headers_out{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "filter headers out", "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_block_filter_bodies_in{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "filter bodies in", "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_block_filter_bodies_out{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "filter bodies out", "refId": "F" } ], "title": "QPS of Block", "type": "timeseries" } ], "targets": [ { "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "refId": "A" } ], "title": "Fetcher", "type": "row" }, { "collapsed": true, "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "gridPos": { "h": 1, "w": 24, "x": 0, "y": 52 }, "id": 17, "panels": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "Bps" }, "overrides": [] }, "gridPos": { "h": 7, "w": 12, "x": 0, "y": 87 }, "id": 35, "links": [], "options": { "legend": { "calcs": [ "mean", "min", "max" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "rate(eth_db_chaindata_disk_read{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "ethdb read", "range": true, "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "rate(eth_db_chaindata_disk_write{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "intervalFactor": 1, "legendFormat": "ethdb write", "range": true, "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "rate(eth_db_chaindata_ancient_read{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "ancient read", "range": true, "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "rate(eth_db_chaindata_ancient_write{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "intervalFactor": 1, "legendFormat": "ancient write", "range": true, "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_db_chaindata_compact_input{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "compact read", "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_db_chaindata_compact_output{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "compact write", "refId": "F" } ], "title": "Data rate", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "decbytes" }, "overrides": [] }, "gridPos": { "h": 7, "w": 6, "x": 12, "y": 87 }, "id": 118, "links": [], "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "eth_db_chaindata_disk_read{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "leveldb read", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "eth_db_chaindata_disk_write{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "leveldb write", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "eth_db_chaindata_ancient_read{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "ancient read", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "eth_db_chaindata_ancient_write{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "ancient write", "refId": "D" } ], "title": "Session totals", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "decbytes" }, "overrides": [] }, "gridPos": { "h": 7, "w": 6, "x": 18, "y": 87 }, "id": 119, "links": [], "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "eth_db_chaindata_disk_size{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "leveldb", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "eth_db_chaindata_ancient_size{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "ancient", "refId": "A" } ], "title": "Storage size", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "short" }, "overrides": [ { "matcher": { "id": "byName", "options": "delay time" }, "properties": [ { "id": "unit", "value": "ns" } ] } ] }, "gridPos": { "h": 4, "w": 3, "x": 0, "y": 94 }, "id": 127, "links": [], "options": { "colorMode": "value", "graphMode": "area", "justifyMode": "auto", "orientation": "auto", "reduceOptions": { "calcs": [], "fields": "", "values": false }, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_db_chaindata_compact_writedelay_counter{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "", "refId": "B" } ], "title": "Compact Writedelay Count", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "short" }, "overrides": [ { "matcher": { "id": "byName", "options": "time" }, "properties": [ { "id": "custom.lineWidth", "value": 3 }, { "id": "custom.axisPlacement", "value": "right" }, { "id": "unit", "value": "ns" } ] }, { "matcher": { "id": "byName", "options": "delay time" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" }, { "id": "unit", "value": "ns" } ] } ] }, "gridPos": { "h": 8, "w": 21, "x": 3, "y": 94 }, "id": 121, "links": [], "options": { "legend": { "calcs": [ "mean", "min", "max" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_db_chaindata_compact_time{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "time", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_db_chaindata_compact_nonlevel0{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "level0", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_db_chaindata_compact_level0{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "~level0", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_db_chaindata_compact_memory{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "mem", "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_db_chaindata_compact_seek{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "seek", "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_db_chaindata_compact_writedelay_duration{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "delay time", "refId": "F" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_db_chaindata_compact_writedelay_counter{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "delay count", "refId": "G" } ], "title": "Compact", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "ns" }, "overrides": [ { "matcher": { "id": "byName", "options": "time" }, "properties": [ { "id": "unit", "value": "ns" } ] }, { "matcher": { "id": "byName", "options": "delay time" }, "properties": [ { "id": "unit", "value": "ns" } ] } ] }, "gridPos": { "h": 4, "w": 3, "x": 0, "y": 98 }, "id": 128, "links": [], "options": { "colorMode": "value", "graphMode": "area", "justifyMode": "auto", "orientation": "auto", "reduceOptions": { "calcs": [], "fields": "", "values": false }, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_db_chaindata_compact_writedelay_duration{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "", "refId": "B" } ], "title": "Compact Writedelay Duration", "type": "stat" } ], "targets": [ { "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "refId": "A" } ], "title": "Database", "type": "row" }, { "collapsed": true, "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "gridPos": { "h": 1, "w": 24, "x": 0, "y": 53 }, "id": 37, "panels": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "Bps" }, "overrides": [] }, "gridPos": { "h": 6, "w": 12, "x": 0, "y": 88 }, "id": 120, "links": [], "options": { "legend": { "calcs": [ "lastNotNull", "min", "max" ], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "rate(trie_memcache_clean_read{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "instant": false, "intervalFactor": 1, "legendFormat": "read", "range": true, "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "rate(trie_memcache_clean_write{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "intervalFactor": 1, "legendFormat": "write", "range": true, "refId": "B" } ], "title": "Clean cache-BPS", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "Bps" }, "overrides": [] }, "gridPos": { "h": 6, "w": 12, "x": 12, "y": 88 }, "id": 56, "links": [], "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(trie_memcache_gc_size{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "intervalFactor": 1, "legendFormat": "gc", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(trie_memcache_flush_size{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "intervalFactor": 1, "legendFormat": "overflow", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(trie_memcache_commit_size{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "intervalFactor": 1, "legendFormat": "commit", "refId": "A" } ], "title": "Dirty cache-BPS", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "rps" }, "overrides": [ { "matcher": { "id": "byRegexp", "options": ".*rate" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" }, { "id": "unit", "value": "percentunit" }, { "id": "custom.lineWidth", "value": 2 }, { "id": "color", "value": { "mode": "continuous-RdYlGr" } } ] } ] }, "gridPos": { "h": 6, "w": 12, "x": 0, "y": 94 }, "id": 122, "links": [], "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_clean_hit{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "hit", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_clean_miss{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "miss", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_clean_hit{chain=\"$chain\", instance=~\"$instance\"}[1m])/(rate(trie_memcache_clean_miss{chain=\"$chain\", instance=~\"$instance\"}[1m])+rate(trie_memcache_clean_hit{chain=\"$chain\", instance=~\"$instance\"}[1m]))", "hide": false, "interval": "", "legendFormat": "hit rate", "refId": "A" } ], "title": "Clean cache-Count", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "rps" }, "overrides": [ { "matcher": { "id": "byRegexp", "options": ".*rate" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" }, { "id": "unit", "value": "percentunit" }, { "id": "custom.lineWidth", "value": 2 }, { "id": "color", "value": { "mode": "continuous-RdYlGr" } } ] } ] }, "gridPos": { "h": 6, "w": 12, "x": 12, "y": 94 }, "id": 124, "links": [], "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_dirty_hit{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "hit", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_dirty_miss{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "miss", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_dirty_hit{chain=\"$chain\", instance=~\"$instance\"}[1m])/(rate(trie_memcache_dirty_miss{chain=\"$chain\", instance=~\"$instance\"}[1m])+rate(trie_memcache_dirty_hit{chain=\"$chain\", instance=~\"$instance\"}[1m]))", "hide": false, "interval": "", "legendFormat": "hit rate", "refId": "A" } ], "title": "Dirty cache-Count", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "wps" }, "overrides": [] }, "gridPos": { "h": 9, "w": 12, "x": 0, "y": 100 }, "id": 125, "links": [], "options": { "legend": { "calcs": [ "lastNotNull", "mean", "min", "max" ], "displayMode": "table", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_gc_nodes{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "gc", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_commit_nodes{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "commit", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_flush_nodes{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "overflow", "refId": "A" } ], "title": "MPT-Nodes", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "ns" }, "overrides": [] }, "gridPos": { "h": 9, "w": 12, "x": 12, "y": 100 }, "id": 126, "links": [], "options": { "legend": { "calcs": [ "lastNotNull", "mean", "min", "max" ], "displayMode": "table", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_gc_time{chain=\"$chain\", instance=~\"$instance\", quantile=~\"$quantile\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "gc", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_commit_time{chain=\"$chain\", instance=~\"$instance\", quantile=~\"$quantile\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "commit", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_flush_time{chain=\"$chain\", instance=~\"$instance\", quantile=~\"$quantile\"}[1m])", "hide": false, "interval": "", "legendFormat": "overflow", "refId": "A" } ], "title": "MPT-Time", "type": "timeseries" } ], "targets": [ { "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "refId": "A" } ], "title": "Trie Stats", "type": "row" } ], "refresh": "10s", "revision": 1, "schemaVersion": 38, "style": "dark", "tags": [ "go-ethereum", "blockchain", "ethereum", "prometheus" ], "templating": { "list": [ { "current": { "selected": false, "text": "mainnet", "value": "mainnet" }, "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "definition": "label_values(chain_head_block{}, chain)", "description": "go-ethereum compatible chains", "hide": 0, "includeAll": false, "label": "chain", "multi": false, "name": "chain", "options": [], "query": { "query": "label_values(chain_head_block{}, chain)", "refId": "StandardVariableQuery" }, "refresh": 2, "regex": "", "skipUrlSync": false, "sort": 0, "type": "query" }, { "current": { "selected": false, "text": "asrock-boulder-02", "value": "asrock-boulder-02" }, "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "definition": "label_values(chain_head_block{chain=~\"$chain\"}, instance)", "hide": 0, "includeAll": false, "label": "instance", "multi": false, "name": "instance", "options": [], "query": { "query": "label_values(chain_head_block{chain=~\"$chain\"}, instance)", "refId": "StandardVariableQuery" }, "refresh": 1, "regex": "", "skipUrlSync": false, "sort": 0, "type": "query" }, { "current": { "selected": false, "text": "0.95", "value": "0.95" }, "hide": 0, "includeAll": false, "multi": false, "name": "quantile", "options": [ { "selected": false, "text": "0.5", "value": "0.5" }, { "selected": false, "text": "0.75", "value": "0.75" }, { "selected": true, "text": "0.95", "value": "0.95" }, { "selected": false, "text": "0.99", "value": "0.99" }, { "selected": false, "text": "0.999", "value": "0.999" }, { "selected": false, "text": "0.9999", "value": "0.9999" } ], "query": "0.5, 0.75, 0.95, 0.99, 0.999, 0.9999", "queryValue": "", "skipUrlSync": false, "type": "custom" } ] }, "time": { "from": "now-15m", "to": "now" }, "timepicker": { "refresh_intervals": [ "5s", "10s", "30s", "1m", "5m", "15m", "30m", "1h", "2h", "1d" ], "time_options": [ "5m", "15m", "1h", "6h", "12h", "24h", "2d", "7d", "30d" ] }, "timezone": "", "title": "Go-Ethereum-By-Instance", "uid": "MHrP4vo7i", "version": 20, "weekStart": "" }