Skip to content

Latest commit

 

History

History
1371 lines (1184 loc) · 75.3 KB

beacon_api_.md

File metadata and controls

1371 lines (1184 loc) · 75.3 KB

beacon_api_

Events derived from the Beacon API event stream

Availability

  • Public Parquet Files
  • EthPandaOps Clickhouse

Tables

beacon_api_eth_v1_beacon_committee

Contains beacon API /eth/v1/beacon/states/{state_id}/committees data from each sentry client attached to a beacon node.

Sometimes sentries may publish different committees for the same epoch.

Availability

Data is partitioned hourly on slot_start_date_time for the following networks:

  • mainnet: 2023-09-05 to 2024-12-18
  • holesky: 2023-12-25 to 2024-12-18
  • sepolia: 2023-12-24 to 2024-12-18

Examples

Parquet file

https://data.ethpandaops.io/xatu/NETWORK/databases/default/beacon_api_eth_v1_beacon_committee/YYYY/MM/DD/HH.parquet

docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
    SELECT
        *
    FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_beacon_committee/2024/12/13/0.parquet', 'Parquet')
    LIMIT 10
    FORMAT Pretty
"""
Your Clickhouse

Note: FINAL should be used when querying this table

docker run --rm -it --net host clickhouse/clickhouse-server clickhouse client --query="""
    SELECT
        *
    FROM default.beacon_api_eth_v1_beacon_committee FINAL
    WHERE
        slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 10
    FORMAT Pretty
"""
EthPandaOps Clickhouse

Note: FINAL should be used when querying this table

echo """
    SELECT
        *
    FROM default.beacon_api_eth_v1_beacon_committee FINAL
    WHERE
        slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 3
    FORMAT Pretty
""" | curl "https://clickhouse.xatu.ethpandaops.io" -u "$CLICKHOUSE_USER:$CLICKHOUSE_PASSWORD" --data-binary @-

Columns

Name Type Description
updated_date_time DateTime Timestamp when the record was last updated
event_date_time DateTime64(3) When the sentry received the event from a beacon node
slot UInt32 Slot number in the beacon API committee payload
slot_start_date_time DateTime The wall clock time when the slot started
committee_index LowCardinality(String) The committee index in the beacon API committee payload
validators Array(UInt32) The validator indices in the beacon API committee payload
epoch UInt32 The epoch number in the beacon API committee payload
epoch_start_date_time DateTime The wall clock time when the epoch started
meta_client_name LowCardinality(String) Name of the client that generated the event
meta_client_id String Unique Session ID of the client that generated the event. This changes every time the client is restarted.
meta_client_version LowCardinality(String) Version of the client that generated the event
meta_client_implementation LowCardinality(String) Implementation of the client that generated the event
meta_client_os LowCardinality(String) Operating system of the client that generated the event
meta_client_ip Nullable(IPv6) IP address of the client that generated the event
meta_client_geo_city LowCardinality(String) City of the client that generated the event
meta_client_geo_country LowCardinality(String) Country of the client that generated the event
meta_client_geo_country_code LowCardinality(String) Country code of the client that generated the event
meta_client_geo_continent_code LowCardinality(String) Continent code of the client that generated the event
meta_client_geo_longitude Nullable(Float64) Longitude of the client that generated the event
meta_client_geo_latitude Nullable(Float64) Latitude of the client that generated the event
meta_client_geo_autonomous_system_number Nullable(UInt32) Autonomous system number of the client that generated the event
meta_client_geo_autonomous_system_organization Nullable(String) Autonomous system organization of the client that generated the event
meta_network_id Int32 Ethereum network ID
meta_network_name LowCardinality(String) Ethereum network name
meta_consensus_version LowCardinality(String) Ethereum consensus client version that generated the event
meta_consensus_version_major LowCardinality(String) Ethereum consensus client major version that generated the event
meta_consensus_version_minor LowCardinality(String) Ethereum consensus client minor version that generated the event
meta_consensus_version_patch LowCardinality(String) Ethereum consensus client patch version that generated the event
meta_consensus_implementation LowCardinality(String) Ethereum consensus client implementation that generated the event
meta_labels Map(String, String) Labels associated with the event

beacon_api_eth_v1_events_attestation

Contains beacon API eventstream "attestation" data from each sentry client attached to a beacon node.

Availability

Data is partitioned hourly on slot_start_date_time for the following networks:

  • mainnet: 2023-06-05 to 2024-12-18
  • holesky: 2023-09-29 to 2024-12-18
  • sepolia: 2023-09-01 to 2024-12-18

Examples

Parquet file

https://data.ethpandaops.io/xatu/NETWORK/databases/default/beacon_api_eth_v1_events_attestation/YYYY/MM/DD/HH.parquet

docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
    SELECT
        *
    FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_attestation/2024/12/13/0.parquet', 'Parquet')
    LIMIT 10
    FORMAT Pretty
"""
Your Clickhouse
docker run --rm -it --net host clickhouse/clickhouse-server clickhouse client --query="""
    SELECT
        *
    FROM default.beacon_api_eth_v1_events_attestation
    WHERE
        slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 10
    FORMAT Pretty
"""
EthPandaOps Clickhouse
echo """
    SELECT
        *
    FROM default.beacon_api_eth_v1_events_attestation
    WHERE
        slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 3
    FORMAT Pretty
""" | curl "https://clickhouse.xatu.ethpandaops.io" -u "$CLICKHOUSE_USER:$CLICKHOUSE_PASSWORD" --data-binary @-

Columns

Name Type Description
event_date_time DateTime64(3) When the sentry received the event from a beacon node
slot UInt32 Slot number in the beacon API event stream payload
slot_start_date_time DateTime The wall clock time when the slot started
propagation_slot_start_diff UInt32 The difference between the event_date_time and the slot_start_date_time
committee_index LowCardinality(String) The committee index in the beacon API event stream payload
attesting_validator_index Nullable(UInt32) The index of the validator attesting to the event
attesting_validator_committee_index LowCardinality(String) The committee index of the attesting validator
aggregation_bits String The aggregation bits of the event in the beacon API event stream payload
beacon_block_root FixedString(66) The beacon block root hash in the beacon API event stream payload
epoch UInt32 The epoch number in the beacon API event stream payload
epoch_start_date_time DateTime The wall clock time when the epoch started
source_epoch UInt32 The source epoch number in the beacon API event stream payload
source_epoch_start_date_time DateTime The wall clock time when the source epoch started
source_root FixedString(66) The source beacon block root hash in the beacon API event stream payload
target_epoch UInt32 The target epoch number in the beacon API event stream payload
target_epoch_start_date_time DateTime The wall clock time when the target epoch started
target_root FixedString(66) The target beacon block root hash in the beacon API event stream payload
meta_client_name LowCardinality(String) Name of the client that generated the event
meta_client_id String Unique Session ID of the client that generated the event. This changes every time the client is restarted.
meta_client_version LowCardinality(String) Version of the client that generated the event
meta_client_implementation LowCardinality(String) Implementation of the client that generated the event
meta_client_os LowCardinality(String) Operating system of the client that generated the event
meta_client_ip Nullable(IPv6) IP address of the client that generated the event
meta_client_geo_city LowCardinality(String) City of the client that generated the event
meta_client_geo_country LowCardinality(String) Country of the client that generated the event
meta_client_geo_country_code LowCardinality(String) Country code of the client that generated the event
meta_client_geo_continent_code LowCardinality(String) Continent code of the client that generated the event
meta_client_geo_longitude Nullable(Float64) Longitude of the client that generated the event
meta_client_geo_latitude Nullable(Float64) Latitude of the client that generated the event
meta_client_geo_autonomous_system_number Nullable(UInt32) Autonomous system number of the client that generated the event
meta_client_geo_autonomous_system_organization Nullable(String) Autonomous system organization of the client that generated the event
meta_network_id Int32 Ethereum network ID
meta_network_name LowCardinality(String) Ethereum network name
meta_consensus_version LowCardinality(String) Ethereum consensus client version that generated the event
meta_consensus_version_major LowCardinality(String) Ethereum consensus client major version that generated the event
meta_consensus_version_minor LowCardinality(String) Ethereum consensus client minor version that generated the event
meta_consensus_version_patch LowCardinality(String) Ethereum consensus client patch version that generated the event
meta_consensus_implementation LowCardinality(String) Ethereum consensus client implementation that generated the event
meta_labels Map(String, String) Labels associated with the event

beacon_api_eth_v1_events_blob_sidecar

Contains beacon API eventstream "blob_sidecar" data from each sentry client attached to a beacon node.

Availability

Data is partitioned daily on slot_start_date_time for the following networks:

  • mainnet: 2024-03-13 to 2024-12-18
  • holesky: 2024-02-07 to 2024-12-18
  • sepolia: 2024-01-30 to 2024-12-18

Examples

Parquet file

https://data.ethpandaops.io/xatu/NETWORK/databases/default/beacon_api_eth_v1_events_blob_sidecar/YYYY/MM/DD.parquet

docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
    SELECT
        *
    FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_blob_sidecar/2024/12/13.parquet', 'Parquet')
    LIMIT 10
    FORMAT Pretty
"""
Your Clickhouse

Note: FINAL should be used when querying this table

docker run --rm -it --net host clickhouse/clickhouse-server clickhouse client --query="""
    SELECT
        *
    FROM default.beacon_api_eth_v1_events_blob_sidecar FINAL
    WHERE
        slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 10
    FORMAT Pretty
"""
EthPandaOps Clickhouse

Note: FINAL should be used when querying this table

echo """
    SELECT
        *
    FROM default.beacon_api_eth_v1_events_blob_sidecar FINAL
    WHERE
        slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 3
    FORMAT Pretty
""" | curl "https://clickhouse.xatu.ethpandaops.io" -u "$CLICKHOUSE_USER:$CLICKHOUSE_PASSWORD" --data-binary @-

Columns

Name Type Description
updated_date_time DateTime Timestamp when the record was last updated
event_date_time DateTime64(3) When the sentry received the event from a beacon node
slot UInt32 Slot number in the beacon API event stream payload
slot_start_date_time DateTime The wall clock time when the slot started
propagation_slot_start_diff UInt32 The difference between the event_date_time and the slot_start_date_time
epoch UInt32 The epoch number in the beacon API event stream payload
epoch_start_date_time DateTime The wall clock time when the epoch started
block_root FixedString(66) The beacon block root hash in the beacon API event stream payload
blob_index UInt64 The index of blob sidecar in the beacon API event stream payload
kzg_commitment FixedString(98) The KZG commitment in the beacon API event stream payload
versioned_hash FixedString(66) The versioned hash in the beacon API event stream payload
meta_client_name LowCardinality(String) Name of the client that generated the event
meta_client_id String Unique Session ID of the client that generated the event. This changes every time the client is restarted.
meta_client_version LowCardinality(String) Version of the client that generated the event
meta_client_implementation LowCardinality(String) Implementation of the client that generated the event
meta_client_os LowCardinality(String) Operating system of the client that generated the event
meta_client_ip Nullable(IPv6) IP address of the client that generated the event
meta_client_geo_city LowCardinality(String) City of the client that generated the event
meta_client_geo_country LowCardinality(String) Country of the client that generated the event
meta_client_geo_country_code LowCardinality(String) Country code of the client that generated the event
meta_client_geo_continent_code LowCardinality(String) Continent code of the client that generated the event
meta_client_geo_longitude Nullable(Float64) Longitude of the client that generated the event
meta_client_geo_latitude Nullable(Float64) Latitude of the client that generated the event
meta_client_geo_autonomous_system_number Nullable(UInt32) Autonomous system number of the client that generated the event
meta_client_geo_autonomous_system_organization Nullable(String) Autonomous system organization of the client that generated the event
meta_network_id Int32 Ethereum network ID
meta_network_name LowCardinality(String) Ethereum network name
meta_consensus_version LowCardinality(String) Ethereum consensus client version that generated the event
meta_consensus_version_major LowCardinality(String) Ethereum consensus client major version that generated the event
meta_consensus_version_minor LowCardinality(String) Ethereum consensus client minor version that generated the event
meta_consensus_version_patch LowCardinality(String) Ethereum consensus client patch version that generated the event
meta_consensus_implementation LowCardinality(String) Ethereum consensus client implementation that generated the event
meta_labels Map(String, String) Labels associated with the event

beacon_api_eth_v1_events_block

Contains beacon API eventstream "block" data from each sentry client attached to a beacon node.

Availability

Data is partitioned daily on slot_start_date_time for the following networks:

  • mainnet: 2023-02-28 to 2024-12-18
  • holesky: 2023-12-24 to 2024-12-18
  • sepolia: 2023-12-24 to 2024-12-18

Examples

Parquet file

https://data.ethpandaops.io/xatu/NETWORK/databases/default/beacon_api_eth_v1_events_block/YYYY/MM/DD.parquet

docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
    SELECT
        *
    FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_block/2024/12/13.parquet', 'Parquet')
    LIMIT 10
    FORMAT Pretty
"""
Your Clickhouse

Note: FINAL should be used when querying this table

docker run --rm -it --net host clickhouse/clickhouse-server clickhouse client --query="""
    SELECT
        *
    FROM default.beacon_api_eth_v1_events_block FINAL
    WHERE
        slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 10
    FORMAT Pretty
"""
EthPandaOps Clickhouse

Note: FINAL should be used when querying this table

echo """
    SELECT
        *
    FROM default.beacon_api_eth_v1_events_block FINAL
    WHERE
        slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 3
    FORMAT Pretty
""" | curl "https://clickhouse.xatu.ethpandaops.io" -u "$CLICKHOUSE_USER:$CLICKHOUSE_PASSWORD" --data-binary @-

Columns

Name Type Description
updated_date_time DateTime Timestamp when the record was last updated
event_date_time DateTime64(3) When the sentry received the event from a beacon node
slot UInt32 Slot number in the beacon API event stream payload
slot_start_date_time DateTime The wall clock time when the slot started
propagation_slot_start_diff UInt32 The difference between the event_date_time and the slot_start_date_time
block FixedString(66) The beacon block root hash in the beacon API event stream payload
epoch UInt32 The epoch number in the beacon API event stream payload
epoch_start_date_time DateTime The wall clock time when the epoch started
execution_optimistic Bool If the attached beacon node is running in execution optimistic mode
meta_client_name LowCardinality(String) Name of the client that generated the event
meta_client_id String Unique Session ID of the client that generated the event. This changes every time the client is restarted.
meta_client_version LowCardinality(String) Version of the client that generated the event
meta_client_implementation LowCardinality(String) Implementation of the client that generated the event
meta_client_os LowCardinality(String) Operating system of the client that generated the event
meta_client_ip Nullable(IPv6) IP address of the client that generated the event
meta_client_geo_city LowCardinality(String) City of the client that generated the event
meta_client_geo_country LowCardinality(String) Country of the client that generated the event
meta_client_geo_country_code LowCardinality(String) Country code of the client that generated the event
meta_client_geo_continent_code LowCardinality(String) Continent code of the client that generated the event
meta_client_geo_longitude Nullable(Float64) Longitude of the client that generated the event
meta_client_geo_latitude Nullable(Float64) Latitude of the client that generated the event
meta_client_geo_autonomous_system_number Nullable(UInt32) Autonomous system number of the client that generated the event
meta_client_geo_autonomous_system_organization Nullable(String) Autonomous system organization of the client that generated the event
meta_network_id Int32 Ethereum network ID
meta_network_name LowCardinality(String) Ethereum network name
meta_consensus_version LowCardinality(String) Ethereum consensus client version that generated the event
meta_consensus_version_major LowCardinality(String) Ethereum consensus client major version that generated the event
meta_consensus_version_minor LowCardinality(String) Ethereum consensus client minor version that generated the event
meta_consensus_version_patch LowCardinality(String) Ethereum consensus client patch version that generated the event
meta_consensus_implementation LowCardinality(String) Ethereum consensus client implementation that generated the event
meta_labels Map(String, String) Labels associated with the event

beacon_api_eth_v1_events_chain_reorg

Contains beacon API eventstream "chain reorg" data from each sentry client attached to a beacon node.

Availability

Data is partitioned daily on slot_start_date_time for the following networks:

  • mainnet: 2023-03-01 to 2024-12-18
  • holesky: 2024-02-05 to 2024-12-18
  • sepolia: 2024-05-23 to 2024-12-18

Examples

Parquet file

https://data.ethpandaops.io/xatu/NETWORK/databases/default/beacon_api_eth_v1_events_chain_reorg/YYYY/MM/DD.parquet

docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
    SELECT
        *
    FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_chain_reorg/2024/12/13.parquet', 'Parquet')
    LIMIT 10
    FORMAT Pretty
"""
Your Clickhouse

Note: FINAL should be used when querying this table

docker run --rm -it --net host clickhouse/clickhouse-server clickhouse client --query="""
    SELECT
        *
    FROM default.beacon_api_eth_v1_events_chain_reorg FINAL
    WHERE
        slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 10
    FORMAT Pretty
"""
EthPandaOps Clickhouse

Note: FINAL should be used when querying this table

echo """
    SELECT
        *
    FROM default.beacon_api_eth_v1_events_chain_reorg FINAL
    WHERE
        slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 3
    FORMAT Pretty
""" | curl "https://clickhouse.xatu.ethpandaops.io" -u "$CLICKHOUSE_USER:$CLICKHOUSE_PASSWORD" --data-binary @-

Columns

Name Type Description
updated_date_time DateTime Timestamp when the record was last updated
event_date_time DateTime64(3) When the sentry received the event from a beacon node
slot UInt32 The slot number of the chain reorg event in the beacon API event stream payload
slot_start_date_time DateTime The wall clock time when the reorg slot started
propagation_slot_start_diff UInt32 Difference in slots between when the reorg occurred and when the sentry received the event
depth UInt16 The depth of the chain reorg in the beacon API event stream payload
old_head_block FixedString(66) The old head block root hash in the beacon API event stream payload
new_head_block FixedString(66) The new head block root hash in the beacon API event stream payload
old_head_state FixedString(66) The old head state root hash in the beacon API event stream payload
new_head_state FixedString(66) The new head state root hash in the beacon API event stream payload
epoch UInt32 The epoch number in the beacon API event stream payload
epoch_start_date_time DateTime The wall clock time when the epoch started
execution_optimistic Bool Whether the execution of the epoch was optimistic
meta_client_name LowCardinality(String) Name of the client that generated the event
meta_client_id String Unique Session ID of the client that generated the event. This changes every time the client is restarted.
meta_client_version LowCardinality(String) Version of the client that generated the event
meta_client_implementation LowCardinality(String) Implementation of the client that generated the event
meta_client_os LowCardinality(String) Operating system of the client that generated the event
meta_client_ip Nullable(IPv6) IP address of the client that generated the event
meta_client_geo_city LowCardinality(String) City of the client that generated the event
meta_client_geo_country LowCardinality(String) Country of the client that generated the event
meta_client_geo_country_code LowCardinality(String) Country code of the client that generated the event
meta_client_geo_continent_code LowCardinality(String) Continent code of the client that generated the event
meta_client_geo_longitude Nullable(Float64) Longitude of the client that generated the event
meta_client_geo_latitude Nullable(Float64) Latitude of the client that generated the event
meta_client_geo_autonomous_system_number Nullable(UInt32) Autonomous system number of the client that generated the event
meta_client_geo_autonomous_system_organization Nullable(String) Autonomous system organization of the client that generated the event
meta_network_id Int32 Ethereum network ID
meta_network_name LowCardinality(String) Ethereum network name
meta_consensus_version LowCardinality(String) Ethereum consensus client version that generated the event
meta_consensus_version_major LowCardinality(String) Ethereum consensus client major version that generated the event
meta_consensus_version_minor LowCardinality(String) Ethereum consensus client minor version that generated the event
meta_consensus_version_patch LowCardinality(String) Ethereum consensus client patch version that generated the event
meta_consensus_implementation LowCardinality(String) Ethereum consensus client implementation that generated the event
meta_labels Map(String, String) Labels associated with the event

beacon_api_eth_v1_events_contribution_and_proof

Contains beacon API eventstream "contribution and proof" data from each sentry client attached to a beacon node.

Availability

Data is partitioned daily on contribution_slot_start_date_time for the following networks:

  • mainnet: 2023-08-31 to 2024-12-18
  • holesky: 2023-12-24 to 2024-12-18
  • sepolia: 2023-12-24 to 2024-12-18

Examples

Parquet file

https://data.ethpandaops.io/xatu/NETWORK/databases/default/beacon_api_eth_v1_events_contribution_and_proof/YYYY/MM/DD.parquet

docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
    SELECT
        *
    FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_contribution_and_proof/2024/12/13.parquet', 'Parquet')
    LIMIT 10
    FORMAT Pretty
"""
Your Clickhouse

Note: FINAL should be used when querying this table

docker run --rm -it --net host clickhouse/clickhouse-server clickhouse client --query="""
    SELECT
        *
    FROM default.beacon_api_eth_v1_events_contribution_and_proof FINAL
    WHERE
        contribution_slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 10
    FORMAT Pretty
"""
EthPandaOps Clickhouse

Note: FINAL should be used when querying this table

echo """
    SELECT
        *
    FROM default.beacon_api_eth_v1_events_contribution_and_proof FINAL
    WHERE
        contribution_slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 3
    FORMAT Pretty
""" | curl "https://clickhouse.xatu.ethpandaops.io" -u "$CLICKHOUSE_USER:$CLICKHOUSE_PASSWORD" --data-binary @-

Columns

Name Type Description
updated_date_time DateTime Timestamp when the record was last updated
event_date_time DateTime64(3) When the sentry received the event from a beacon node
aggregator_index UInt32 The validator index of the aggregator in the beacon API event stream payload
contribution_slot UInt32 The slot number of the contribution in the beacon API event stream payload
contribution_slot_start_date_time DateTime The wall clock time when the contribution slot started
contribution_propagation_slot_start_diff UInt32 Difference in slots between when the contribution occurred and when the sentry received the event
contribution_beacon_block_root FixedString(66) The beacon block root hash in the beacon API event stream payload
contribution_subcommittee_index LowCardinality(String) The subcommittee index of the contribution in the beacon API event stream payload
contribution_aggregation_bits String The aggregation bits of the contribution in the beacon API event stream payload
contribution_signature String The signature of the contribution in the beacon API event stream payload
contribution_epoch UInt32 The epoch number of the contribution in the beacon API event stream payload
contribution_epoch_start_date_time DateTime The wall clock time when the contribution epoch started
selection_proof String The selection proof in the beacon API event stream payload
signature String The signature in the beacon API event stream payload
meta_client_name LowCardinality(String) Name of the client that generated the event
meta_client_id String Unique Session ID of the client that generated the event. This changes every time the client is restarted.
meta_client_version LowCardinality(String) Version of the client that generated the event
meta_client_implementation LowCardinality(String) Implementation of the client that generated the event
meta_client_os LowCardinality(String) Operating system of the client that generated the event
meta_client_ip Nullable(IPv6) IP address of the client that generated the event
meta_client_geo_city LowCardinality(String) City of the client that generated the event
meta_client_geo_country LowCardinality(String) Country of the client that generated the event
meta_client_geo_country_code LowCardinality(String) Country code of the client that generated the event
meta_client_geo_continent_code LowCardinality(String) Continent code of the client that generated the event
meta_client_geo_longitude Nullable(Float64) Longitude of the client that generated the event
meta_client_geo_latitude Nullable(Float64) Latitude of the client that generated the event
meta_client_geo_autonomous_system_number Nullable(UInt32) Autonomous system number of the client that generated the event
meta_client_geo_autonomous_system_organization Nullable(String) Autonomous system organization of the client that generated the event
meta_network_id Int32 Ethereum network ID
meta_network_name LowCardinality(String) Ethereum network name
meta_consensus_version LowCardinality(String) Ethereum consensus client version that generated the event
meta_consensus_version_major LowCardinality(String) Ethereum consensus client major version that generated the event
meta_consensus_version_minor LowCardinality(String) Ethereum consensus client minor version that generated the event
meta_consensus_version_patch LowCardinality(String) Ethereum consensus client patch version that generated the event
meta_consensus_implementation LowCardinality(String) Ethereum consensus client implementation that generated the event
meta_labels Map(String, String) Labels associated with the event

beacon_api_eth_v1_events_finalized_checkpoint

Contains beacon API eventstream "finalized checkpoint" data from each sentry client attached to a beacon node.

Availability

Data is partitioned daily on epoch_start_date_time for the following networks:

  • mainnet: 2023-04-10 to 2024-12-18
  • holesky: 2023-03-26 to 2024-12-18
  • sepolia: 2023-03-26 to 2024-12-18

Examples

Parquet file

https://data.ethpandaops.io/xatu/NETWORK/databases/default/beacon_api_eth_v1_events_finalized_checkpoint/YYYY/MM/DD.parquet

docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
    SELECT
        *
    FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_finalized_checkpoint/2024/12/13.parquet', 'Parquet')
    LIMIT 10
    FORMAT Pretty
"""
Your Clickhouse

Note: FINAL should be used when querying this table

docker run --rm -it --net host clickhouse/clickhouse-server clickhouse client --query="""
    SELECT
        *
    FROM default.beacon_api_eth_v1_events_finalized_checkpoint FINAL
    WHERE
        epoch_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 10
    FORMAT Pretty
"""
EthPandaOps Clickhouse

Note: FINAL should be used when querying this table

echo """
    SELECT
        *
    FROM default.beacon_api_eth_v1_events_finalized_checkpoint FINAL
    WHERE
        epoch_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 3
    FORMAT Pretty
""" | curl "https://clickhouse.xatu.ethpandaops.io" -u "$CLICKHOUSE_USER:$CLICKHOUSE_PASSWORD" --data-binary @-

Columns

Name Type Description
updated_date_time DateTime Timestamp when the record was last updated
event_date_time DateTime64(3) When the sentry received the event from a beacon node
block FixedString(66) The finalized block root hash in the beacon API event stream payload
state FixedString(66) The finalized state root hash in the beacon API event stream payload
epoch UInt32 The epoch number in the beacon API event stream payload
epoch_start_date_time DateTime The wall clock time when the epoch started
execution_optimistic Bool Whether the execution of the epoch was optimistic
meta_client_name LowCardinality(String) Name of the client that generated the event
meta_client_id String Unique Session ID of the client that generated the event. This changes every time the client is restarted.
meta_client_version LowCardinality(String) Version of the client that generated the event
meta_client_implementation LowCardinality(String) Implementation of the client that generated the event
meta_client_os LowCardinality(String) Operating system of the client that generated the event
meta_client_ip Nullable(IPv6) IP address of the client that generated the event
meta_client_geo_city LowCardinality(String) City of the client that generated the event
meta_client_geo_country LowCardinality(String) Country of the client that generated the event
meta_client_geo_country_code LowCardinality(String) Country code of the client that generated the event
meta_client_geo_continent_code LowCardinality(String) Continent code of the client that generated the event
meta_client_geo_longitude Nullable(Float64) Longitude of the client that generated the event
meta_client_geo_latitude Nullable(Float64) Latitude of the client that generated the event
meta_client_geo_autonomous_system_number Nullable(UInt32) Autonomous system number of the client that generated the event
meta_client_geo_autonomous_system_organization Nullable(String) Autonomous system organization of the client that generated the event
meta_network_id Int32 Ethereum network ID
meta_network_name LowCardinality(String) Ethereum network name
meta_consensus_version LowCardinality(String) Ethereum consensus client version that generated the event
meta_consensus_version_major LowCardinality(String) Ethereum consensus client major version that generated the event
meta_consensus_version_minor LowCardinality(String) Ethereum consensus client minor version that generated the event
meta_consensus_version_patch LowCardinality(String) Ethereum consensus client patch version that generated the event
meta_consensus_implementation LowCardinality(String) Ethereum consensus client implementation that generated the event
meta_labels Map(String, String) Labels associated with the event

beacon_api_eth_v1_events_head

Contains beacon API eventstream "head" data from each sentry client attached to a beacon node.

Availability

Data is partitioned daily on slot_start_date_time for the following networks:

  • mainnet: 2023-08-30 to 2024-12-18
  • holesky: 2023-12-05 to 2024-12-18
  • sepolia: 2023-12-05 to 2024-12-18

Examples

Parquet file

https://data.ethpandaops.io/xatu/NETWORK/databases/default/beacon_api_eth_v1_events_head/YYYY/MM/DD.parquet

docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
    SELECT
        *
    FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_head/2024/12/13.parquet', 'Parquet')
    LIMIT 10
    FORMAT Pretty
"""
Your Clickhouse

Note: FINAL should be used when querying this table

docker run --rm -it --net host clickhouse/clickhouse-server clickhouse client --query="""
    SELECT
        *
    FROM default.beacon_api_eth_v1_events_head FINAL
    WHERE
        slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 10
    FORMAT Pretty
"""
EthPandaOps Clickhouse

Note: FINAL should be used when querying this table

echo """
    SELECT
        *
    FROM default.beacon_api_eth_v1_events_head FINAL
    WHERE
        slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 3
    FORMAT Pretty
""" | curl "https://clickhouse.xatu.ethpandaops.io" -u "$CLICKHOUSE_USER:$CLICKHOUSE_PASSWORD" --data-binary @-

Columns

Name Type Description
updated_date_time DateTime Timestamp when the record was last updated
event_date_time DateTime64(3) When the sentry received the event from a beacon node
slot UInt32 Slot number in the beacon API event stream payload
slot_start_date_time DateTime The wall clock time when the slot started
propagation_slot_start_diff UInt32 The difference between the event_date_time and the slot_start_date_time
block FixedString(66) The beacon block root hash in the beacon API event stream payload
epoch UInt32 The epoch number in the beacon API event stream payload
epoch_start_date_time DateTime The wall clock time when the epoch started
epoch_transition Bool If the event is an epoch transition
execution_optimistic Bool If the attached beacon node is running in execution optimistic mode
previous_duty_dependent_root FixedString(66) The previous duty dependent root in the beacon API event stream payload
current_duty_dependent_root FixedString(66) The current duty dependent root in the beacon API event stream payload
meta_client_name LowCardinality(String) Name of the client that generated the event
meta_client_id String Unique Session ID of the client that generated the event. This changes every time the client is restarted.
meta_client_version LowCardinality(String) Version of the client that generated the event
meta_client_implementation LowCardinality(String) Implementation of the client that generated the event
meta_client_os LowCardinality(String) Operating system of the client that generated the event
meta_client_ip Nullable(IPv6) IP address of the client that generated the event
meta_client_geo_city LowCardinality(String) City of the client that generated the event
meta_client_geo_country LowCardinality(String) Country of the client that generated the event
meta_client_geo_country_code LowCardinality(String) Country code of the client that generated the event
meta_client_geo_continent_code LowCardinality(String) Continent code of the client that generated the event
meta_client_geo_longitude Nullable(Float64) Longitude of the client that generated the event
meta_client_geo_latitude Nullable(Float64) Latitude of the client that generated the event
meta_client_geo_autonomous_system_number Nullable(UInt32) Autonomous system number of the client that generated the event
meta_client_geo_autonomous_system_organization Nullable(String) Autonomous system organization of the client that generated the event
meta_network_id Int32 Ethereum network ID
meta_network_name LowCardinality(String) Ethereum network name
meta_consensus_version LowCardinality(String) Ethereum consensus client version that generated the event
meta_consensus_version_major LowCardinality(String) Ethereum consensus client major version that generated the event
meta_consensus_version_minor LowCardinality(String) Ethereum consensus client minor version that generated the event
meta_consensus_version_patch LowCardinality(String) Ethereum consensus client patch version that generated the event
meta_consensus_implementation LowCardinality(String) Ethereum consensus client implementation that generated the event
meta_labels Map(String, String) Labels associated with the event

beacon_api_eth_v1_events_voluntary_exit

Contains beacon API eventstream "voluntary exit" data from each sentry client attached to a beacon node.

Availability

Data is partitioned daily on wallclock_epoch_start_date_time for the following networks:

  • mainnet: 2020-12-01 to 2024-12-18
  • holesky: 2023-10-01 to 2024-12-18
  • sepolia: 2023-10-01 to null

Examples

Parquet file

https://data.ethpandaops.io/xatu/NETWORK/databases/default/beacon_api_eth_v1_events_voluntary_exit/YYYY/MM/DD.parquet

docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
    SELECT
        *
    FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_voluntary_exit/2024/12/13.parquet', 'Parquet')
    LIMIT 10
    FORMAT Pretty
"""
Your Clickhouse

Note: FINAL should be used when querying this table

docker run --rm -it --net host clickhouse/clickhouse-server clickhouse client --query="""
    SELECT
        *
    FROM default.beacon_api_eth_v1_events_voluntary_exit FINAL
    WHERE
        wallclock_epoch_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 10
    FORMAT Pretty
"""
EthPandaOps Clickhouse

Note: FINAL should be used when querying this table

echo """
    SELECT
        *
    FROM default.beacon_api_eth_v1_events_voluntary_exit FINAL
    WHERE
        wallclock_epoch_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 3
    FORMAT Pretty
""" | curl "https://clickhouse.xatu.ethpandaops.io" -u "$CLICKHOUSE_USER:$CLICKHOUSE_PASSWORD" --data-binary @-

Columns

Name Type Description
updated_date_time DateTime Timestamp when the record was last updated
event_date_time DateTime64(3) When the sentry received the event from a beacon node
epoch UInt32 The epoch number in the beacon API event stream payload
epoch_start_date_time DateTime The wall clock time when the epoch started
wallclock_slot UInt32 Slot number of the wall clock when the event was received
wallclock_slot_start_date_time DateTime Start date and time of the wall clock slot when the event was received
wallclock_epoch UInt32 Epoch number of the wall clock when the event was received
wallclock_epoch_start_date_time DateTime Start date and time of the wall clock epoch when the event was received
validator_index UInt32 The index of the validator making the voluntary exit
signature String The signature of the voluntary exit in the beacon API event stream payload
meta_client_name LowCardinality(String) Name of the client that generated the event
meta_client_id String Unique Session ID of the client that generated the event. This changes every time the client is restarted.
meta_client_version LowCardinality(String) Version of the client that generated the event
meta_client_implementation LowCardinality(String) Implementation of the client that generated the event
meta_client_os LowCardinality(String) Operating system of the client that generated the event
meta_client_ip Nullable(IPv6) IP address of the client that generated the event
meta_client_geo_city LowCardinality(String) City of the client that generated the event
meta_client_geo_country LowCardinality(String) Country of the client that generated the event
meta_client_geo_country_code LowCardinality(String) Country code of the client that generated the event
meta_client_geo_continent_code LowCardinality(String) Continent code of the client that generated the event
meta_client_geo_longitude Nullable(Float64) Longitude of the client that generated the event
meta_client_geo_latitude Nullable(Float64) Latitude of the client that generated the event
meta_client_geo_autonomous_system_number Nullable(UInt32) Autonomous system number of the client that generated the event
meta_client_geo_autonomous_system_organization Nullable(String) Autonomous system organization of the client that generated the event
meta_network_id Int32 Ethereum network ID
meta_network_name LowCardinality(String) Ethereum network name
meta_consensus_version LowCardinality(String) Ethereum consensus client version that generated the event
meta_consensus_version_major LowCardinality(String) Ethereum consensus client major version that generated the event
meta_consensus_version_minor LowCardinality(String) Ethereum consensus client minor version that generated the event
meta_consensus_version_patch LowCardinality(String) Ethereum consensus client patch version that generated the event
meta_consensus_implementation LowCardinality(String) Ethereum consensus client implementation that generated the event
meta_labels Map(String, String) Labels associated with the event

beacon_api_eth_v1_validator_attestation_data

Contains beacon API validator attestation data from each sentry client attached to a beacon node.

Availability

Data is partitioned daily on slot_start_date_time for the following networks:

  • mainnet: 2023-08-31 to 2024-12-18
  • holesky: 2023-12-24 to 2024-12-18
  • sepolia: 2023-12-24 to 2024-12-18

Examples

Parquet file

https://data.ethpandaops.io/xatu/NETWORK/databases/default/beacon_api_eth_v1_validator_attestation_data/YYYY/MM/DD.parquet

docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
    SELECT
        *
    FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_validator_attestation_data/2024/12/13.parquet', 'Parquet')
    LIMIT 10
    FORMAT Pretty
"""
Your Clickhouse

Note: FINAL should be used when querying this table

docker run --rm -it --net host clickhouse/clickhouse-server clickhouse client --query="""
    SELECT
        *
    FROM default.beacon_api_eth_v1_validator_attestation_data FINAL
    WHERE
        slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 10
    FORMAT Pretty
"""
EthPandaOps Clickhouse

Note: FINAL should be used when querying this table

echo """
    SELECT
        *
    FROM default.beacon_api_eth_v1_validator_attestation_data FINAL
    WHERE
        slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 3
    FORMAT Pretty
""" | curl "https://clickhouse.xatu.ethpandaops.io" -u "$CLICKHOUSE_USER:$CLICKHOUSE_PASSWORD" --data-binary @-

Columns

Name Type Description
updated_date_time DateTime Timestamp when the record was last updated
event_date_time DateTime64(3) When the sentry received the event from a beacon node
slot UInt32 Slot number in the beacon API validator attestation data payload
slot_start_date_time DateTime The wall clock time when the slot started
committee_index LowCardinality(String) The committee index in the beacon API validator attestation data payload
beacon_block_root FixedString(66) The beacon block root hash in the beacon API validator attestation data payload
epoch UInt32 The epoch number in the beacon API validator attestation data payload
epoch_start_date_time DateTime The wall clock time when the epoch started
source_epoch UInt32 The source epoch number in the beacon API validator attestation data payload
source_epoch_start_date_time DateTime The wall clock time when the source epoch started
source_root FixedString(66) The source beacon block root hash in the beacon API validator attestation data payload
target_epoch UInt32 The target epoch number in the beacon API validator attestation data payload
target_epoch_start_date_time DateTime The wall clock time when the target epoch started
target_root FixedString(66) The target beacon block root hash in the beacon API validator attestation data payload
request_date_time DateTime When the request was sent to the beacon node
request_duration UInt32 The request duration in milliseconds
request_slot_start_diff UInt32 The difference between the request_date_time and the slot_start_date_time
meta_client_name LowCardinality(String) Name of the client that generated the event
meta_client_id String Unique Session ID of the client that generated the event. This changes every time the client is restarted.
meta_client_version LowCardinality(String) Version of the client that generated the event
meta_client_implementation LowCardinality(String) Implementation of the client that generated the event
meta_client_os LowCardinality(String) Operating system of the client that generated the event
meta_client_ip Nullable(IPv6) IP address of the client that generated the event
meta_client_geo_city LowCardinality(String) City of the client that generated the event
meta_client_geo_country LowCardinality(String) Country of the client that generated the event
meta_client_geo_country_code LowCardinality(String) Country code of the client that generated the event
meta_client_geo_continent_code LowCardinality(String) Continent code of the client that generated the event
meta_client_geo_longitude Nullable(Float64) Longitude of the client that generated the event
meta_client_geo_latitude Nullable(Float64) Latitude of the client that generated the event
meta_client_geo_autonomous_system_number Nullable(UInt32) Autonomous system number of the client that generated the event
meta_client_geo_autonomous_system_organization Nullable(String) Autonomous system organization of the client that generated the event
meta_network_id Int32 Ethereum network ID
meta_network_name LowCardinality(String) Ethereum network name
meta_consensus_version LowCardinality(String) Ethereum consensus client version that generated the event
meta_consensus_version_major LowCardinality(String) Ethereum consensus client major version that generated the event
meta_consensus_version_minor LowCardinality(String) Ethereum consensus client minor version that generated the event
meta_consensus_version_patch LowCardinality(String) Ethereum consensus client patch version that generated the event
meta_consensus_implementation LowCardinality(String) Ethereum consensus client implementation that generated the event
meta_labels Map(String, String) Labels associated with the event

beacon_api_eth_v2_beacon_block

Contains beacon API /eth/v2/beacon/blocks/{block_id} data from each sentry client attached to a beacon node.

Availability

Data is partitioned daily on slot_start_date_time for the following networks:

  • mainnet: 2023-11-14 to 2024-12-18
  • holesky: 2023-12-24 to 2024-12-18
  • sepolia: 2023-12-24 to 2024-12-18

Examples

Parquet file

https://data.ethpandaops.io/xatu/NETWORK/databases/default/beacon_api_eth_v2_beacon_block/YYYY/MM/DD.parquet

docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
    SELECT
        *
    FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v2_beacon_block/2024/12/13.parquet', 'Parquet')
    LIMIT 10
    FORMAT Pretty
"""
Your Clickhouse

Note: FINAL should be used when querying this table

docker run --rm -it --net host clickhouse/clickhouse-server clickhouse client --query="""
    SELECT
        *
    FROM default.beacon_api_eth_v2_beacon_block FINAL
    WHERE
        slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 10
    FORMAT Pretty
"""
EthPandaOps Clickhouse

Note: FINAL should be used when querying this table

echo """
    SELECT
        *
    FROM default.beacon_api_eth_v2_beacon_block FINAL
    WHERE
        slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 3
    FORMAT Pretty
""" | curl "https://clickhouse.xatu.ethpandaops.io" -u "$CLICKHOUSE_USER:$CLICKHOUSE_PASSWORD" --data-binary @-

Columns

Name Type Description
updated_date_time DateTime Timestamp when the record was last updated
event_date_time DateTime64(3) When the sentry fetched the beacon block from a beacon node
slot UInt32 The slot number from beacon block payload
slot_start_date_time DateTime The wall clock time when the reorg slot started
epoch UInt32 The epoch number from beacon block payload
epoch_start_date_time DateTime The wall clock time when the epoch started
block_root FixedString(66) The root hash of the beacon block
block_version LowCardinality(String) The version of the beacon block
block_total_bytes Nullable(UInt32) The total bytes of the beacon block payload
block_total_bytes_compressed Nullable(UInt32) The total bytes of the beacon block payload when compressed using snappy
parent_root FixedString(66) The root hash of the parent beacon block
state_root FixedString(66) The root hash of the beacon state at this block
proposer_index UInt32 The index of the validator that proposed the beacon block
eth1_data_block_hash FixedString(66) The block hash of the associated execution block
eth1_data_deposit_root FixedString(66) The root of the deposit tree in the associated execution block
execution_payload_block_hash FixedString(66) The block hash of the execution payload
execution_payload_block_number UInt32 The block number of the execution payload
execution_payload_fee_recipient String The recipient of the fee for this execution payload
execution_payload_base_fee_per_gas Nullable(UInt128) Base fee per gas for execution payload
execution_payload_blob_gas_used Nullable(UInt64) Gas used for blobs in execution payload
execution_payload_excess_blob_gas Nullable(UInt64) Excess gas used for blobs in execution payload
execution_payload_gas_limit Nullable(UInt64) Gas limit for execution payload
execution_payload_gas_used Nullable(UInt64) Gas used for execution payload
execution_payload_state_root FixedString(66) The state root of the execution payload
execution_payload_parent_hash FixedString(66) The parent hash of the execution payload
execution_payload_transactions_count Nullable(UInt32) The transaction count of the execution payload
execution_payload_transactions_total_bytes Nullable(UInt32) The transaction total bytes of the execution payload
execution_payload_transactions_total_bytes_compressed Nullable(UInt32) The transaction total bytes of the execution payload when compressed using snappy
meta_client_name LowCardinality(String) Name of the client that generated the event
meta_client_id String Unique Session ID of the client that generated the event. This changes every time the client is restarted.
meta_client_version LowCardinality(String) Version of the client that generated the event
meta_client_implementation LowCardinality(String) Implementation of the client that generated the event
meta_client_os LowCardinality(String) Operating system of the client that generated the event
meta_client_ip Nullable(IPv6) IP address of the client that generated the event
meta_client_geo_city LowCardinality(String) City of the client that generated the event
meta_client_geo_country LowCardinality(String) Country of the client that generated the event
meta_client_geo_country_code LowCardinality(String) Country code of the client that generated the event
meta_client_geo_continent_code LowCardinality(String) Continent code of the client that generated the event
meta_client_geo_longitude Nullable(Float64) Longitude of the client that generated the event
meta_client_geo_latitude Nullable(Float64) Latitude of the client that generated the event
meta_client_geo_autonomous_system_number Nullable(UInt32) Autonomous system number of the client that generated the event
meta_client_geo_autonomous_system_organization Nullable(String) Autonomous system organization of the client that generated the event
meta_network_id Int32 Ethereum network ID
meta_network_name LowCardinality(String) Ethereum network name
meta_consensus_version LowCardinality(String) Ethereum consensus client version that generated the event
meta_consensus_version_major LowCardinality(String) Ethereum consensus client major version that generated the event
meta_consensus_version_minor LowCardinality(String) Ethereum consensus client minor version that generated the event
meta_consensus_version_patch LowCardinality(String) Ethereum consensus client patch version that generated the event
meta_consensus_implementation LowCardinality(String) Ethereum consensus client implementation that generated the event
meta_labels Map(String, String) Labels associated with the event

beacon_api_eth_v1_proposer_duty

Contains a proposer duty from a beacon block.

Availability

Data is partitioned daily on slot_start_date_time for the following networks:

  • mainnet: 2024-04-03 to 2024-12-18
  • holesky: 2024-04-03 to 2024-12-18
  • sepolia: 2024-04-03 to 2024-12-18

Examples

Parquet file

https://data.ethpandaops.io/xatu/NETWORK/databases/default/beacon_api_eth_v1_proposer_duty/YYYY/MM/DD.parquet

docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
    SELECT
        *
    FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_proposer_duty/2024/12/13.parquet', 'Parquet')
    LIMIT 10
    FORMAT Pretty
"""
Your Clickhouse

Note: FINAL should be used when querying this table

docker run --rm -it --net host clickhouse/clickhouse-server clickhouse client --query="""
    SELECT
        *
    FROM default.beacon_api_eth_v1_proposer_duty FINAL
    WHERE
        slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 10
    FORMAT Pretty
"""
EthPandaOps Clickhouse

Note: FINAL should be used when querying this table

echo """
    SELECT
        *
    FROM default.beacon_api_eth_v1_proposer_duty FINAL
    WHERE
        slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 3
    FORMAT Pretty
""" | curl "https://clickhouse.xatu.ethpandaops.io" -u "$CLICKHOUSE_USER:$CLICKHOUSE_PASSWORD" --data-binary @-

Columns

Name Type Description
updated_date_time DateTime When this row was last updated
event_date_time DateTime64(3) When the client fetched the beacon block from a beacon node
slot UInt32 The slot number from beacon block payload
slot_start_date_time DateTime The wall clock time when the slot started
epoch UInt32 The epoch number from beacon block payload
epoch_start_date_time DateTime The wall clock time when the epoch started
proposer_validator_index UInt32 The validator index from the proposer duty payload
proposer_pubkey String The BLS public key of the validator from the proposer duty payload
meta_client_name LowCardinality(String) Name of the client that generated the event
meta_client_id String Unique Session ID of the client that generated the event. This changes every time the client is restarted.
meta_client_version LowCardinality(String) Version of the client that generated the event
meta_client_implementation LowCardinality(String) Implementation of the client that generated the event
meta_client_os LowCardinality(String) Operating system of the client that generated the event
meta_client_ip Nullable(IPv6) IP address of the client that generated the event
meta_client_geo_city LowCardinality(String) City of the client that generated the event
meta_client_geo_country LowCardinality(String) Country of the client that generated the event
meta_client_geo_country_code LowCardinality(String) Country code of the client that generated the event
meta_client_geo_continent_code LowCardinality(String) Continent code of the client that generated the event
meta_client_geo_longitude Nullable(Float64) Longitude of the client that generated the event
meta_client_geo_latitude Nullable(Float64) Latitude of the client that generated the event
meta_client_geo_autonomous_system_number Nullable(UInt32) Autonomous system number of the client that generated the event
meta_client_geo_autonomous_system_organization Nullable(String) Autonomous system organization of the client that generated the event
meta_network_id Int32 Ethereum network ID
meta_network_name LowCardinality(String) Ethereum network name
meta_consensus_version LowCardinality(String) Ethereum consensus client version that generated the event
meta_consensus_version_major LowCardinality(String) Ethereum consensus client major version that generated the event
meta_consensus_version_minor LowCardinality(String) Ethereum consensus client minor version that generated the event
meta_consensus_version_patch LowCardinality(String) Ethereum consensus client patch version that generated the event
meta_consensus_implementation LowCardinality(String) Ethereum consensus client implementation that generated the event
meta_labels Map(String, String) Labels associated with the event

beacon_api_eth_v3_validator_block

Contains beacon API /eth/v3/validator/blocks/{slot} data from each sentry client attached to a beacon node.

Availability

Data is partitioned daily on slot_start_date_time for the following networks:

  • mainnet: 2024-11-25 to 2024-12-18
  • holesky: 2024-11-25 to 2024-12-18
  • sepolia: 2024-11-25 to 2024-12-18

Examples

Parquet file

https://data.ethpandaops.io/xatu/NETWORK/databases/default/beacon_api_eth_v3_validator_block/YYYY/MM/DD.parquet

docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
    SELECT
        *
    FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v3_validator_block/2024/12/13.parquet', 'Parquet')
    LIMIT 10
    FORMAT Pretty
"""
Your Clickhouse

Note: FINAL should be used when querying this table

docker run --rm -it --net host clickhouse/clickhouse-server clickhouse client --query="""
    SELECT
        *
    FROM default.beacon_api_eth_v3_validator_block FINAL
    WHERE
        slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 10
    FORMAT Pretty
"""
EthPandaOps Clickhouse

Note: FINAL should be used when querying this table

echo """
    SELECT
        *
    FROM default.beacon_api_eth_v3_validator_block FINAL
    WHERE
        slot_start_date_time >= NOW() - INTERVAL '1 HOUR'
    LIMIT 3
    FORMAT Pretty
""" | curl "https://clickhouse.xatu.ethpandaops.io" -u "$CLICKHOUSE_USER:$CLICKHOUSE_PASSWORD" --data-binary @-

Columns

Name Type Description
updated_date_time DateTime Timestamp when the record was last updated
event_date_time DateTime64(3) When the sentry received the event from a beacon node
slot UInt32 Slot number within the payload
slot_start_date_time DateTime The wall clock time when the reorg slot started
epoch UInt32 The epoch number in the beacon API event stream payload
epoch_start_date_time DateTime The wall clock time when the epoch started
block_version LowCardinality(String) The version of the beacon block
block_total_bytes Nullable(UInt32) The total bytes of the beacon block payload
block_total_bytes_compressed Nullable(UInt32) The total bytes of the beacon block payload when compressed using snappy
consensus_payload_value Nullable(UInt64) Consensus rewards paid to the proposer for this block, in Wei. Use to determine relative value of consensus blocks.
execution_payload_value Nullable(UInt64) Execution payload value in Wei. Use to determine relative value of execution payload.
execution_payload_block_number UInt32 The block number of the execution payload
execution_payload_base_fee_per_gas Nullable(UInt128) Base fee per gas for execution payload
execution_payload_blob_gas_used Nullable(UInt64) Gas used for blobs in execution payload
execution_payload_excess_blob_gas Nullable(UInt64) Excess gas used for blobs in execution payload
execution_payload_gas_limit Nullable(UInt64) Gas limit for execution payload
execution_payload_gas_used Nullable(UInt64) Gas used for execution payload
execution_payload_transactions_count Nullable(UInt32) The transaction count of the execution payload
execution_payload_transactions_total_bytes Nullable(UInt32) The transaction total bytes of the execution payload
execution_payload_transactions_total_bytes_compressed Nullable(UInt32) The transaction total bytes of the execution payload when compressed using snappy
meta_client_name LowCardinality(String) Name of the client that generated the event
meta_client_id String Unique Session ID of the client that generated the event. This changes every time the client is restarted.
meta_client_version LowCardinality(String) Version of the client that generated the event
meta_client_implementation LowCardinality(String) Implementation of the client that generated the event
meta_client_os LowCardinality(String) Operating system of the client that generated the event
meta_client_ip Nullable(IPv6) IP address of the client that generated the event
meta_client_geo_city LowCardinality(String) City of the client that generated the event
meta_client_geo_country LowCardinality(String) Country of the client that generated the event
meta_client_geo_country_code LowCardinality(String) Country code of the client that generated the event
meta_client_geo_continent_code LowCardinality(String) Continent code of the client that generated the event
meta_client_geo_longitude Nullable(Float64) Longitude of the client that generated the event
meta_client_geo_latitude Nullable(Float64) Latitude of the client that generated the event
meta_client_geo_autonomous_system_number Nullable(UInt32) Autonomous system number of the client that generated the event
meta_client_geo_autonomous_system_organization Nullable(String) Autonomous system organization of the client that generated the event
meta_network_id Int32 Ethereum network ID
meta_network_name LowCardinality(String) Ethereum network name
meta_consensus_version LowCardinality(String) Ethereum consensus client version that generated the event
meta_consensus_version_major LowCardinality(String) Ethereum consensus client major version that generated the event
meta_consensus_version_minor LowCardinality(String) Ethereum consensus client minor version that generated the event
meta_consensus_version_patch LowCardinality(String) Ethereum consensus client patch version that generated the event
meta_consensus_implementation LowCardinality(String) Ethereum consensus client implementation that generated the event
meta_labels Map(String, String) Labels associated with the event