Multi-Tier Cluster

The Multi-Tier Cluster (x-large) deployment is suitable for high ingest rates, while also supporting longer retention periods.

Sizing Parameter
Value

Licensed Units

up to 16

Recommended Max. Ingest Rate

48000 flows/sec

Retention at Max. Rate

30 days

Shards

6

Replicas

1

This multi-tier architecture provides hot data nodes for high-performance ingest, as well as warm nodes for increased storage capacity at a lower cost. Additional warm nodes can be added for even greater retention periods.

Application
CPU Cores
Memory
Storage

Kibana, Elasticsearch (coordinating)

8

32 GB

128 GB

Application
CPU Cores
Memory
Storage

Elasticsearch (master)

4

32 GB

128 GB

Elasticsearch (master)

4

32 GB

128 GB

Elasticsearch (master)

4

32 GB

128 GB

Application
CPU Cores
Memory
SSD Storage

Elasticsearch (hot data)

12-16

64 GB

2 x 4 TB (6.8 TB)

Elasticsearch (hot data)

12-16

64 GB

2 x 4 TB (6.8 TB)

Elasticsearch (hot data)

12-16

64 GB

2 x 4 TB (6.8 TB)

Elasticsearch (hot data)

12-16

64 GB

2 x 4 TB (6.8 TB)

Elasticsearch (hot data)

12-16

64 GB

2 x 4 TB (6.8 TB)

Elasticsearch (hot data)

12-16

64 GB

2 x 4 TB (6.8 TB)

Application
CPU Cores
Memory
HDD Storage

Elasticsearch (warm data)

8-16

64 GB

4 x 4 TB (13.6 TB)

Elasticsearch (warm data)

8-16

64 GB

4 x 4 TB (13.6 TB)

Elasticsearch (warm data)

8-16

64 GB

4 x 4 TB (13.6 TB)

Elasticsearch (warm data)

8-16

64 GB

4 x 4 TB (13.6 TB)

Elasticsearch (warm data)

8-16

64 GB

4 x 4 TB (13.6 TB)

Elasticsearch (warm data)

8-16

64 GB

4 x 4 TB (13.6 TB)

Application
CPU Cores
Memory
Storage

Flow Collector, Elasticsearch (coordinating)

16

32 GB

128 GB

Docker Compose Configurations

Kibana

Coordinating Node for Kibana

Elasticsearch Master Node 1

Elasticsearch Master Node 2

Elasticsearch Master Node 3

Elasticsearch Hot Data Node 1

Elasticsearch Hot Data Node 2

Elasticsearch Hot Data Node 3

Elasticsearch Hot Data Node 4

Elasticsearch Hot Data Node 5

Elasticsearch Hot Data Node 6

Elasticsearch Warm Data Node 1

Elasticsearch Warm Data Node 2

Elasticsearch Warm Data Node 3

Elasticsearch Warm Data Node 4

Elasticsearch Warm Data Node 5

Elasticsearch Warm Data Node 6

Coordinating Node for the ElastiFlow Collectors