Manage | Install | Deployment architecture guidance#

Hardware requirements for EclecticIQ Intelligence Center can vary, depending on the target system and the environment.

The requirements outlined in this section are guidelines for different deployment configurations:

Test – Small#

1 host

Note

Not recommended for production deployments.

Configuration:

test-small

Entity count:

5 million

Number of hosts:

1

Disk IOPS per host:

3000 IOPS minimum, 10000 IOPS recommended

Host 1

  • CPU Cores: 8

  • RAM: 64 GB

  • Acts as:

    • Application node (ic-application-01)

    • Worker node (ic-celery-01)

    • Worker node (ic-ingestion-01)

    • Elasticsearch node (elastic-node-01)

    • PostgreSQL node (pg-node-01)

    • Redis node (redis-node-01)

Partition sizes

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

200

300

Total

250

400

Diagrammatic overview of the test small deployment

Test – Medium#

4 hosts

Note

Not recommended for production deployments.

Configuration:

test-medium

Entity count:

25 million

Number of hosts:

4

Disk IOPS per host:

3000 IOPS minimum, 10000 IOPS recommended

Host 1

  • CPU Cores: 4

  • RAM: 96 GB

  • Acts as:

    • Application node (ic-application-01)

    • Worker node (ic-celery-01)

    • Worker node (ic-ingestion-01)

    • PostgreSQL node (pg-node-01)

    • Redis node (redis-node-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

350

400

Total

400

500

Host 2

  • CPU Cores: 4

  • RAM: 32 GB

  • Acts as:

    • Elasticsearch primary node (elastic-node-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

150

200

Total

200

300

Host 3

  • CPU Cores: 4

  • RAM: 32 GB

  • Acts as:

    • Elasticsearch node (elastic-node-02)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

150

200

Total

200

300

Host 4

  • CPU Cores: 4

  • RAM: 32 GB

  • Acts as:

    • Elasticsearch node (elastic-node-03)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

150

200

Total

200

300

Diagrammatic overview of the test medium deployment

Production – Small#

3 hosts
Configuration:

prod-small

Entity count:

50-100 million

Number of nodes:

3

Disk IOPS per node:

10,000 IOPS minimum (for 50 million Entities), 20,000 IOPS recommended (for 100 million Entities)

node 1

  • CPU Cores: 16

  • RAM: 128 GB

  • Acts as:

    • Application node (ic-application)

    • Elasticsearch node (elastic-node-01)

    • PostgreSQL node (pg-node-01)

    • Redis node (redis-node-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

80

150

/swap

64

128

/var/log

20

50

/media

1000

2000

Total

1164

2328

node 2

  • CPU Cores: 16

  • RAM: 128 GB

  • Acts as:

    • Worker node (ic-celery)

    • Elasticsearch node (elastic-node-02)

    • PostgreSQL node (pg-node-02)

    • Redis node (redis-node-02)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

80

150

/swap

64

128

/var/log

20

50

/media

1000

2000

Total

1164

2328

node 3

  • CPU Cores: 16

  • RAM: 128 GB

  • Acts as:

    • Worker node (ic-ingestion)

    • Elasticsearch node (elastic-node-03)

    • PostgreSQL node (pg-node-03)

    • Redis node (redis-node-03)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

80

150

/swap

64

128

/var/log

20

50

/media

1000

2000

Total

1164

2328

Diagrammatic overview of the production small deployment

Production – Medium#

6 hosts
Configuration:

prod-medium

Entity count:

60 million

Number of hosts:

6

Disk IOPS per host:

3000 IOPS minimum, 10000 IOPS recommended

Host 1

  • CPU Cores: 4

  • RAM: 64 GB

  • Acts as:

    • Application node (ic-application-01)

    • Worker node (ic-celery-01)

    • Worker node (ic-ingestion-01)

    • Redis node (redis-node-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

150

200

Total

200

300

Host 2

  • CPU Cores: 4

  • RAM: 32 GB

  • Acts as:

    • Elasticsearch primary node (elastic-node-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

150

200

Total

200

300

Host 3

  • CPU Cores: 4

  • RAM: 32 GB

  • Acts as:

    • Elasticsearch node (elastic-node-02)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

150

200

Total

200

300

Host 4

  • CPU Cores: 4

  • RAM: 32 GB

  • Acts as:

    • Elasticsearch node (elastic-node-03)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

150

200

Total

200

300

Host 5

  • CPU Cores: 4

  • RAM: 64 GB

  • Acts as:

    • PostgreSQL primary node (pg-node-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

450

700

Total

500

800

Host 6

  • CPU Cores: 4

  • RAM: 64 GB

  • Acts as:

    • PostgreSQL replica node (pg-node-02)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

450

700

Total

500

800

Diagrammatic overview of the production medium deployment

Production – Large#

10 hosts
Configuration:

prod-large

Entity count:

100 million

Number of hosts:

10

Disk IOPS per host:

3000 IOPS minimum, 10000 IOPS recommended

Host 1

  • CPU Cores: 4

  • RAM: 32 GB

  • Acts as:

    • Application node (ic-application-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

90

90

/var/log

10

10

Total

100

100

Host 2

  • CPU Cores: 8

  • RAM: 32 GB

  • Acts as:

    • Worker node (ic-ingestion-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

90

90

/var/log

10

10

Total

100

100

Host 3

  • CPU Cores: 4

  • RAM: 32 GB

  • Acts as:

    • Worker node (ic-celery-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

90

90

/var/log

10

10

Total

100

100

Host 4

  • CPU Cores: 2

  • RAM: 32 GB

  • Acts as:

    • Redis primary node (ic-redis-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

40

/var/log

10

10

/media/redis

50

50

Total

100

100

Host 5

  • CPU Cores: 2

  • RAM: 32 GB

  • Acts as:

    • Redis secondary node (ic-redis-02)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

40

/var/log

10

10

/media/redis

50

50

Total

100

100

Host 6

  • CPU Cores: 4

  • RAM: 48 GB

  • Acts as:

    • Elasticsearch primary node (elastic-node-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

350

700

Total

400

800

Host 7

  • CPU Cores: 4

  • RAM: 48 GB

  • Acts as:

    • Elasticsearch node (elastic-node-02)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

350

700

Total

400

800

Host 8

  • CPU Cores: 4

  • RAM: 48 GB

  • Acts as:

    • Elasticsearch node (elastic-node-03)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

350

700

Total

400

800

Host 9

  • CPU Cores: 4

  • RAM: 64 GB

  • Acts as:

    • PostgreSQL primary node (pg-node-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

450

900

Total

500

1000

Host 10

  • CPU Cores: 4

  • RAM: 64 GB

  • Acts as:

    • PostgreSQL replica node (pg-node-02)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

450

900

Total

500

1000

Diagrammatic overview of the production large deployment

Production – AI Nodes#

You can add specific nodes that provide AI functionalities to your deployment. These nodes have to follow the requirements listed below.

You can add a singular AI node, but adding multiple is required if you want to implement hot fail-over of AI features.

Requirements per node

Disk IOPS (per node):

1,000 IOPS minimum

CPU Cores:

8

RAM:

64 GB

GPU:

NVidia

Mount point

Min. Size (GB)

/

180

/var/log

20

Total

200