Deployment architecture guidance#

Hardware requirements for EclecticIQ Intelligence Center can vary, depending on the target system and the environment.

The requirements outlined in this section are guidelines for different deployment configurations:

Test Small configuration (1 host)#

Note

Not recommended for production deployments.

Configuration:

test-small

Entity count:

5 million

Number of hosts:

1

Disk IOPs per host:

3000 IOPs minimum, 10000 IOPs recommended

Host 1

  • CPU Cores: 8

  • RAM: 64 GB

  • Acts as:

    • Application node (ic-application-01)

    • Worker node (ic-celery-01)

    • Worker node (ic-ingestion-01)

    • Elasticsearch node (elastic-node-01)

    • PostgreSQL node (pg-node-01)

    • Redis node (redis-node-01)

Partition sizes

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

200

300

Total

250

400

Test Medium configuration (4 hosts)#

Note

Not recommended for production deployments.

Configuration:

test-medium

Entity count:

25 million

Number of hosts:

4

Disk IOPs per host:

3000 IOPs minimum, 10000 IOPs recommended

Host 1

  • CPU Cores: 4

  • RAM: 96 GB

  • Acts as:

    • Application node (ic-application-01)

    • Worker node (ic-celery-01)

    • Worker node (ic-ingestion-01)

    • PostgreSQL node (pg-node-01)

    • Redis node (redis-node-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

350

400

Total

400

500

Host 2

  • CPU Cores: 4

  • RAM: 32 GB

  • Acts as:

    • Elasticsearch primary node (elastic-node-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

150

200

Total

200

300

Host 3

  • CPU Cores: 4

  • RAM: 32 GB

  • Acts as:

    • Elasticsearch node (elastic-node-02)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

150

200

Total

200

300

Host 4

  • CPU Cores: 4

  • RAM: 32 GB

  • Acts as:

    • Elasticsearch node (elastic-node-03)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

150

200

Total

200

300

Production Medium configuration (6 hosts)#

Configuration:

prod-medium

Entity count:

60 million

Number of hosts:

6

Disk IOPs per host:

3000 IOPs minimum, 10000 IOPs recommended

Host 1

  • CPU Cores: 4

  • RAM: 64 GB

  • Acts as:

    • Application node (ic-application-01)

    • Worker node (ic-celery-01)

    • Worker node (ic-ingestion-01)

    • Redis node (redis-node-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

150

200

Total

200

300

Host 2

  • CPU Cores: 4

  • RAM: 32 GB

  • Acts as:

    • Elasticsearch primary node (elastic-node-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

150

200

Total

200

300

Host 3

  • CPU Cores: 4

  • RAM: 32 GB

  • Acts as:

    • Elasticsearch node (elastic-node-02)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

150

200

Total

200

300

Host 4

  • CPU Cores: 4

  • RAM: 32 GB

  • Acts as:

    • Elasticsearch node (elastic-node-03)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

150

200

Total

200

300

Host 5

  • CPU Cores: 4

  • RAM: 64 GB

  • Acts as:

    • PostgreSQL primary node (pg-node-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

450

700

Total

500

800

Host 6

  • CPU Cores: 4

  • RAM: 64 GB

  • Acts as:

    • PostgreSQL replica node (pg-node-02)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

450

700

Total

500

800

Production Large configuration (10 hosts)#

Configuration:

prod-large

Entity count:

100 million

Number of hosts:

10

Disk IOPs per host:

3000 IOPs minimum, 10000 IOPs recommended

Host 1

  • CPU Cores: 4

  • RAM: 32 GB

  • Acts as:

    • Application node (ic-application-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

90

90

/var/log

10

10

Total

100

100

Host 2

  • CPU Cores: 8

  • RAM: 32 GB

  • Acts as:

    • Worker node (ic-ingestion-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

90

90

/var/log

10

10

Total

100

100

Host 3

  • CPU Cores: 4

  • RAM: 32 GB

  • Acts as:

    • Worker node (ic-celery-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

90

90

/var/log

10

10

Total

100

100

Host 4

  • CPU Cores: 2

  • RAM: 32 GB

  • Acts as:

    • Redis primary node (ic-redis-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

40

/var/log

10

10

/media/redis

50

50

Total

100

100

Host 5

  • CPU Cores: 2

  • RAM: 32 GB

  • Acts as:

    • Redis secondary node (ic-redis-02)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

40

/var/log

10

10

/media/redis

50

50

Total

100

100

Host 6

  • CPU Cores: 4

  • RAM: 48 GB

  • Acts as:

    • Elasticsearch primary node (elastic-node-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

350

700

Total

400

800

Host 7

  • CPU Cores: 4

  • RAM: 48 GB

  • Acts as:

    • Elasticsearch node (elastic-node-02)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

350

700

Total

400

800

Host 8

  • CPU Cores: 4

  • RAM: 48 GB

  • Acts as:

    • Elasticsearch node (elastic-node-03)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

350

700

Total

400

800

Host 9

  • CPU Cores: 4

  • RAM: 64 GB

  • Acts as:

    • PostgreSQL primary node (pg-node-01)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

450

900

Total

500

1000

Host 10

  • CPU Cores: 4

  • RAM: 64 GB

  • Acts as:

    • PostgreSQL replica node (pg-node-02)

Mount point

Min. Size (GB)

Recc. Size (GB)

/

40

80

/var/log

10

20

/media

450

900

Total

500

1000