Cluster Requirements

Subsalt provides Terraform templates for each of the major Kubernetes cloud providers to make it easy to set up compatible clusters. The Terraform templates are accessible through Subsalt's CLI tool.

Cluster resource requirements

• Subsalt runs on Kubernetes v1.24+, and can be deployed in multiple configurations depending on your needs. Multiple components can be deployed in a single cluster, or across multiple clusters.

• Subsalt must have cluster-level permission to add operators at installation time.

• Below are tables that note the minimum requirements for node pools configured in each cloud environment.

Microsoft Azure AKS

Name	Node count	Recommended instance type	Taints	Labels
common	2 (configurable)	Standard_E16s_v3		subsalt.io/node-purpose=common
serving	1 (configurable)	Standard_NV12ads_A10_v5	nvidia.com/gpu=present:NoSchedule	subsalt.io/node-purpose=serving, subsalt.io/has-gpu=true
pipelines_cpu	0 - 8 (auto-scaling)	Standard_E16s_v3	subsalt.io/node-purpose=pipelines:NoSchedule	subsalt.io/node-purpose=pipelines, subsalt.io/has-gpu=false
pipelines_gpu	0 - 6 (auto-scaling)	Standard_NC40ads_H100_v5	nvidia.com/gpu=present:NoSchedule	subsalt.io/node-purpose=pipelines, subsalt.io/has-gpu=true

Amazon Web Services (AWS) EKS

Name	Node count	Recommended instance type	Taints	Labels
common	2 (configurable)	r6a.4xlarge		subsalt.io/node-purpose=common
serving	1 (configurable)	g5.2xlarge	nvidia.com/gpu=present:NoSchedule	subsalt.io/node-purpose=serving, subsalt.io/has-gpu=true
pipelines_cpu	0 - 8 (auto-scaling)	r6a.4xlarge	subsalt.io/node-purpose=pipelines:NoSchedule	subsalt.io/node-purpose=pipelines, subsalt.io/has-gpu=false
pipelines_gpu	0 - 6 (auto-scaling)	g5.4xlarge	nvidia.com/gpu=present:NoSchedule	subsalt.io/node-purpose=pipelines, subsalt.io/has-gpu=true

Assuming you're using EC2 autoscaling groups for cluster autoscaling the following tags will also need to be set (assumes recommended instance types):

Serving node pool

Key	Value
k8s.io/cluster-autoscaler/node-template/resources/cpu	8
k8s.io/cluster-autoscaler/node-template/resources/memory	32G
k8s.io/cluster-autoscaler/node-template/resources/nvidia.com/gpu	1
k8s.io/cluster-autoscaler/node-template/taint/nvidia.com/gpu	present:NoSchedule
k8s.io/cluster-autoscaler/node-template/label/subsalt.io/has-gpu	true

Pipelines (CPU) node pool

Key	Value
k8s.io/cluster-autoscaler/node-template/resources/cpu	16
k8s.io/cluster-autoscaler/node-template/resources/memory	128G
k8s.io/cluster-autoscaler/node-template/taint/subsalt.io/node-purpose	pipelines:NoSchedule
k8s.io/cluster-autoscaler/node-template/label/subsalt.io/node-purpose	pipelines
k8s.io/cluster-autoscaler/node-template/label/subsalt.io/has-gpu	false

Pipelines (GPU) node pool

Key	Value
k8s.io/cluster-autoscaler/node-template/resources/cpu	16
k8s.io/cluster-autoscaler/node-template/resources/memory	64G
k8s.io/cluster-autoscaler/node-template/resources/nvidia.com/gpu	1
k8s.io/cluster-autoscaler/node-template/taint/nvidia.com/gpu	present:NoSchedule
k8s.io/cluster-autoscaler/node-template/label/subsalt.io/node-purpose	pipelines
k8s.io/cluster-autoscaler/node-template/label/subsalt.io/has-gpu	true

Other

If your team uses another Kubernetes provider (IBM, DigitalOcean, etc), please reach out and we can find a way to support your deployment.