Overview GitHub Actions provides powerful CI/CD automation, but running workflows on GitHub-hosted runners can be costly. By using self-hosted runners, users can control their infrastructure, optimize spending, and improve security. For Kubernetes users, GitHub offers a convenient way to manage self-hosted runners via the Actions Runner Controller (ARC). This allows automatic scaling of runners based on workload demand using Helm and Terraform. In this guide, we’ll walk through setting up self-hosted GitHub Actions runners on Kubernetes using Terraform and Helm. ...
Overview AWS recently introduced EKS Auto mode which seems to be a game changer. It exptends the responsibility of AWS from managing control plane components to managing the data plane - nodes. With EKS auto mode EKS users can shift their focus more towards application development, rather than managing individual nodes. Prerequisites Make sure to have terraform installed as the processes described in this guide are based on terraform Terraform (latest version) AWS CLI (configured with credentials for your AWS account) kubectl (for interacting with the EKS cluster) Creating cluster in EKS auto mode Using the EKS terraform module to create a cluster with EKS auto mode is as easy as it sounds. ...
Overview GPU slicing (time-slicing) enables efficient GPU resource sharing on Amazon EKS clusters, particularly for AI workloads. By dividing GPU access into smaller time intervals, multiple tasks or processes can share GPU resources, leading to cost optimization and improved utilization. Amazon EKS supports GPU slicing through NVIDIA’s Kubernetes device plugin, which exposes GPU resources to Kubernetes, allowing the scheduler to manage GPU allocation dynamically. Here’s how to enable GPU slicing on EKS clusters. ...
Overview This repository contains Terraform code to deploy an EKS cluster on AWS, utilizing Karpenter for efficient node autoscaling. The cluster supports both x86 (amd64) and Graviton (arm64) architectures. Additionally, the configuration leverages Spot Instances for cost efficiency and includes a demonstration deployment for users to test the setup. Prerequisites Before using this Terraform repository, ensure you have the following installed: Terraform (latest version) AWS CLI (configured with credentials for your AWS account) kubectl (for interacting with the EKS cluster) It needs to be made sure that service-linked role is created for creation of spot instances. It can be created with command. ...