This repository is my home Kubernetes cluster in a declarative state. Flux watches the kubernetes folder and will make the changes to the cluster based on the YAML manifests.
Core components that form the foundation of the cluster:
- backube/volsync and backube/snapscheduler: Backup and recovery of persistent volume claims.
- cilium/cilium: Kubernetes CNI.
- envoyproxy/envoy: Kubernetes-based application gateway using Kubernetes Gateway API.
- external-secrets/external-secrets: Managed Kubernetes secrets using 1Password Connect.
- jetstack/cert-manager: Creates SSL certificates for services in my Kubernetes cluster.
- kubernetes-sigs/external-dns: Automatically manages DNS records from my cluster in CloudFlare.
- rancher/system-upgrade-controller: Handles Kubernetes and Talos upgrades automatically.
- rook/rook: Distributed block storage for persistent storage.
- siderolabs/talos: The Kubernetes Operating System.
For observability and monitoring of the cluster the following software is used:
- fluent/fluent-bit: Log processor.
- grafana/grafana: Data visualization platform.
- prometheus/alertmanager: Handles processing and sending alerts.
- pushover: Handles receiving alerts on my devices.
- TwiN/gatus: High level status dashboard.
- VictoriaMetrics/VictoriaLogs: Database for logs.
- VictoriaMetrics/VictoriaMetrics: Time series database, drop-in replacement for Prometheus.
- Github Actions for checking code formatting and running periodic jobs
- Renovate keeps the application charts and container images up-to-date
- 1Password for managing secrets via external-secrets.
- AWS SES for sending emails.
- Cloudflare tunnels for exposing services & creating certificates & managing domains.
- Cloudflare R2 for daily backups.
- Pushover for sending alerts.
Total cloud costs yearly is approximately ~$150/year.
This Git repository contains the following directories.
📁 bootstrap # Flux installation to bootstrap cluster
📁 docs # Docs
📁 hacks # Contains random scripts
📁 kubernetes # Kubernetes cluster defined as code
├─📁 flux # Main Flux configuration of repository
├─📁 components # Flux components
└─📁 apps # Apps deployed into my cluster grouped by namespace
📁 talos # Contains the configuration for Talos operating system
📁 terraform # Contains Cloudflare terraform
Checkout my rack
| Device | Count | OS Disk Size | Data Disk Size | Ram | Operating System | Purpose |
|---|---|---|---|---|---|---|
| UDM-Pro-Max | 1 | - | - | - | UniFi | Router |
| USW-Pro-Aggregation | 1 | - | - | - | UniFi | Switch |
| USW-Pro-Max-24-PoE | 1 | - | - | - | UniFi | Switch |
| UAP-AC-Lite | 1 | - | - | - | UniFi | WiFi AP |
| ER-10X | 1 | - | - | - | EdgeOS | Switch |
| PiKVM V4 Mini | 1 | - | - | - | PiKVM | KVM |
| TESmart HDMI KVM Switch 8 Ports | 1 | - | - | - | - | KVM Switch |
| CyberPower CP1500PFCRM2U | 1 | - | - | - | UPS | |
| USP-PDU-Pro | 1 | - | - | - | UniFi | PDU |
| Synology DS920+ | 1 | - | 2x8TB & 2x16TB | 20GB | DSM | NAS |
| MS-01 i9-13900H | 3 | 1TB | 2TB | 96GB | Talos | Control Plane |
Thanks to all the people who donate their time to the Kubernetes @Home community.
This repository was built off the onedr0p/template-cluster-k3s repository.
See LICENSE