28 points SweetSoftPillow 1 hour ago 16 comments

floornext 58 minutes ago | parent

Talos is nice but debugging a failed kubelet without shell access is rough, spent way too long on serial console logs once

b3n4kh 48 minutes ago | parent

Switched to Talos from one k3s on Debian and Ubuntu, haven’t looked back even once.

sgt 45 minutes ago | parent

Is it recommended to run Talos inside a VM or on bare metal or maybe it doesn't matter?

gwynforthewyn 42 minutes ago | parent

I’ve run it both ways, with virtualbox and vmware as a hypervisor, and with micro PCs as hardware.

rdwrrr 40 minutes ago | parent

That doesn't really matter. I don't really know anyone who still runs anything on bare metal.

sgt 20 minutes ago | parent

I do, still. It's often a lot cheaper and modern HW is very robust and reliable. But it comes with more responsibility, of course. Not happy with performance on typical cheap VMs.

dada216 16 minutes ago | parent

I do :) alongside cloud of course, hybrid is the way to go in my view.

I run a bunch of openshift clusters for very private container workloads and VMs.

You can't beat a local fiber channel SAN for speed and reliability, especially compared to cloud software defined storage, and even on the networking side of things if you worked out your local connectivity well using real networking vs cloud providers software defined networks is so much better.

CSIs are hit and miss, some vendors are really really good, some are meh (hitachi, even though they are improving a lot with the latest relases), but the moment you get an IBM nvme san and start to tune all layers you get performance that are out of this world, some of our dbms workloads are very io sensitive and they improved 10x with nvme fabric.

globular-toast 5 minutes ago | parent

With Kubernetes it makes a lot of sense to run bare metal. What advantage is there to running K8s nodes on a hypervisor? It's one more thing that requires maintenance and can go wrong.

SweetSoftPillow 12 minutes ago | parent

I run it on bare metal, but both are viable.

gwynforthewyn 44 minutes ago | parent

My team ran on-premise with Talos for the last bunch of years. It avoided tons of odd issues I saw when I built k8s clusters on top of Ubuntu that I never quite ironed out.

It gave me a ton of appreciation for Kubernetes and Linux and how k8s is built on linux assumptions: the file system layout’s a little different in Talos to the default k8s assumptions, so there were some small adjustments I’d make every now and then.

Sidero’s professional support is out of the world, too. I had simple questions and got answers back from their devops engineers who are running clusters 100-1000 times the size of anything I had to touch, or from their software engineering team who write Talos.

Definitely worth a look if you’re hosting in your home lab, definitely worth a look if you’re doing self-hosted k8s for your job.

tobi_bsf 43 minutes ago | parent

Talos is awesome.

myururdurmaz 41 minutes ago | parent

Popupssss

abousselmi 37 minutes ago | parent

Nice to see an real apllication of unikernels. It looks promising!

IkerGalardi 10 minutes ago | parent

Talos does not seem to be a unikernel. Just a distro with enough to run kubernetes and a management API.

mschuster91 16 minutes ago | parent

You'd think someone with a "talk to us" enterprise plan and a bunch of well known brands as customers would have at least one human copytexter and a designer on staff. Instead, a landing page reeking of Claudish in text and look.

Jesus.