Rendered at 12:27:55 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
HerbManic 6 hours ago [-]
I'm not surprised at the outcome. These Ampere system single core/thread performance is pretty low and that is where you feel it. The OS/software simply cannot allocate the threads across enough cores effectively to make up for this difference.
This is why things like the Apple M Series feels so fast, because while they don't win the multi core performance especially when going up against a 80 core beast like this, they have single thread performance exactly were it is needed.
Maybe we will need 80 cores in future, that is cool but for daily home use it is still just way too much for what we need.
akoboldfrying 2 hours ago [-]
Apple M series is also aarch64 architecture, isn't it? Could you explain more why you expect Ampere to be slow but M series to be fast?
rwmj 2 hours ago [-]
Apple design their own Arm-compatible cores from scratch. Ampere use a modified Arm Neoverse N1 core. In addition, the Ampere server that Marcin is using is about 6 years old, and would have been tuned for core count over single thread performance (good for web serving). Basically Arm's own cores aren't nearly as good as Apple's at the best of times, and having a 6 year old server makes things even worse.
dzaima 2 hours ago [-]
Ampere Altra is for cloud/datacenters/servers where multithreaded throughput is approximately all that matters. Apple M series is for consumers.
jdub 2 hours ago [-]
Because they're designed for different things.
Ampere's primary focus is running lots of simple tasks concurrently, at relatively low power, with lots of I/O. So, many tens to hundreds of cores, not too fast, at lower power draw than amd64, with lots of PCIe lanes for storage and network.
Apple's primary focus is user experience and power efficiency. That's why you'll find a handful of fast performance cores and low power efficiency cores, along with graphics acceleration to drive high resolution displays.
dn3500 3 hours ago [-]
I don't understand the kernel problem. Why did he feel he had to rebuild the kernel weekly? When the amdgpu stopped working why couldn't he just go back to the last working kernel?
M95D 2 hours ago [-]
He said he needed patches to make the GPUs work. Kernel package auto-updated does not have those patches and overwrites the custom kernel he built every time there was an update available.
trentor 2 hours ago [-]
You can disable automatic kernel updates on almost every distribution. Most people that use secure boot and Nvidia do it.
M95D 1 hours ago [-]
I wouldn't know. I run Gentoo. :)
2 hours ago [-]
nevi-me 2 hours ago [-]
I presumed that as a kernel developer, he would run the kernel he runs, which would require rebuilding periodically. Daily doesn't make sense, monthly is too infrequent given the rate of change in the kernel.
My speculation though. When I was building an app I was using, I used to run a recent stable build on my device instead of just the one released in the Play Store. Simplifies having to keep multiple devices.
edg5000 3 hours ago [-]
> there was no org.freedesktop.Platform.GL.nvidia in Flatpak repositories for AArch64
All he had to do was build some packages from source, right? It's really worth learning how to do this, since it removes a lot of constraints.
And the kernel patch should land in the kernel pretty soon, I hope? He won't have to run a patched kernel forever. Should be possible to get that in a release in a year or so?
jsnell 2 hours ago [-]
I don't know if it's your intent, but that reads really condescending. It's obvious the author knows how to build packages from source. They're working professionally for a Linux distro on arch support!
But that was several layers deep into yak shaving broken graphics, and at some point you need to actually get your real work done.
10000truths 2 hours ago [-]
I'm not sure why the author didn't attempt to dive deeper into the error message he saw. amd_vcn_dec sounds like it's an issue with the GPU's video decoding logic. If there's a timeout when trying to process a decode request, it may be that power management for the GPU is buggy somehow. Given that this is a server build and idle power consumption is likely not a big deal, I'd suggest pinning the GPU power state to see if it resolves the issue (see amdgpu.ppfeaturemask and amdgpu.runpm kernel parameters).
bayindirh 1 hours ago [-]
I believe something I call "the window phenomenon" has occurred. Sometimes, life allows you have the time to do these big experiments on your life and then it gets busy again and you can't dive into it with the same capacity, so you have to do what you have to do while surviving what you have at hand.
I have gone through many patches like this, and I believe he had to handle life while is experimental workstation had to limp through.
Then when he had the time, he had just pulled the plug.
fragmede 3 hours ago [-]
Fascinating! I've been running the laptop version-ish of this experiment with the 14M9610, and my major complaint is Device Tree sucks. It's been explained to me why all of ARM can't just enumerate devices like PCs do, but it still sucks. This means every ARM device starts off in custom kernel territory, which makes all sorts of hacks okay to begin with, since you need a custom kernel anyway.
bpye 3 hours ago [-]
ACPI does exist for Aarch64, but is only really used for Windows client devices, and server hardware - though I think the Ampere hardware in the article would use ACPI not DT.
If you want to run Linux on one of the modern Qualcomm Windows laptops, you still generally end up needing to use device tree.
M95D 2 hours ago [-]
> my major complaint is Device Tree sucks
Why? Device tree is great. You can patch it yourself if something doesn't work, add overlays, etc.
rwmj 2 hours ago [-]
It's a bad solution compared to having the hardware just enumerate itself like PCI does. (No one uses the firmware supplied DTs because they're usually broken.)
M95D 39 minutes ago [-]
All IBM PC clones had (or emulated) the same 8253 timer, 8259 PIC, 8237 DMA controller, 8042 keyboard controller, CMOS RTC, 8250/16550 serial port, standard IDE/PATA, standard framebuffer addresses, standard PCI and ISA register addresses, FPU was always at IRQ13, mouse at IRQ12, RTC at IRQ8, LPT at 0x378, PC speaker at 0x61, etc.
All this doesn't require any enumeration and was still standard until BIOS/CSM was removed. PCs could use the same IDE driver for 30 years of hardware! All chipsets were compatible, from 386 to today's SATA in compatibility mode.
ARM made the mistake of not standardizing anything beside CPU instructions (and even those aren't always the same - see the mess armv7 created with thumb, thumb-ee, simd, neon, crypto acceleration, etc.). Of course it needs enumeration. But x86 is now catching up with the mess. Just wait...
Enumeration instead of standardized hw is bad, but I prefer the least worse device tree.
M95D 21 minutes ago [-]
But ARM has PCI, including it's enumeration. For the many other devices (timer, uart, I2c, PCI controller itself) no enumeration is possible - you can't enumerate searching for a timer without having a working timer - only a hardware description stored somewhere is possible. The device tree is the most logical, easy to understand, fixable, updateable and extendable way to describe hardware. It doesn't have executable code like ACPI does, and that's also one of the good things.
Let's take an example. Raspberry Pi doesn't have a RTC, but it has GPIO header. You add a RTC module on that header, one of several models of RTCs.
With the device tree, you load an overlay with some parameters and a kernel driver module. And it works.
How do you do that with ACPI? Ask the manufacturer for a UEFI update that scans for dozens of RTC types on each I2c bus? Good luck with that! What happens 5 years later when the board is long abandoned (not Raspberry's case, but think of an ordinary chinese manufacturer)?
jdub 2 hours ago [-]
Take a look at how modern PCs enumerate all of their non-PCI hardware. I'll put a bucket over here.
1 hours ago [-]
bestouff 2 hours ago [-]
This is not completely true. You can use a generic kernel with a custom device tree.
The only problem is that distributions currently tend to package them together, but that shouldn't be obligatory.
dezgeg 54 minutes ago [-]
You can't if the firmware provided DTB doesn't follow any upstream Linux approved bindings and instead uses some vendor kernel specific bindings.
M95D 14 minutes ago [-]
Why would you combine mainline kernel with manufacturer device tree? Kernel includes its own device trees.
anthonj 4 hours ago [-]
I see the problem, but I don't see a clear analysis on the actual source of the problem. I assumed the issue was mainly single core performance, but he is also suggesting context switches could be the cause?
So could you fix that with a new scheduler? Or you just need another SoC with better single core performance? I could imagine that the latter already exists, just not in soc with >16 cores.
My naive view is that such high core count system comes with tradoff on core size and interconnect/memeory bus complexity.
And I mean.. my phone is a middle lower end device and for sure I can play youtube videos (maybe in a popup as well) and run the browser without noticing that much difference from my laptop.
NavinF 3 hours ago [-]
I don't think youtube playback is a relevant comparison since it uses ~0 CPU. Pretty much all phones have hardware accelerated decoding. Lots of TVs and streaming devices use an ancient Android phone SoC yet they too can play YT and run a browser. The entire UI is often a local web app.
anthonj 1 hours ago [-]
I imagine, be he mentions video playback on youtube making things worse, and he does have a dedicated amd gpu.
But iirc for both Firefox and chromium on Linux desktop hw acceleration is tricky so maybe it's that.
KaiserPro 4 hours ago [-]
I think the single core performance would be bearable if it wasn't combined with maintaining a custom built kernel.
__patchbit__ 7 hours ago [-]
Can the ThinkPad T14 ARM Snapdragon variant function without pain as a daily Linux/BSD driver?
neobrain 1 hours ago [-]
Unlikely. I've been daily-driving the predecessor (X13s). While it's usable and technically all drivers are there, it's far from "without pain" due to endless number of small but annoying quirks. Just to give you an idea: boot fails 4 out of 5 times, external displays aren't recognized unless plugged in/out several times, sporadic resets during overnight sleep, etc. On top of that speakers will sound prohibitively tinny due unimplemented software-side speaker protection. I haven't tried T14s, but at least the audio issues will still apply there.
Apple devices supported by Asahi are a far more polished experience.
M95D 11 minutes ago [-]
> software-side speaker protection
What's that?
sedatk 5 hours ago [-]
Snapdragon has excellent single-thread performance (unlike Ampere) if that’s what you’re asking.
Without pain? I mean, there is pain when using Linux. It just works better than, say, Windows.
hparadiz 3 hours ago [-]
I just setup Gentoo on a Lenovo laptop last week. It was the least painful process for a Linux laptop of my entire career. Everything just works. Even sleep and the fingerprint sensor for sudo. LLM tuis replaced Google entirely.
I can't even say there was any pain whatsoever. The experience is now more akin to MacOS circa 10.6.x years.
izacus 3 hours ago [-]
Was it a Snapdragon laptop? Because if it wasn't, then it has nothing to do with the OPs question.
hparadiz 3 hours ago [-]
Driver support for that particular Lenovo is 100%. You just recompile. The issue is more to do with the CPU not being as good as say an AMD AI Max or an M4.
dlahoda 2 hours ago [-]
he does not mention AI usage.
how it helped to solve problems and search over git sources.
intresting what he would achieve mixing nixos and ai for patches.
bayindirh 1 hours ago [-]
AI will be more harmful than helpful than a very big and unexplored (for them) codebase for them.
Moreover, playing with code which fiddles with hardware directly is neither simple, nor easy, nor fun.
ginko 3 hours ago [-]
I wonder if a source-based distro like Gentoo would have made OP's life slightly easier. Portage for instance should allow you to maintain a set of patches to automatically apply when you update your kernel. Those flatpak problems also shouldn't exist there.
lonelyasacloud 2 hours ago [-]
At very least it would have given all those cores something to do :-)
cmrdporcupine 4 hours ago [-]
I use a DGX Spark every day as my daily driver and it's great. I barely use the "AI" facilities of it, but as an Aarch64 desktop Linux, I have no complaints.
john_alan 2 hours ago [-]
I’ve been using ARM Debian desktop stably for a long time. I don’t see what the issue is, am I missing something or is this just his hardware choice?
rvz 4 hours ago [-]
The AArch64 desktop experiment started in 2020 with the Macbook M1 and it ended in 2026 with great success with Apple phasing out support for Intel.
It is called Apple Silicon.
jeroenhd 3 hours ago [-]
If you think running a Linux desktop on an Ampere is bad, try running it on an M5 Mac!
preisschild 4 hours ago [-]
Which is somewhat useless because it doesn't properly support ACPI/UEFI so that you can boot other operating systems
laurencerowe 4 hours ago [-]
Wasn’t booting other operating systems supported from early on (two months after release of M1)? It was reverse engineering the graphics hardware that took time and effort.
True, but they had to implement their own bootloader chain and because of such overhead they need a lot of effort to port to each new apple SoC generation
dezgeg 50 minutes ago [-]
That is the reality for huge amount of ARM powered hardware, unless you fancy running vendor forks of kernel, u-boot, etc.
boxed 2 hours ago [-]
Ok.. and? That's job someone has already done, so what does it matter?
From what I've understood there's significant backwards compatibility for the new SoCs, so the significant work they need to do is to support new features, not getting things running.
shevy-java 6 hours ago [-]
The Desktop Linux will take over from here guys. Next year it will be ready, together with GNU Hurd for everyone and their Grandma.
mort96 4 hours ago [-]
Has anyone ever pretended that (non-Apple) ARM hardware running Linux makes for a remotely suitable desktop experience for the general public or are you shadow boxing here?
This is why things like the Apple M Series feels so fast, because while they don't win the multi core performance especially when going up against a 80 core beast like this, they have single thread performance exactly were it is needed.
Maybe we will need 80 cores in future, that is cool but for daily home use it is still just way too much for what we need.
Ampere's primary focus is running lots of simple tasks concurrently, at relatively low power, with lots of I/O. So, many tens to hundreds of cores, not too fast, at lower power draw than amd64, with lots of PCIe lanes for storage and network.
Apple's primary focus is user experience and power efficiency. That's why you'll find a handful of fast performance cores and low power efficiency cores, along with graphics acceleration to drive high resolution displays.
My speculation though. When I was building an app I was using, I used to run a recent stable build on my device instead of just the one released in the Play Store. Simplifies having to keep multiple devices.
All he had to do was build some packages from source, right? It's really worth learning how to do this, since it removes a lot of constraints.
And the kernel patch should land in the kernel pretty soon, I hope? He won't have to run a patched kernel forever. Should be possible to get that in a release in a year or so?
But that was several layers deep into yak shaving broken graphics, and at some point you need to actually get your real work done.
I have gone through many patches like this, and I believe he had to handle life while is experimental workstation had to limp through.
Then when he had the time, he had just pulled the plug.
If you want to run Linux on one of the modern Qualcomm Windows laptops, you still generally end up needing to use device tree.
Why? Device tree is great. You can patch it yourself if something doesn't work, add overlays, etc.
All this doesn't require any enumeration and was still standard until BIOS/CSM was removed. PCs could use the same IDE driver for 30 years of hardware! All chipsets were compatible, from 386 to today's SATA in compatibility mode.
ARM made the mistake of not standardizing anything beside CPU instructions (and even those aren't always the same - see the mess armv7 created with thumb, thumb-ee, simd, neon, crypto acceleration, etc.). Of course it needs enumeration. But x86 is now catching up with the mess. Just wait...
Enumeration instead of standardized hw is bad, but I prefer the least worse device tree.
Let's take an example. Raspberry Pi doesn't have a RTC, but it has GPIO header. You add a RTC module on that header, one of several models of RTCs.
With the device tree, you load an overlay with some parameters and a kernel driver module. And it works.
How do you do that with ACPI? Ask the manufacturer for a UEFI update that scans for dozens of RTC types on each I2c bus? Good luck with that! What happens 5 years later when the board is long abandoned (not Raspberry's case, but think of an ordinary chinese manufacturer)?
The only problem is that distributions currently tend to package them together, but that shouldn't be obligatory.
So could you fix that with a new scheduler? Or you just need another SoC with better single core performance? I could imagine that the latter already exists, just not in soc with >16 cores. My naive view is that such high core count system comes with tradoff on core size and interconnect/memeory bus complexity.
And I mean.. my phone is a middle lower end device and for sure I can play youtube videos (maybe in a popup as well) and run the browser without noticing that much difference from my laptop.
But iirc for both Firefox and chromium on Linux desktop hw acceleration is tricky so maybe it's that.
Apple devices supported by Asahi are a far more polished experience.
What's that?
I believe Ubuntu also has semi official X1 elite support, no idea if they're working on the latest generation.
Even. Setting it up is a pain: https://github.com/Jeremiah-Hawley/Linux-on-Snapdragon
It can run Windows well though.
I can't even say there was any pain whatsoever. The experience is now more akin to MacOS circa 10.6.x years.
how it helped to solve problems and search over git sources.
intresting what he would achieve mixing nixos and ai for patches.
Moreover, playing with code which fiddles with hardware directly is neither simple, nor easy, nor fun.
It is called Apple Silicon.
From what I've understood there's significant backwards compatibility for the new SoCs, so the significant work they need to do is to support new features, not getting things running.