tinybox red v2! 4x9070XT, single 15A plug. What price are people buying at?
Full bandwidth PCIe 4 x16 between the 4 GPUs. 32 core EPYC processor, 128 GB ram, 2TB NVMe.
Actually why am I using AMD's bandwidth tool? Here's a vibe coded one in tinygrad. Full P2P between the GPUs is supported on the stock AMD driver (unlike certain other green companies who block it because they are mean)
Good dtype support, 165 TFLOPS MMAPEAK for bf16 acc f32. 315 TFLOPS for fp8.
Good dtype support, 165 TFLOPS MMAPEAK for bf16 acc f32. 315 TFLOPS for fp8. This is of course per card.
Full support for the tinygrad AM driver, meaning you can rmmod amdgpu and it still works! Python is mapping the PCIe BARs into the process and directly driving the GPU.
AMD has made a ton of progress with ROCm. Version 7.1 comes standard, along with the latest PyTorch. 133 achieved GEMM TFLOPS out of 165 MMAPEAK isn't bad, and the amdgpu driver seems stable on RDNA4!
tinygrad 13 line gpuburn! Maxing out power at 304W per card, PSU handles it great and barely audible in office.
Here it is with amdgpu instead of AM driver. idk what it's on about about low power state, that's max power, and look at those frigid temps after burning for 10 minutes!
Looks like a standard issue tinybox, beautiful front screen, big clicky button, calming circles.
12.37K