3 appearances on the backlist front page in the last 30 days.
I got 2 intel bad boys on Friday. At this point I’m struggling to find more power for all this. - 4x 6000s - 1x DGX Spark - AMD Strix - 4x 3090 - 2x intel arc b70 - Mac mini 16gb - MacBook Pro 32gb 544gb VRAM 300gb mixed Total = 844g
Full build Asrock romed82t motherboard Epyc 7443p CPU 512gb ddr4 samsung Noctua fans 2 PSUs a 1600w and 1000w RTX 3090 for TTS and STT 4x RTX Pro 6000s Makeshift chassis 6tb total NVMe Each RTX pro is capped at 275w 2 GPUs per PSU
Wow! 4 MacBooks serving 40 tok/s+ on a 230B param model hmmmm I thought the gatekeepers said this isnt possible