New Server Hopes to Break Through AI’s “Memory Wall”

Jul 10, 2026

AI hardware startup Majestic Labs is developing a new AI server, Prometheus, featuring up to 128 terabytes of memory—over 60 times more than Nvidia's DGX B300 server. The company employs a DRAM-centric architecture and a proprietary memory interface to address the memory bottleneck that limits large language model inference performance.

Why it matters: This approach could significantly reduce the memory bottleneck in AI inference, potentially enabling more efficient processing of large language models.

Full story at: IEEE Spectrum / AI ↗