Supercomputing is essential for many fields such as theoretical physics, engineering, and even precision medicine. I will explain the challenges involved in designing a supercomputer that achieves high sustained performance on many thousands of nodes, in particular the balance between processor, memory system, and network. I will describe several successful examples, including some I have helped to design in collaboration with IBM and Intel. I will also discuss very recent developments based on ARM technology, such as the Post-K supercomputer in Japan.
