The computing problem of our time: Moving data

• Celestial AI's Photonic Fabric technology can deliver up to 700 terabits per second of bidirectional bandwidth per chip package.
• The start-up has recently raised $100 million in funding.

The size of AI models that implement machine learning continue to grow staggeringly fast.

Such AI models are used for computer vision, large language models such as ChatGPT, and recommendation systems that rank items such as search results and music playlists.

David Lazovsky

The workhorse silicon used to build such AI models are graphics processing units (GPUs). GPU processing performance and their memory size may be advancing impressively but AI model growth is far outpacing their processing and input-output [I/O] capabilities.

Click to read more ...