While hardware initially facilitates the computing for AI, it is now becoming the limiting factor, forcing AI developments to fit with computing infrastructure. The growing popularity and accessibility of AI models are driving a significant shift in hardware innovations. AI models are increasing in size and complexity faster than the advancements in general-purpose computing technologies for processing.
In the previous SURF Tech Trends Report 2023, the surge in specialised AI hardware was highlighted. In addition to this trend, more devices (phones, laptops, etc.) are being produced to support daily AI workflows. Another development driven by this mismatch is the design of AI models to use available computational resources more efficiently. With innovations such as low-precision models and AI-aware hardware implementations, AI is being reshaped, driven by the need to achieve ‘more with less’ in system capabilities.