Download this chapter (PDF)
Increase in co-evolution between hardware and AI

While hardware initially facilitates the computing for AI, it is now becoming the limiting factor, forcing AI developments to fit with computing infrastructure. The growing popularity and accessibility of AI models are driving a significant shift in hardware innovations. AI models are increasing in size and complexity faster than the advancements in general-purpose computing technologies for processing.


In the previous SURF Tech Trends Report 2023, the surge in specialised AI hardware was highlighted. In addition to this trend, more devices (phones, laptops, etc.) are being produced to support daily AI workflows. Another development driven by this mismatch is the design of AI models to use available computational resources more efficiently. With innovations such as low-precision models and AI-aware hardware implementations, AI is being reshaped, driven by the need to achieve ‘more with less’ in system capabilities.

Impact

education

Education

  • Personal AI workstations and increased attention for trusted compute architectures may help mitigate current privacy issues with big tech LLMs, as well as reducing data traffic across networks.
  • High-performance compute for (HPC) for AI will offer students the possibility to handle more complex data tasks, however training may be required.
Research

Research

  • More accessible computer hardware with higher performance (personal supercomputers) means that there will be enhanced research capabilities for the research community.
  • A dependency on a handful of vendors for AI-hardware exposes a risk of a potential scarcity of AI-devices as global supply chains come under pressure.
Operations

Operations

  • Personal AI workstations and more efficient AI models, at lower cost, mean students and researchers are less likely to require large-scale high-performance computing (HPC) systems to experiment with cutting-edge AI. Unlike the computer science, data science, and AI communities who will still need to carry out internationally competitive research.
  • Global demand for resources enabling AI specific chips, could limit hardware availability of edge devices supporting smart campus automation, research and education.
More info about AI?
Visit surf.nl
Link SURF icoon