I had the opportunity to attend NVidia’s “Editor’s Day” in San Francisco last week, in preparation for the launch of their RTX Spark line of laptops and desktops. It was a day of presentations about AI, and how the new hardware enables local AI processing, and the benefits of that shift. NVidia is very good at creating a market for its products. It did this with 3D gaming in general, various technologies within it, including Ray tracing, DLSS, etc. It did this with CUDA and eventually GPU accelerated AI in general. Now they are doing it with local on-device AI. One of the major hardware limitations for running complex AI models is RAM. Unified memory architectures provide flexibility, allowing GPUs access to up to the entire capacity of the system memory, which in turn opens up more AI model options.
Continue reading
