What are these "GPUs" really?

Summary

The post explains how graphics hardware evolved from CPU-offloaded video rendering into modern GPUs and why those devices now matter for AI/ML. It traces the path from the Commodore 64’s VIC-II and 3D accelerator cards through Quake, Tomb Raider, integrated graphics, and increasingly parallel hardware, while describing components such as framebuffers, command processors, shader hardware, memory, and display outputs. It then connects shader and CUDA cores to workloads including GPT-2, Stable Diffusion, and speech or text processing, and presents model chaining as more useful than treating models as isolated tools. A conference-video workflow combines ffmpeg, Whisper, subtitle segmentation, a large language model, Markdown, and human review to produce accessible written material. The conclusion distinguishes graphics-capable cards from A100 accelerators, which the post says cannot process graphics or encode video but are highly effective for AI/ML workloads.

Takeaways

1. 1

   The Commodore 64’s VIC-II demonstrated offloading video output tasks from the CPU to a dedicated device.

2. 2

   Modern GPUs combine components including framebuffers, command processors, shader hardware, memory, display outputs, video encoders, raytracing cores, and AI/ML hardware.

3. 3

   The post says A100 cards cannot process graphics or encode video, but are highly effective for AI/ML workloads and can perform more tasks per watt than CPUs.