Machine Learning Experts - Lewis Tunstall

Summary

In this interview with Britney Muller, Hugging Face machine learning engineer Lewis Tunstall discusses his background, his book Natural Language Processing with Transformers, and tooling optimizations for deploying transformer models. Tunstall notes that large model parameter sizes often lead to high latency, making off-the-shelf transformers impractical for responsive applications like chatbots. To resolve this issue, he developed single-line export tooling within the transformers library to convert models into the ONNX format. This conversion enables engineers to run PyTorch models in TensorFlow or on specialized hardware, achieving faster latency and higher throughput. Tunstall also recounts co-authoring the O'Reilly book with Leandro von Werra and Thom Wolf, collaborating on the Hugging Face Course, and training a GPT-2 model named code parrot on Python code.

Takeaways

1. 1

   Transformer parameter sizes cause latency issues in production applications like chatbots when using unoptimized models.

2. 2

   The Hugging Face transformers library added one-line export functionality to convert PyTorch models to the ONNX format for deployment on dedicated hardware.

3. 3

   Tunstall co-authored the book Natural Language Processing with Transformers after identifying an information gap in learning materials for the architecture.