Conquering Large Scale Inference

Overview

Large-scale AI model inference is a unique technical challenge. Luckily, Domenic Donato, VP of Technology at AssemblyAI, an API startup building state-of-the-art AI models, will share how to tackle it. Domenic will dive deep into the innovative solutions employed by AssemblyAI to address this complex undertaking and explore cutting-edge techniques to ensure efficient, effective inference processes on deep learning models. From optimizing computational resources to leveraging parallelization and distributed systems, you’ll learn strategies on how to make informed decisions at-scale.

Key Topics

• Optimizing computational resources for large-scale inference
• Leveraging parallelization techniques
• Distributed systems for deep learning models
• Making informed decisions at scale

Speaker

Domenic Donato - VP of Technology at AssemblyAI