Advanced Quantization Techniques for Large Language Models

Master advanced quantization techniques for transformer models, from mathematical foundations to practical applications, maximizing efficiency while preserving model quality.
Course details
Discover cutting-edge quantization techniques for large language models, focusing on the algorithms and optimization strategies that deliver the best performance. Instructor Nayan Saxena begins by covering mathematical foundations, before progressing through advanced methods including GPTQ, AWQ, and SmoothQuant with hands-on examples in Google Colab. Along the way, gather quick tips to master critical concepts such as precision formats, calibration strategies, and evaluation methodologies. Leveraging both theoretical principles and practical applications, this course equips you with in-demand skills to significantly reduce model size and accelerate inference while maintaining performance quality.
Skills covered
Large Language Models (LLM), Model Training, Quantization Techniques
Homepage