Quantization Methods for Large Language Models From Theory to Real-World Implementations (Paperback)
Anand Vemula
ISBN 13: 9798227328335
Published by Anand Vemula, 2024
New
Paperback
From
CitiRetail, Stevenage, United Kingdom
Seller rating 5 out of 5 stars
AbeBooks Seller since June 29, 2022
This book is no longer available. AbeBooks has millions of books. Please enter search terms below to find similar copies.
About this Item
Description:
Paperback. The book provides an in-depth understanding of quantization techniques and their impact on model efficiency, performance, and deployment.The book starts with a foundational overview of quantization, explaining its significance in reducing the computational and memory requirements of LLMs. It delves into various quantization methods, including uniform and non-uniform quantization, per-layer and per-channel quantization, and hybrid approaches. Each technique is examined for its applicability and trade-offs, helping readers select the best method for their specific needs.The guide further explores advanced topics such as quantization for edge devices and multi-lingual models. It contrasts dynamic and static quantization strategies and discusses emerging trends in the field. Practical examples, use cases, and case studies are provided to illustrate how these techniques are applied in real-world scenarios, including the quantization of popular models like GPT and BERT. Shipping may be from our UK warehouse or from our Australian or US warehouses, depending on stock availability. Seller Inventory # 9798227328335
Synopsis:
The book provides an in-depth understanding of quantization techniques and their impact on model efficiency, performance, and deployment.
The book starts with a foundational overview of quantization, explaining its significance in reducing the computational and memory requirements of LLMs. It delves into various quantization methods, including uniform and non-uniform quantization, per-layer and per-channel quantization, and hybrid approaches. Each technique is examined for its applicability and trade-offs, helping readers select the best method for their specific needs.
The guide further...
"About this title" may belong to another edition of this title.
Bibliographic Details
Title: Quantization Methods for Large Language ...
Publisher: Anand Vemula
Publication Date: 2024
Binding: Paperback
Condition: new
AbeBooks offers millions of new, used, rare and out-of-print books, as well as cheap textbooks from thousands of booksellers around the world. Shopping on AbeBooks is easy, safe and 100% secure - search for your book, purchase a copy via our secure checkout and the bookseller ships it straight to you.
Search thousands of booksellers selling millions of new & used books
New & Used Books
New and used copies of new releases, best sellers and award winners. Save money with our huge selection.
Rare & Out of Print Books
From scarce first editions to sought-after signatures, find an array of rare, valuable and highly collectible books.
