Items related to Small Language Models in Action: Efficient generative...

Small Language Models in Action: Efficient generative AI for resource-constrained systems (English Edition) - Softcover

Muppala, Dr. Sireesha; DeFauw, Randy; Eigenbrode, Shelbee

 
9788167080028: Small Language Models in Action: Efficient generative AI for resource-constrained systems (English Edition)

Synopsis

While large language models have transformed generative AI (GenAI), their heavy compute demands, high inference costs, and cloud dependency make them impractical for many real-world applications. Small language models (SLMs) offer a compelling alternative, delivering powerful GenAI capabilities while running efficiently on mobile devices, edge hardware, and cost-constrained systems. This book bridges the gap between theoretical model architecture and real-world deployment, serving as your ultimate engineering roadmap for building efficient, compact, and production-ready AI systems.

This book systematically guides you through the entire life cycle of small language models across 14 comprehensive chapters. This book begins with the foundations of SLMs, covering their architecture, design principles, and size-performance trade-offs. Readers will master core compression techniques including knowledge distillation, quantization, and pruning to shrink models while preserving accuracy. The book also explores lightweight transformers, efficient fine-tuning, and inference optimization for latency and memory, followed by practical deployment on edge and mobile platforms using ONNX and TensorFlow Lite. Finally, the book explores SLM-powered agents capable of tool use and multi-step reasoning, hybrid architectures that combine small and large models, and real-world case studies, closing with benchmarking and cost-performance frameworks.

By the end of this book, readers will be able to build production-ready SLMs from scratch, apply compression techniques confidently, and deploy efficient generative AI across mobile, edge, and cloud, making sound architectural decisions under real-world constraints.

What you will learn

● Design compact SLM architectures balancing size and performance.

● Evaluate SLMs across multiple dimensions.

● Apply distillation, quantization, and pruning to compress models.

● Fine-tune small models for task and domain-specific generative AI tasks.

● Optimize inference for low latency and minimal memory.

● Deploy SLMs on edge, mobile, and cloud platforms.

● Build SLM-powered agents with tool use and reasoning.

Who this book is for

The book is designed for students, machine learning engineers, NLP practitioners, software developers, and AI builders deploying efficient models to resource-constrained environments, edge systems, and mobile devices. Readers need working knowledge of Python alongside a basic understanding of core machine learning concepts.

Table of Contents

1. Small Language Model Architecture Overview

2. Transformer Architecture Fundamentals for SLMs

3. Evaluating SLMs

4. Knowledge Distillation for Language Models

5. Quantization for Efficient Inference

6. Pruning and Sparsity for Compact Models

7. Fine-tuning SLMs

8. Optimizing Inference for Speed and Memory

9. Edge and Mobile Deployment for Generative AI

10. Production Pipelines and Serving Infrastructure

11. SLMs in Agents and Agentic Workflows

12. Hybrid Architectures Combining SLMs and LLMs

13. Multimodal SLMs

14. SLM Production Case Studies and Trends

"synopsis" may belong to another edition of this title.