vLLM and High-Performance Inference: Memory Optimization, Parallel Execution, Token Streaming, and Scalable Model Serving (Large Language Model Refinement and Inference Series) - Softcover
Book 2 of 2: Large Language Model Refinement and Inference Series
Synopsis
Once a language model has been refined, its effectiveness depends on how well it can be delivered in real-world environments. This book examines the systems and techniques that enable efficient inference, with a particular focus on vLLM and the architectural decisions that support high-throughput execution.
The text begins by establishing the relationship between model size, hardware constraints, and response latency. It then explores how memory is managed during inference, including strategies that reduce overhead while maintaining output quality. Concepts such as batching, caching, and token-level scheduling are presented in a way that reveals their practical impact on performance.
A central theme of the book is parallel execution, where multiple requests are handled simultaneously without degrading responsiveness. The discussion highlights how modern inference frameworks distribute workloads, coordinate computation, and maintain consistency across concurrent processes.
Token streaming is examined as a critical component of user-facing systems, showing how incremental output generation improves perceived responsiveness and interaction flow. The material connects these techniques to broader system considerations, including scaling across machines, managing resource allocation, and maintaining stability under load.
As the book progresses, it presents a unified view of inference as both a technical and operational challenge. It demonstrates how decisions made at the system level directly influence user experience, cost efficiency, and reliability.
By the end, readers will have a clear understanding of how optimized inference transforms a refined model into a responsive and scalable system capable of operating under demanding conditions.
"synopsis" may belong to another edition of this title.
Search results for vLLM and High-Performance Inference: Memory Optimization,...
Stock Image
vLLM and High-Performance Inference: Memory Optimization, Parallel Execution, Token Streaming, and Scalable Model Serving (Large Language Model Refinement and Inference Series)
Print on DemandSeller: California Books, Miami, FL, U.S.A.
Seller rating 4 out of 5 stars
Condition: New. Print on Demand. Seller Inventory # I-9798195860981
Stock Image
vLLM and High-Performance Inference
Print on DemandSeller: PBShop.store US, Wood Dale, IL, U.S.A.
Seller rating 5 out of 5 stars
PAP. Condition: New. New Book. Shipped from UK. THIS BOOK IS PRINTED ON DEMAND. Established seller since 2000. Seller Inventory # L0-9798195860981
Stock Image
vLLM and High-Performance Inference
Print on DemandSeller: PBShop.store UK, Fairford, GLOS, United Kingdom
Seller rating 5 out of 5 stars
PAP. Condition: New. New Book. Delivered from our UK warehouse in 4 to 14 business days. THIS BOOK IS PRINTED ON DEMAND. Established seller since 2000. Seller Inventory # L0-9798195860981
Buy New
US$ 23.32
US$ 5.49 shipping
Ships from United Kingdom to U.S.A.
Ships from United Kingdom to U.S.A.
Quantity: Over 20 available
Stock Image
vLLM and High-Performance Inference (Paperback)
Print on DemandSeller: CitiRetail, Stevenage, United Kingdom
Seller rating 5 out of 5 stars
Paperback. Condition: new. Paperback. Once a language model has been refined, its effectiveness depends on how well it can be delivered in real-world environments. This book examines the systems and techniques that enable efficient inference, with a particular focus on vLLM and the architectural decisions that support high-throughput execution.The text begins by establishing the relationship between model size, hardware constraints, and response latency. It then explores how memory is managed during inference, including strategies that reduce overhead while maintaining output quality. Concepts such as batching, caching, and token-level scheduling are presented in a way that reveals their practical impact on performance.A central theme of the book is parallel execution, where multiple requests are handled simultaneously without degrading responsiveness. The discussion highlights how modern inference frameworks distribute workloads, coordinate computation, and maintain consistency across concurrent processes.Token streaming is examined as a critical component of user-facing systems, showing how incremental output generation improves perceived responsiveness and interaction flow. The material connects these techniques to broader system considerations, including scaling across machines, managing resource allocation, and maintaining stability under load.As the book progresses, it presents a unified view of inference as both a technical and operational challenge. It demonstrates how decisions made at the system level directly influence user experience, cost efficiency, and reliability.By the end, readers will have a clear understanding of how optimized inference transforms a refined model into a responsive and scalable system capable of operating under demanding conditions. This item is printed on demand. Shipping may be from our UK warehouse or from our Australian or US warehouses, depending on stock availability. Seller Inventory # 9798195860981
Buy New
US$ 27.85
US$ 48.83 shipping
Ships from United Kingdom to U.S.A.
Ships from United Kingdom to U.S.A.
Quantity: 1 available
Stock Image
vLLM and High-Performance Inference : Memory Optimization, Parallel Execution, Token Streaming, and Scalable Model Serving
Published by
Amazon Digital Services LLC - Kdp Mai 2026, 2026
ISBN 13: 9798195860981
New
Taschenbuch
Seller: AHA-BUCH GmbH, Einbeck, Germany
Seller rating 5 out of 5 stars
Taschenbuch. Condition: Neu. Neuware. Seller Inventory # 9798195860981
Buy New
US$ 35.50
US$ 70.21 shipping
Ships from Germany to U.S.A.
Ships from Germany to U.S.A.
Quantity: 2 available