Items related to ONNX Runtime GenAI: Portable Inference Across CPU,...
Synopsis
"ONNX Runtime GenAI: Portable Inference Across CPU, GPU, and Edge"
Modern AI systems rarely live on a single hardware target. They must run correctly and efficiently across CPUs, GPUs, mobile devices, and specialized edge accelerators—often while serving increasingly demanding generative workloads. This book is written for experienced practitioners who already know the basics of model deployment and now need a rigorous, architecture-level guide to making ONNX Runtime and ONNX Runtime GenAI work reliably in heterogeneous environments.
Readers will build a deep understanding of ONNX Runtime’s execution model, inference sessions, execution providers, graph partitioning, and optimization pipeline, then apply that knowledge to real deployment decisions: choosing between ONNX and ORT formats, tuning CPU and GPU backends, diagnosing fallback and operator gaps, engineering reproducible environments, and optimizing performance under production constraints. The book also covers edge and mobile deployment, quantization, and the full GenAI packaging and generation workflow for portable large-model inference.
Rather than treating portability as a marketing promise, this book treats it as an engineering discipline shaped by compatibility boundaries, hardware capabilities, memory behavior, and version-sensitive tooling. Its focus is practical and advanced: not just how to run a model, but how to design, measure, debug, and evolve portable inference systems that remain dependable as runtimes, providers, and model artifacts change.
"synopsis" may belong to another edition of this title.
Search results for ONNX Runtime GenAI: Portable Inference Across CPU,...
Stock Image
ONNX Runtime GenAI (Paperback)
Print on DemandSeller: Grand Eagle Retail, Bensenville, IL, U.S.A.
Seller rating 5 out of 5 stars
Paperback. Condition: new. Paperback. "ONNX Runtime GenAI: Portable Inference Across CPU, GPU, and Edge"Modern AI systems rarely live on a single hardware target. They must run correctly and efficiently across CPUs, GPUs, mobile devices, and specialized edge accelerators-often while serving increasingly demanding generative workloads. This book is written for experienced practitioners who already know the basics of model deployment and now need a rigorous, architecture-level guide to making ONNX Runtime and ONNX Runtime GenAI work reliably in heterogeneous environments.Readers will build a deep understanding of ONNX Runtime's execution model, inference sessions, execution providers, graph partitioning, and optimization pipeline, then apply that knowledge to real deployment decisions: choosing between ONNX and ORT formats, tuning CPU and GPU backends, diagnosing fallback and operator gaps, engineering reproducible environments, and optimizing performance under production constraints. The book also covers edge and mobile deployment, quantization, and the full GenAI packaging and generation workflow for portable large-model inference.Rather than treating portability as a marketing promise, this book treats it as an engineering discipline shaped by compatibility boundaries, hardware capabilities, memory behavior, and version-sensitive tooling. Its focus is practical and advanced: not just how to run a model, but how to design, measure, debug, and evolve portable inference systems that remain dependable as runtimes, providers, and model artifacts change. This item is printed on demand. Shipping may be from multiple locations in the US or from the UK, depending on stock availability. Seller Inventory # 9798896653448
Stock Image
ONNX Runtime GenAI
Print on DemandSeller: PBShop.store US, Wood Dale, IL, U.S.A.
Seller rating 5 out of 5 stars
PAP. Condition: New. New Book. Shipped from UK. THIS BOOK IS PRINTED ON DEMAND. Established seller since 2000. Seller Inventory # L0-9798896653448
Stock Image
ONNX Runtime GenAI: Portable Inference Across CPU, GPU, and Edge
Seller: California Books, Miami, FL, U.S.A.
Seller rating 5 out of 5 stars
Condition: New. Seller Inventory # I-9798896653448
Stock Image
ONNX Runtime GenAI
Print on DemandSeller: PBShop.store UK, Fairford, GLOS, United Kingdom
Seller rating 5 out of 5 stars
PAP. Condition: New. New Book. Delivered from our UK warehouse in 4 to 14 business days. THIS BOOK IS PRINTED ON DEMAND. Established seller since 2000. Seller Inventory # L0-9798896653448
Buy New
US$ 36.73
US$ 5.57 shipping
Ships from United Kingdom to U.S.A.
Ships from United Kingdom to U.S.A.
Quantity: Over 20 available
Stock Image
ONNX Runtime GenAI (Paperback)
Print on DemandSeller: CitiRetail, Stevenage, United Kingdom
Seller rating 5 out of 5 stars
Paperback. Condition: new. Paperback. "ONNX Runtime GenAI: Portable Inference Across CPU, GPU, and Edge"Modern AI systems rarely live on a single hardware target. They must run correctly and efficiently across CPUs, GPUs, mobile devices, and specialized edge accelerators-often while serving increasingly demanding generative workloads. This book is written for experienced practitioners who already know the basics of model deployment and now need a rigorous, architecture-level guide to making ONNX Runtime and ONNX Runtime GenAI work reliably in heterogeneous environments.Readers will build a deep understanding of ONNX Runtime's execution model, inference sessions, execution providers, graph partitioning, and optimization pipeline, then apply that knowledge to real deployment decisions: choosing between ONNX and ORT formats, tuning CPU and GPU backends, diagnosing fallback and operator gaps, engineering reproducible environments, and optimizing performance under production constraints. The book also covers edge and mobile deployment, quantization, and the full GenAI packaging and generation workflow for portable large-model inference.Rather than treating portability as a marketing promise, this book treats it as an engineering discipline shaped by compatibility boundaries, hardware capabilities, memory behavior, and version-sensitive tooling. Its focus is practical and advanced: not just how to run a model, but how to design, measure, debug, and evolve portable inference systems that remain dependable as runtimes, providers, and model artifacts change. This item is printed on demand. Shipping may be from our UK warehouse or from our Australian or US warehouses, depending on stock availability. Seller Inventory # 9798896653448
Buy New
US$ 43.42
US$ 49.54 shipping
Ships from United Kingdom to U.S.A.
Ships from United Kingdom to U.S.A.
Quantity: 1 available
Stock Image
ONNX Runtime GenAI : Portable Inference Across CPU, GPU, and Edge
Print on DemandSeller: AHA-BUCH GmbH, Einbeck, Germany
Seller rating 5 out of 5 stars
Taschenbuch. Condition: Neu. nach der Bestellung gedruckt Neuware - Printed after ordering - 'ONNX Runtime GenAI: Portable Inference Across CPU, GPU, and Edge'Modern AI systems rarely live on a single hardware target. They must run correctly and efficiently across CPUs, GPUs, mobile devices, and specialized edge accelerators-often while serving increasingly demanding generative workloads. This book is written for experienced practitioners who already know the basics of model deployment and now need a rigorous, architecture-level guide to making ONNX Runtime and ONNX Runtime GenAI work reliably in heterogeneous environments.Readers will build a deep understanding of ONNX Runtime's execution model, inference sessions, execution providers, graph partitioning, and optimization pipeline, then apply that knowledge to real deployment decisions: choosing between ONNX and ORT formats, tuning CPU and GPU backends, diagnosing fallback and operator gaps, engineering reproducible environments, and optimizing performance under production constraints. The book also covers edge and mobile deployment, quantization, and the full GenAI packaging and generation workflow for portable large-model inference.Rather than treating portability as a marketing promise, this book treats it as an engineering discipline shaped by compatibility boundaries, hardware capabilities, memory behavior, and version-sensitive tooling. Its focus is practical and advanced: not just how to run a model, but how to design, measure, debug, and evolve portable inference systems that remain dependable as runtimes, providers, and model artifacts change. Seller Inventory # 9798896653448
Buy New
US$ 59.39
US$ 39.05 shipping
Ships from Germany to U.S.A.
Ships from Germany to U.S.A.
Quantity: 2 available
Seller Image
ONNX Runtime GenAI | Portable Inference Across CPU, GPU, and Edge
Print on DemandSeller: preigu, Osnabrück, Germany
Seller rating 5 out of 5 stars
Taschenbuch. Condition: Neu. ONNX Runtime GenAI | Portable Inference Across CPU, GPU, and Edge | Trex Team | Taschenbuch | Englisch | 2026 | NobleTrex Press | EAN 9798896653448 | Verantwortliche Person für die EU: Libri GmbH, Europaallee 1, 36244 Bad Hersfeld, gpsr[at]libri[dot]de | Anbieter: preigu Print on Demand. Seller Inventory # 138110699
Buy New
US$ 49.07
US$ 78.11 shipping
Ships from Germany to U.S.A.
Ships from Germany to U.S.A.
Quantity: 5 available