Local Performance Handbook Optimizing by Tyson Ethan (2 results)
- More images
Language: English
Published by Createspace Independent Publishing Platform Mai 2026, 2026
- Softcover
Seller: AHA-BUCH GmbH, Einbeck, GermanyAHA-BUCH GmbH
Contact seller5-star sellerCondition: New
US$ 30.91
US$ 70.70 shippingShips from Germany to U.S.A.Quantity: 2 available
Taschenbuch. Condition: Neu. Neuware - The Local AI Performance Handbook: Optimizing Ollama for Multi-GPU and Hardware AccelerationLocal AI is powerful, but poor configuration can turn expensive hardware into a slow, unstable bottleneck. If your Ollama setup struggles with VRAM limits, weak token throughput, GPU underuse, long c…ontext slowdowns, or unreliable multi-user workloads, this handbook gives you the practical performance playbook you need.The Local AI Performance Handbook is a technical guide to building faster, more private, and more reliable Ollama systems across NVIDIA CUDA, AMD ROCm, Apple Silicon, WSL2, Docker, Kubernetes, and multi-GPU environments. It moves beyond basic local model setup and focuses on the engineering details that determine real-world performance: hardware acceleration, VRAM planning, quantization, request concurrency, private RAG, secure deployment, benchmarking, and production maintenance. The book's scope is reflected in its coverage of hardware-specific runtimes, memory engineering, multi-GPU scheduling, quantization, high-concurrency handling, private RAG, deployment, agentic workflows, and troubleshooting.Inside, readers will learn how to: - Configure Ollama for CUDA, ROCm, Apple Silicon, Vulkan, Docker, and WSL2.- Calculate model memory footprints and avoid out-of-memory failures.- Tune VRAM usage, KV cache behavior, context windows, and quantization choices.- Scale Ollama across multiple GPUs and isolate workloads with resource controls.- Benchmark tokens per second, latency, GPU utilization, and system bottlenecks.- Deploy private AI inference with Docker Compose, Kubernetes, health checks, and secure API access.- Build faster private RAG and local agent workflows without depending on cloud APIs.For developers, AI engineers, homelab builders, and technical teams serious about private AI performance, this book turns Ollama from a simple local model runner into a tuned inference platform.
Language: English
Published by Independently published, 2026
- Softcover
- Print on Demand
Seller: California Books, Miami, FL, U.S.A.California Books
Contact seller4-star sellerCondition: New
US$ 24.00
Free ShippingShips within U.S.A.Quantity: Over 20 available
Condition: New. Print on Demand.
