Brousseau C. LLMs in Production. From language models...products 2025 Final
Download this torrent!
Brousseau C. LLMs in Production. From language models...products 2025 Final
To start this P2P download, you have to install a BitTorrent client like qBittorrent
Category: Other
Total size: 37.48 MB
Added: 2025-03-10 23:39:12
Share ratio:
40 seeders,
2 leechers
Info Hash: A1C632B986DAD802F33E7B83B4108EF2D41CC144
Last updated: 19.9 minutes ago
Description:
Textbook in PDF format
Learn how to put Large Language Model-based applications into production safely and efficiently.
This practical book offers clear, example-rich explanations of how LLMs work, how you can interact with them, and how to integrate LLMs into your own applications. Find out what makes LLMs so different from traditional software and ML, discover best practices for working with them out of the lab, and dodge common pitfalls with experienced advice.
In LLMs in Production you will:
Grasp the fundamentals of LLMs and the technology behind them
Evaluate when to use a premade LLM and when to build your own
Efficiently scale up an ML platform to handle the needs of LLMs
Train LLM foundation models and finetune an existing LLM
Deploy LLMs to the cloud and edge devices using complex architectures like PEFT and LoRA
Build applications leveraging the strengths of LLMs while mitigating their weaknesses
LLMs in Production delivers vital insights into delivering MLOps so you can easily and seamlessly guide one to production usage. Inside, you’ll find practical insights into everything from acquiring an LLM-suitable training dataset, building a platform, and compensating for their immense size. Plus, tips and tricks for prompt engineering, retraining and load testing, handling costs, and ensuring security.
Foreword by Joe Reis.
Purchase of the print book includes a free eBook in PDF and EPUB formats from Manning Publications.
About the technology
Most business software is developed and improved iteratively, and can change significantly even after deployment. By contrast, because LLMs are expensive to create and difficult to modify, they require meticulous upfront planning, exacting data standards, and carefully-executed technical implementation. Integrating LLMs into production products impacts every aspect of your operations plan, including the application lifecycle, data pipeline, compute cost, security, and more. Get it wrong, and you may have a costly failure on your hands.
About the book
LLMs in Production teaches you how to develop an LLMOps plan that can take an AI app smoothly from design to delivery. You’ll learn techniques for preparing an LLM dataset, cost-efficient training hacks like LORA and RLHF, and industry benchmarks for model evaluation. Along the way, you’ll put your new skills to use in three exciting example projects: creating and training a custom LLM, building a VSCode AI coding extension, and deploying a small model to a Raspberry Pi.
What's inside
Balancing cost and performance
Retraining and load testing
Optimizing models for commodity hardware
Deploying on a Kubernetes cluster
About the reader
For data scientists and ML engineers who know Python and the basics of cloud deployment.
About the author
Christopher Brousseau and Matt Sharp are experienced engineers who have led numerous successful large scale LLM deployments.
Table of Contents
Words’ awakening: Why large language models have captured attention
Large language models: A deep dive into language modeling
Large language model operations: Building a platform for LLMs
Data engineering for large language models: Setting up for success
Training large language models: How to generate the generator
Large language model services: A practical guide
Prompt engineering: Becoming an LLM whisperer
Large language model applications: Building an interactive experience
Creating an LLM project: Reimplementing Llama 3
Creating a coding copilot project: This would have helped you earlier
Deploying an LLM on a Raspberry Pi: How low can you go?
Production, an ever-changing landscape: Things are just getting started
A History of linguistics
B Reinforcement learning with human feedback
C Multimodal latent spaces