Building Large Language Models from Scratch : Design, Train, and Deploy LLMs with PyTorch
Language: English
Published by Apress Mai 2026, 2026
- Softcover
- New
Seller: AHA-BUCH GmbH, Einbeck, GermanyAHA-BUCH GmbH
AbeBooks seller since August 14, 2006
Condition: New
US$ 75.02
Quantity: 2 available
Add to basketItem description from seller
Neuware - This book is a complete, hands-on guide to designing, training, and deploying your own Large Language Models (LLMs) from the foundations of tokenization to the advanced stages of fine-tuning and reinforcement learning. Written for developers, data scientists, and AI practitioners, it bridges core principles and state-of-the-art techniques, offering a rare, transparent look at how modern transformers truly work beneath the surface.Starting from the essentials, you ll learn how to set up your environment with Python and PyTorch, manage datasets, and implement critical fundamentals such as tensors, embeddings, and gradient descent. You ll then progress through the architectural heart of modern models, covering RMS normalization, rotary positional embeddings (RoPE), scaled dot-product attention, Grouped Query Attention (GQA), Mixture of Experts (MoE), and SwiGLU activations, each explored in depth and built step by step in code. As you advance, the book introduces custom CUDA kernel integration, teaching you how to optimize key components for speed and memory efficiency at the GPU level an essential skill for scaling real-world LLMs. You ll also gain mastery over the phases of training that define today s leading models:Pretraining - Building general linguistic and semantic understanding.Midtraining - Expanding domain-specific capabilities and adaptability.Supervised Fine-Tuning (SFT) - Aligning behavior with curated, task-driven data.Reinforcement Learning from Human Feedback (RLHF) - Refining responses through reward-based optimization for human alignment.The final chapters guide you through dataset preparation, filtering, deduplication, and training optimization, culminating in model evaluation and real-world prompting with a custom TokenGenerator for text generation and inference.By the end of this book, you ll have the knowledge and confidence to architect, train, and deploy your own transformer-based models, equipped with both the theoretical depth and practical expertise to innovate in the rapidly evolving world of AI.What You ll LearnHow to configure and optimize your development environment using PyTorchThe mechanics of tokenization, embeddings, normalization, and attention mechanisms.How to implement transformer components like RMSNorm, RoPE, GQA, MoE, and SwiGLU from scratch.How to integrate custom CUDA kernels to accelerate transformer computations.The full LLM training pipeline: pretraining, midtraining, supervised fine-tuning, and RLHF.Techniques for dataset preparation, deduplication, model debugging, and GPU memory management.How to train, evaluate, and deploy a complete GPT-like architecture for real-world tasks.…
Seller Inventory # 9798868822964
- Title
- Building Large Language Models from Scratch : Design, Train, and Deploy LLMs with PyTorch
- Author
- Dilyan Grigorov
- Publisher
- Apress Mai 2026
- Publication year
- 2026
- Condition
- Neu
- Binding
- Taschenbuch
- Language
- English
- ISBN 13
- 9798868822964
- Item weight
- 1,032 grams
- Dimensions
- 254x178x30 mm
This book is a complete, hands-on guide to designing, training, and deploying your own Large Language Models (LLMs)—from the foundations of tokenization to the advanced stages of fine-tuning and reinforcement learning. Written for developers, data scientists, and AI practitioners, it bridges core principles and state-of-the-art techniques, offering a rare, transparent look at how modern transformers truly work beneath the surface.
Starting from the essentials, you’ll learn how to set up your environment with Python and PyTorch, manage datasets, and implement critical fundamentals such as tensors, embeddings, and gradient descent. You’ll then progress through the architectural heart of modern models, covering RMS normalization, rotary positional embeddings (RoPE), scaled dot-product attention, Grouped Query Attention (GQA), Mixture of Experts (MoE), and SwiGLU activations, each explored in depth and built step by step in code. As you advance, the book introduces custom CUDA kernel integration, teaching you how to optimize key components for speed and memory efficiency at the GPU level—an essential skill for scaling real-world LLMs. You’ll also gain mastery over the phases of training that define today’s leading models:
- Pretraining - Building general linguistic and semantic understanding.
- Midtraining - Expanding domain-specific capabilities and adaptability.
- Supervised Fine-Tuning (SFT) - Aligning behavior with curated, task-driven data.
- Reinforcement Learning from Human Feedback (RLHF) - Refining responses through reward-based optimization for human alignment.
The final chapters guide you through dataset preparation, filtering, deduplication, and training optimization, culminating in model evaluation and real-world prompting with a custom TokenGenerator for text generation and inference.
By the end of this book, you’ll have the knowledge and confidence to architect, train, and deploy your own transformer-based models, equipped with both the theoretical depth and practical expertise to innovate in the rapidly evolving world of AI.
What You’ll Learn
- How to configure and optimize your development environment using PyTorch
- The mechanics of tokenization, embeddings, normalization, and attention mechanisms.
- How to implement transformer components like RMSNorm, RoPE, GQA, MoE, and SwiGLU from scratch.
- How to integrate custom CUDA kernels to accelerate transformer computations.
- The full LLM training pipeline: pretraining, midtraining, supervised fine-tuning, and RLHF.
- Techniques for dataset preparation, deduplication, model debugging, and GPU memory management.
- How to train, evaluate, and deploy a complete GPT-like architecture for real-world tasks.
Who this book is for:
Software developers, data scientists, machine learning engineers and AI enthusiasts looking to build their models from scratch.
"Synopsis" may belong to another edition of this title.
About the Author
Dilyan Grigorov is a software developer with a passion for Python software development, generative deep learning & machine learning, data structures, and algorithms. He is an advocate for open source and the Python language itself. He has 16 years of industry experience programming in Python and has spent 5 of those years researching and testing Generative AI solutions. His passion for them stems from his background as an SEO specialist dealing with search engine algorithms daily. He enjoys engaging with the software community, often giving talks at local meetups and larger conferences. In his spare time, he enjoys reading books, hiking in the mountains, taking long walks, playing with his son, and playing the piano.
"About the title" may belong to another edition of this title.
Shipping rates from Germany to U.S.A.
| Item | 7 to 10 business days | 5 to 7 business days |
|---|---|---|
| First item | US$ 47.34 | US$ 64.34 |
Payment methods
- Bank Wire Transfer
- Check
- Paypal
Store description
Das Unternehmen AHA-BUCH GmbH: Seit der Gründung von AHA-BUCH im Juli 2005 ist unser Hauptziel, zufriedenen Kunden so schnell und so preisgünstig wie möglich ihren Bücherwunsch zu erfüllen. Unsere Firma beschäftigt 16 Mitarbeiter, die nur ein Ziel kennen: den Kunden und seine Wünsche! Auf über 3700 m2 Fläche haben wir über 100.000 Bücher, Modernes Antiquariat und Spiele auf Lager.
Specialty
Kinderbücher & Kinderhör Casetten, German Books, Software, Natur & Tiere, Ratgeber, Sachbücher, Englische Bücher, Medizin & Gesundheit, Universität & StudiumSeller's business information
AHA-BUCH GmbH
Garlebsen 48
Einbeck, Germany 37574
Terms of sale
General Terms and Conditions and Customer Information / Privacy Policy
I. General Terms and Conditions
§ 1 Basic provisions
(1) The following terms and conditions apply to all contracts that you conclude with us as a provider (AHA-BUCH GmbH) via the Internet platforms AbeBooks and/or ZVAB. Unless otherwise agreed, the inclusion of any of your own terms and conditions used by you will be objected to
(2) A consumer within the meaning of the following regulations is any natural person who concludes a legal transaction for purposes that can predominantly be attributed neither to their commercial nor their independent professional activity. An entrepreneur is any natural or legal person or a partnership with legal capacity who, when concluding a legal transaction, acts in the exercise of his independent professional or commercial activity.
§ 2 Conclusion of the contract
(1) The object of the contract is the sale of goods.
(2) If an article is listed by us at AbeBooks or ZVAB, the activation of the offer page at AbeBooks or ZVAB constitutes the binding offer to conclude a contract under the conditions contained in the article page.
(3) The contract is concluded via the online shopping cart system as follows:
The goods intended for purchase are stored in the "shopping cart". Via the corresponding button in the navigation bar you can call up the "shopping cart" and make changes there at any time.
After calling up the "Checkout" page and entering the personal data as well as the payment and shipping conditions, all order data will be displayed again on the order overview page.
Before sending the order, you have the option of checking all information again, changing it (also via the "back" function of the Internet browser) or cancelling the purchase.
By submitting the order via the "Buy now" button, you declare the acceptance of the offer in a legally binding manner, whereby the contract is concluded.
(4) The processing of the order and transmission of all information required in connection with the conclusion of the contract is partly automated by e-mail. You must therefore ensure that the e-mail address you have stored with us is correct, that the receipt of the e-mails is technically ensured and, in particular, that spam filters do not prevent it.
§ 3 Right of retention, retention of title
(1) You can only exercise a right of retention if it concerns claims from the same contractual relationship.
(2) The goods remain our property until full payment of the purchase price.
§ 4 Warranty
(1) The statutory warranty rights exist.
(2) In the case of used goods, the warranty period is one year from delivery of the item, deviating from the statutory regulation. The shortening of the deadline does not apply:
- culpably caused damages attributable to us from injury to life, limb or health and in the case of other damages caused intentionally or through gross negligence;
- insofar as we have fraudulently concealed the defect or have assumed a guarantee for the quality of the item.
(3) As a consumer, you are requested to check the item immediately upon delivery for completeness, obvious defects and transport damage and to inform us and the freight forwarder of any complaints as soon as possible. If you do not comply with this, this will have no effect on your statutory warranty claims.
§ 5 Choice of law, place of performance, place of jurisdiction
(1) German law shall apply. In the case of consumers, this choice of law shall only apply insofar as this does not withdraw the protection afforded by mandatory provisions of the law of the state of the consumer's habitual residence (principle of favourability).
(2) The place of performance for all services arising from the existing business relationships with us as well as the place of jurisdiction is our registered office, insofar as you are not a consumer, but a merchant, a legal entity under public law or a special fund under public law. The same applies if you do not have a general place of jurisdiction in Germany or the EU or if the domicile or habitual residence is not known at the time the action is brought. The right to appeal to the court at another statutory place of jurisdiction remains unaffected by this.
(3) The provisions of the UN Convention on Contracts for the International Sale of Goods shall expressly not apply.
II. Customer Information
- Identity of the Seller
AHA-BUCH GmbH
Garlebsen 48
D-37574 Einbeck
Germany
Telephone: 055639996039
E-mail: abebooks@aha-buch.de.
Alternative dispute resolution:
The European Commission provides a platform for out-of-court online dispute resolution (ODR platform), which can be accessed under https://ec.europa.eu/odr.
- Information on the conclusion of the contract
The technical steps for the conclusion of the contract, the conclusion of the contract itself and the correction options are carried out in accordance with the provisions "Conclusion of the contract" of our General Terms and Conditions (Part I.).
- Contract language, contract text storage
3.1. The contract language is german.
3.2. The complete text of the contract will not be stored by us. Before sending the order, the contract data can be printed out or electronically saved via the print function of the browser. After receipt of the order by us, the order data, the legally prescribed information for distance contracts and the General Terms and Conditions will be sent to you again by e-mail.
- Essential characteristics of the goods or services
The essential characteristics of the goods and/or services can be found in the respective offer.
- Prices and terms of payment
5.1. The prices stated in the respective offers as well as the shipping costs represent total prices. They include all price components including all applicable taxes.
5.2. The shipping costs incurred are not included in the purchase price. They can be called up via a correspondingly designated button on our website or in the respective offer, are shown separately in the course of the ordering process and are to be borne by you in addition, unless free shipping has been promised.
5.3. If the delivery is made to countries outside the European Union, we may incur additional costs for which we are not responsible, such as.B customs duties, taxes or money transfer fees (transfer or exchange rate fees of the credit institutions), which are to be borne by you. Any costs incurred for the transfer of money shall also be borne by you in cases where the delivery is made to an EU member state, but the payment was initiated outside the European Union.
5.4. The payment methods available to you are indicated under a corresponding button on our website or in the respective offer.
5.5. Unless otherwise stated for the individual payment methods, the payment claims from the concluded contract are due for payment immediately.
- Terms of delivery
6.1. The terms of delivery, the delivery date and, if applicable, existing delivery restrictions can be found under a correspondingly designated button on our website or in the respective offer.
Insofar as no other deadline is specified in the respective offer or under the correspondingly designated button, the delivery of the goods will take place within 3-5 days after conclusion of the contract (in the case of agreed advance payment, however, only after the time of your payment instruction).
6.2. Insofar as you are a consumer, it is regulated by law that the risk of accidental loss and accidental deterioration of the sold item during dispatch shall only pass to you upon handover of the goods, regardless of whether the shipment is insured or uninsured. This does not apply if you have independently commissioned a transport company not named by the entrepreneur or a person otherwise designated to carry out the shipment.
- Statutory liability for defects
Liability for defects is governed by the "Warranty" provision in our General Terms and Conditions (Part I).
last update: 01/06/2022
Privacy policy
Unless otherwise stated below, the provision of your personal data is neither required by law or contract, nor is it necessary for the conclusion of a contract. You are not obliged to provide the data. Failure to provide this will have no consequences. This only applies if no other information is provided in the subsequent processing operations.
Collection, processing and disclosure of personal data when placing orders
When ordering, we collect and process your personal data only to the extent necessary to fulfil and process your order and to process your enquiries. The provision of the data is necessary for the conclusion of the contract. Failure to provide this provision means that no contract can be concluded. The processing takes place on the basis of Art. 6 para. 1 lit.b GDPR and is necessary for the performance of a contract with you.
Your data will be passed on, for example, to the shipping companies and dropshipping providers selected by you, payment service providers, service providers for order processing and IT service providers.
In all cases, we strictly observe the legal requirements. The scope of data transmission is limited to a minimum.
Duration of storage
After completion of the contract, the data will first be stored for the duration of the warranty period, then taking into account legal, in particular tax and commercial retention periods and then deleted after expiry of the period, unless you have consented to further processing and use.
Rights of the data subject
If the legal requirements are met, you have the following rights under Articles 15 to 20 GDPR: Right to information, to correction, to erasure, to restriction of processing, to data portability.
In addition, pursuant to Article 21 (1) GDPR, you have the right to object to processing based on Article 6 (1) f GDPR and to processing for direct marketing purposes.
Contact us on request. The contact details can be found in our imprint.
Right to lodge a complaint with the supervisory authority
In accordance with Article 77 GDPR, you have the right to complain to the supervisory authority if you believe that the processing of your personal data is not lawful.
Right to object
If the personal data processing listed here is based on our legitimate interest pursuant to Art. 6 para. 1 lit. f GDPR, you have the right to object to this processing at any time with effect for the future for reasons arising from your particular situation.
Shipping terms
We ship your order after we received them
for articles on hand latest 24 hours,
for articles with overnight supply latest 48 hours.
In case we need to order an article from our supplier our dispatch time depends on the reception date of the articles, but the articles will be shipped on the same day.
Our goal is to send the ordered articles in the fastest, but also most efficient and secure way to our customers.