Ready to explore the exciting world of generative AI and large language models (LLMs)? This IBM course, part of the Generative AI Engineering Essentials with LLMs Professional Certificate, gives you practical skills to harness AI to transform industries.



Generative AI and LLMs: Architecture and Data Preparation
This course is part of multiple programs.


Instructors: Joseph Santarcangelo
Access provided by New York State Department of Labor
20,903 already enrolled
(213 reviews)
Recommended experience
What you'll learn
Differentiate between generative AI architectures and models, such as RNNs, transformers, VAEs, GANs, and diffusion models
Describe how LLMs, such as GPT, BERT, BART, and T5, are applied in natural language processing tasks
Implement tokenization to preprocess raw text using NLP libraries like NLTK, spaCy, BertTokenizer, and XLNetTokenizer
Create an NLP data loader in PyTorch that handles tokenization, numericalization, and padding for text datasets
Skills you'll gain
Details to know

Add to your LinkedIn profile
4 assignments
See how employees at top companies are mastering in-demand skills

Build your subject-matter expertise
- Learn new concepts from industry experts
- Gain a foundational understanding of a subject or tool
- Develop job-relevant skills with hands-on projects
- Earn a shareable career certificate

There are 2 modules in this course
In this module, you will learn about the significance of generative AI models and how they are used across a wide range of fields for generating various types of content. You will learn about the architectures and models commonly used in generative AI and the differences in the training approaches of these models. You will learn how large language models (LLMs) are used to build NLP-based applications. You will build a simple chatbot using the transformers library from Hugging Face.
What's included
5 videos2 readings2 assignments1 app item3 plugins
In this module, you will learn to prepare data for training large language models (LLMs) by implementing tokenization. You will learn about the tokenization methods and the use of tokenizers. You will also learn about the purpose of data loaders and how you can use the DataLoader class in PyTorch. You will implement tokenization using various libraries such as nltk, spaCy, BertTokenizer, and XLNetTokenizer. You will also create a data loader with a collate function that processes batches of text.
What's included
2 videos5 readings2 assignments2 app items2 plugins
Earn a career certificate
Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.
Offered by
Why people choose 糖心vlog官网观看 for their career




Learner reviews
213 reviews
- 5 stars
77.16%
- 4 stars
15.52%
- 3 stars
5.02%
- 2 stars
0.91%
- 1 star
1.36%
Showing 3 of 213
Reviewed on Mar 3, 2025
this course was very beneficial with detail material and easy to understand
Reviewed on Mar 25, 2025
Too fast reading of the slides without much of explanations.
Reviewed on May 5, 2025
This is a fairly easy course, focusing on introducing the high-level concepts, without too much hands-on practices
Explore more from Data Science

Open new doors with 糖心vlog官网观看 Plus
Unlimited access to 10,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription
Advance your career with an online degree
Earn a degree from world-class universities - 100% online
Join over 3,400 global companies that choose 糖心vlog官网观看 for Business
Upskill your employees to excel in the digital economy