Online Course
Finetuning with Llama

Learn to fine-tune, optimize, and deploy Llama models efficiently and responsibly with Hugging Face

4.8

864 reviews on
1 students already enrolled
  • Institute of Analytics
  • The Association of Data Scientists
  • E-Learning Quality Network
  • European Agency for Higher Education and Accreditation
  • Global Association of Online Trainers and Examiners

Skill level:

Intermediate

Duration:

2 hours
  • Lessons (2 hours)
  • Practice exams (10 minutes)

CPE credits:

4
CPE stands for Continuing Professional Education and represents the mandatory credits a wide range of professionals must earn to maintain their licenses and stay current with regulations and best practices. One CPE credit typically equals 50 minutes of learning. For more details, visit NASBA's official website: www.nasbaregistry.org

Accredited

certificate

What you learn

  • How to fine-tune Llama models with Hugging Face
  • Efficient finetuning with LoRA, QLoRA, and quantization
  • Deploying models as live APIs and applying ethical AI practices

Topics & tools

AILLMLLaMAGenerative AiLLM Fine-TuningLlama-Powered APILLM ApplicationsArtificial IntelligenceData PreprocessingMachine and Deep LearningData EngineeringIndustry SpecializationPython

Your instructor

Course OVERVIEW

Description

CPE Credits: 4 Field of Study: Information Technology
Delivery Method: QAS Self Study

In this hands-on course, you’ll learn how to fine-tune Llama models with Hugging Face from start to finish. Begin by setting up your environment and preparing datasets, then train your first model using the Trainer workflow and evaluate it with ROUGE and BERTScore. Discover efficient methods like LoRA and QLoRA, and apply quantization with BitsAndBytes to run larger models on limited hardware. Finally, deploy your fine-tuned model as a live FastAPI/ngrok-powered API, and explore ethical practices for building safe, fair, and sustainable AI. Build, optimize, and responsibly deploy your own Llama-powered applications!

Prerequisites

  • Python programming skills
  • Basic understanding of GenAI and LLMs
  • Interest in Customizing GenAI and LLMs

Curriculum

24 lessons 37 exercises 2 exams
  • 1. Introduction
    9 min

    Get inspired and discover what finetuning Llama is all about.

    9 min

    Get inspired and discover what finetuning Llama is all about.

    Welcome! Free
    Course Resources Free
  • 2. Getting Started with Finetuning
    14 min

    Learn what finetuning means, explore Llama models, and set up your Hugging Face environment.

    14 min

    Learn what finetuning means, explore Llama models, and set up your Hugging Face environment.

    What is Finetuning? Free
    Llama Overview Free
    Setting up Hugging Face Environment Free
    Exercise Free
  • 3. Data Preparation for Finetuning
    11 min

    Choose, clean, split, and tokenize datasets to create high-quality training inputs.

    11 min

    Choose, clean, split, and tokenize datasets to create high-quality training inputs.

    Choosing & Loading Datasets Free
    Preprocessing Datasets Free
    Dataset Splitting, Saving and Tokenizing Free
    Exercise Free
  • 4. Finetuning with Hugging Face
    15 min

    Run your first finetuning task, monitor training, and evaluate results with standard metrics.

    15 min

    Run your first finetuning task, monitor training, and evaluate results with standard metrics.

    Hugging Face Finetuning Workflow
    Your First Finetuning Task
    Evaluating Finetuned Models
    Exercise
  • 5. Parameter-efficient Finetuning with LoRA
    12 min

    Unlock faster, lighter finetuning using LoRA adapters for efficiency without performance loss.

    12 min

    Unlock faster, lighter finetuning using LoRA adapters for efficiency without performance loss.

    Understanding LoRA
    Using LoRA in Hugging Face
    Evaluating LoRA-finetuned Models
    Exercise
  • 6. Efficient Finetuning with Quantization
    12 min

    Apply quantization and QLoRA to train larger models on limited hardware.

    12 min

    Apply quantization and QLoRA to train larger models on limited hardware.

    Introduction to Quantization
    Applying Quantization with BitsAndBytes
    Finetuning Quantized Models with LoRA
    Exercise
  • 7. Deploying Finetuned Models
    12 min

    Deploy your Llama as a live API using FastAPI and ngrok, ready for real-world use.

    12 min

    Deploy your Llama as a live API using FastAPI and ngrok, ready for real-world use.

    Introduction to Model Deployment
    Creating a Llama-powered API
    Testing Your API
    Exercise
  • 8. Ethical Considerations & Best Practices
    10 min

    Understand fairness, bias, privacy, and responsible deployment of LLMs.

    10 min

    Understand fairness, bias, privacy, and responsible deployment of LLMs.

    Ethical Finetuning
    Responsible AI Deployment
    Exercise
  • 9. Conclusion
    6 min

    Recap your learning and find resources for exploring advanced techniques and continuing your learning journey.

    6 min

    Recap your learning and find resources for exploring advanced techniques and continuing your learning journey.

    Course Summary
    Practice exam
    Further Learning
  • 10. Course exam
    30 min
    30 min
    Course exam

Free lessons

Welcome!

1.1 Welcome!

8 min

Course Resources

1.2 Course Resources

1 min

What is Finetuning?

2.1 What is Finetuning?

4 min

Llama Overview

2.2 Llama Overview

5 min

Setting up Hugging Face Environment

2.3 Setting up Hugging Face Environment

5 min

Choosing & Loading Datasets

3.1 Choosing & Loading Datasets

4 min

Start for free

94%

of AI and data science graduates

successfully change

or advance their careers.

9 in 10

people walk away career-ready

with practical data and AI skills.

4.8

Based on 864 reviews

#1 most reviewed

AI and data learning platform on Trustpilot.

ACCREDITED certificates

Craft a resume and LinkedIn profile you’re proud of—featuring certificates recognized by leading global institutions.

Earn CPE-accredited credentials that showcase your dedication, growth, and essential skills—the qualities employers value most.

  • Institute of Analytics
  • The Association of Data Scientists
  • E-Learning Quality Network
  • European Agency for Higher Education and Accreditation
  • Global Association of Online Trainers and Examiners

Certificates are included with the Self-study learning plan.

A LinkedIn profile mockup on a mobile screen showing Parker Maxwell, a Certified Data Analyst, with credentials from 365 Data Science listed under Licenses & Certification. A 365 Data Science Certificate of Achievement awarded to Parker Maxwell for completing the Data Analyst career track, featuring accreditation badges and a gold “Verified Certificate” seal.

How it WORKS

  • Lessons
  • Exercises
  • Projects
  • Practice exams
  • AI mock interviews

Lessons

Learn through short, simple lessons—no prior experience in AI or data science needed.

Try for free

Exercises

Reinforce your learning with mini recaps, hands-on coding, flashcards, fill-in-the-blank activities, and other engaging exercises.

Try for free

Projects

Tackle real-world AI and data science projects—just like those faced by industry professionals every day.

Try for free

Practice exams

Track your progress and solidify your knowledge with regular practice exams.

Try for free

AI mock interviews

Prep for interviews with real-world tasks, popular questions, and real-time feedback.

Try for free

Student REVIEWS

A collage of student testimonials from 365 Data Science learners, featuring profile photos, names, job titles, and quotes or video play icons, showcasing diverse backgrounds and successful career transitions into AI and data science roles.