🚀 Submit a Challenge — SecDim AppSec Village CTF at DEF CON 34 and Win a ROG Xbox Ally

AI Security Engineer

6h 45mIntermediateAIFeatured

This course introduces developers, engineers, and security practitioners to the OWASP LLM Top 10 and secure coding practices for LLMs. Learning Objectives: Understand the top security risks specific to LLMs. Recognise real-world attack scenarios (e.g., prompt injection,sensitive data disclosure), Learn defensive strategies and coding practices to mitigate risks, and Gain hands-on experience via the SecDim platform.

Topics

  1. Overview

    Lesson5m

    This module introduces developers, engineers, and security practitioners to the OWASP LLM Top 10 and secure coding practices for Large Language Models (LLMs).

  2. Prompt Injection

    Video20m

    Prompt injection is one of the most critical risks identified in the *OWASP LLM Top 10*.

  3. Prompt Injection Lab

    Challenge30m

    Complete this lab to learn how prompt injection works in practice

  4. Sensitive Information Disclosure

    Video15m

    Sensitive information disclosure occurs when an LLM unintentionally exposes confidential data during interaction.

  5. Information Disclosure - Challenge

    Challenge30m

    This bot is leaking secrets, let's fix it.

  6. Supply Chain Attacks

    Video15m

    Unlike traditional software, LLM development depends heavily on *third-party models and datasets*

  7. Malicious Model I - Challenge

    Challenge30m

    After loading the model, a command was executed on the machine. Let's find and fix the issue.

  8. Data and Model Poisoning

    Video15m

    Data poisoning is when an attacker sneaks bad or biased examples into the data used to train or fine-tune a model.

  9. Improper Output Handling

    Video15m

    “Improper Output Handling” refers to situations where the output from an LLM is passed downstream into web pages, system calls, code execution, SQL queries, file paths, or other components, without sufficient validation, sanitization, or context-aware handling.

  10. Improper Output - Challenge

    Challenge30m

    The output from this chatbot is executing some code. Let's find out how.

  11. Excessive Agency

    Video15m

    Excessive agency happens when the model has more powers than it needs — violating the principle of least privilege.

  12. Excessive Agency - Challenge

    Challenge30m

    This bot can do too much and in the wrong way.

  13. System Prompt Leakage

    Video15m

    System Prompt Leakage is the situation in which the “system prompt” (the hidden instructions given to a large-language-model application) is exposed either via direct extraction or indirect inference.

  14. Vector and Embedding Weaknesses

    Video20m

    Vector and embedding systems are a cornerstone of many modern LLM applications: they power semantic search, retrieval-augmented generation (RAG), similarity matching, and much more.

  15. Misinformation

    Video15m

    The models we build to assist, summarise or generate content can themselves become vectors for false, misleading or fabricated information—often with credible language and confident tone.

  16. Unbounded Consumption

    Video15m

    Unbounded Consumption is scenarios in which users or attackers consume model resources in uncontrolled ways: making unlimited inference requests, generating endless output, or triggering costly compute loops.

  17. Model DoS - Challenge

    Challenge30m

    This chatbot is burning our bill and CPU. Let's do something.

  18. Certification - OWASP LLM Top 10 Secure Developer

    Challenge30m

    To obtain the certificate, complete the following challenge.