Easier to read with cream paper, a tint, more contrast or larger text? Choose your colours and text, once, for every page.

Free module

Running models yourself

Learn to run models yourself, hands on: model memory, quantising, serving and batching, licences, choosing a size and self-host or rent.

6 lessons380 min lessonSoftware engineering

The lessons

Each lesson is free to read in full. Create a free account to run its commands in a live lab and to sit its quizzes and tasks.

  1. 1 · Container lab

    How much memory a model needs

    I can work out how much memory a model needs.

    Read the lesson

  2. 2 · Container lab

    What quantising a model changes

    I can say what is lost when numbers get smaller.

    Read the lesson

  3. 3 · Container lab

    How a model server batches requests

    I can describe how a server turns many requests into batches.

    Read the lesson

  4. 4 · Container lab

    Open weights and model licences

    I can read a model's licence and say what it lets me do.

    Read the lesson

  5. 5 · Container lab

    Choosing a model size for a job

    I can pick a model size for a job from a test and a price.

    Read the lesson

  6. 6 · Container lab

    Run a model yourself or rent one?

    I can decide whether to run a model myself.

    Read the lesson

Worked in a real lab

Every lesson of this module is worked in a lab started for you alone. The labs it uses:

Teaching a class? Set this module for your students with a teacher guide, marked assignments and a lab for every student.