Skip to content

Welcome to the 🐶 InstructLab Project

Quick Links: Documentation | FAQ | Hugging Face | Calendar | Discord | Slack | YouTube | X | Reddit

Banner

InstructLab is an approachable open source AI community project. Our community's mission is to enable anyone to shape the future of generative AI via the collaborative improvement of open source-licensed Granite large language models (LLMs) using InstructLab's fine-tuning technology.

Who should use InstructLab?

Have you ever asked an LLM a question about a subject you know well, and it gave an incorrect answer? “If only I could submit a patch to fix it,” you may have thought. With InstructLab, you can!

InstructLab allows anyone to improve an existing LLM by fine-tuning it with additional data sources. This allows LLMs to continuously gain new knowledge, supplementing gaps in their initial training, even about current events that happened since their pre-training phase.

Subject matter experts from any domain—for example, archaeology, astronomy, and human anatomy—can use InstructLab to teach the Granite LLM family new information.

Project users can experiment with making updates to a quantized version of the Granite model and then rebuild that version locally, checking to see if the update improved the quality of the model’s responses. InstructLab’ s tools allow contributors to both see preview of a newly tuned model, and also check to ensure that a submission to improve the community model is properly composed.

You can learn more about InstructLab and how it works in the project documentation.

Where can I find more information about the LLMs created by InstructLab?

Check out InstructLab on Hugging Face.

Get started

Additional information

InstructLab uses Large-Scale Alignment for ChatBots [1] (LAB), a new alignment tuning method for LLMs that leverages synthetic data. To learn more about InstructLab’s origins, visit the About Taxonomy page.

[1] Shivchander Sudalairaj*, Abhishek Bhandwaldar*, Aldo Pareja*, Kai Xu, David D. Cox, Akash Srivastava*. "LAB: Large-Scale Alignment for ChatBots", arXiv preprint arXiv: 2403.01081, 2024. (* denotes equal contributions)

Pinned Loading

  1. instructlab Public

    InstructLab Core package. Use this to chat with a model and execute the InstructLab workflow to train a model using custom taxonomy data.

    Python 1.1k 384

  2. taxonomy Public

    Taxonomy tree that will allow you to create models tuned with your data

    Python 230 1.1k

  3. community Public

    InstructLab Community wide collaboration space including contributing, security, code of conduct, etc

    Python 80 46

  4. dev-docs Public

    Developer documents for the InstructLab organization

    Makefile 5 35

Repositories

Showing 10 of 18 repositories
  • sdg Public

    Python library for Synthetic Data Generation

    Python 32 Apache-2.0 47 70 (2 issues need help) 8 Updated Feb 12, 2025
  • ui Public

    Place to hack on UI for InstructLab

    TypeScript 23 Apache-2.0 45 57 (24 issues need help) 16 Updated Feb 12, 2025
  • rag Public
    Python 7 3 1 0 Updated Feb 12, 2025
  • community Public

    InstructLab Community wide collaboration space including contributing, security, code of conduct, etc

    Python 80 Apache-2.0 46 14 5 Updated Feb 12, 2025
  • taxonomy Public

    Taxonomy tree that will allow you to create models tuned with your data

    Python 230 Apache-2.0 1,056 5 23 Updated Feb 11, 2025
  • dev-docs Public

    Developer documents for the InstructLab organization

    Makefile 5 Apache-2.0 35 7 20 Updated Feb 11, 2025
  • docs.instructlab.ai Public

    The docs.instructlab.ai public documentation repository. PRs accepted and encouraged!

    Shell 15 18 6 5 Updated Feb 11, 2025
  • instructlab Public

    InstructLab Core package. Use this to chat with a model and execute the InstructLab workflow to train a model using custom taxonomy data.

    Python 1,146 Apache-2.0 384 278 (12 issues need help) 70 Updated Feb 11, 2025
  • website Public
    TypeScript 2 CC-BY-4.0 25 8 3 Updated Feb 11, 2025
  • .github Public

    InstructLab GitHub organization community files.

    Makefile 2 Apache-2.0 12 0 2 Updated Feb 12, 2025