Continuum Knowledge Bank Continuum Applications

Continuum Knowledge Bank Continuum Applications

Introduction
Creation of Environment
Huggingface Hub
Download the dataset
Downloading models
Configuration for Training
Datasets
Model Selection - General
Phi 2.0
Llama2
Llama3
Special Tokens
Prompt Construction for Fine-Tuning Large Language Models
Memory-Efficient Fine-Tuning Techniques for Large Language Models
Training Ideas around Hyperparameters
- Hugging Face documentation on loading PEFT
After fine tuning LLama3
Merging Model Weights
Merge Lora Instructions
Axolotl Configuration Files
Axolotl Fine-Tuning Tips & Tricks: A Comprehensive Guide
Axolotl debugging guide
Hugging Face Hub API
NCCL
Training Phi 1.5 - Youtube
JSON (JavaScript Object Notation)
General Tips
Datasets

Powered by GitBook

This documentation is for the Axolotl community

On this page

From hu-po
Fine Tuning Phi 1_5 with PEFT and QLoRA - Large Language Model with PyTorch
Textbooks Are All You Need

Was this helpful?

Training Phi 1.5 - Youtube

Great Youtube videos

PreviousNCCL NextJSON (JavaScript Object Notation)

Last updated 7 months ago

From hu-po

Fine Tuning Phi 1_5 with PEFT and QLoRA - Large Language Model with PyTorch

Textbooks Are All You Need

Page cover image