# Axolotl Training Platform

## Axolotl Library

- [Introduction](https://axolotl.continuumlabs.pro/introduction.md)
- [Creation of Environment](https://axolotl.continuumlabs.pro/creation-of-environment.md): This documentation has been prepared to assist the implementation of the Axolotl training and fine tuning platform
- [Platform Installation](https://axolotl.continuumlabs.pro/creation-of-environment/platform-installation.md): The next step after ensuring NVIDIA Drivers and Enviornment are stable and compatible
- [Axolotl Dependencies](https://axolotl.continuumlabs.pro/creation-of-environment/axolotl-dependencies.md): The libraries contained within the axolotl virtual environment
- [setup.py objectives](https://axolotl.continuumlabs.pro/creation-of-environment/setup.py-objectives.md): Decomposition
- [script analysis](https://axolotl.continuumlabs.pro/creation-of-environment/setup.py-objectives/script-analysis.md)
- [Huggingface Hub](https://axolotl.continuumlabs.pro/huggingface-hub.md): Link to Huggingface Hub for acess to Models and Datasets
- [Download the dataset](https://axolotl.continuumlabs.pro/download-the-dataset.md): Once the model has been downloaded, the dataset is next
- [Types of Dataset Structures](https://axolotl.continuumlabs.pro/download-the-dataset/types-of-dataset-structures.md): Formats and Customizations
- [Structuring Datasets for Fine-Tuning Large Language Models](https://axolotl.continuumlabs.pro/download-the-dataset/structuring-datasets-for-fine-tuning-large-language-models.md)
- [Downloading Huggingface Datasets](https://axolotl.continuumlabs.pro/download-the-dataset/downloading-huggingface-datasets.md): Downloading methods
- [Use Git to download dataset](https://axolotl.continuumlabs.pro/download-the-dataset/use-git-to-download-dataset.md): Using git to download the datasets
- [Popular Datasets](https://axolotl.continuumlabs.pro/download-the-dataset/popular-datasets.md)
- [Download cleaned Alpaca dataset](https://axolotl.continuumlabs.pro/download-the-dataset/download-cleaned-alpaca-dataset.md): Test the engines
- [Template-free prompt construction](https://axolotl.continuumlabs.pro/download-the-dataset/template-free-prompt-construction.md): Sourced from the Axolotl documentation with permission
- [Downloading models](https://axolotl.continuumlabs.pro/downloading-models.md): General Introduction
- [Phi 2.0 details](https://axolotl.continuumlabs.pro/downloading-models/phi-2.0-details.md): Introductory fine tuning exercise
- [Downloading Phi 2.0](https://axolotl.continuumlabs.pro/downloading-models/downloading-phi-2.0.md)
- [Available Models](https://axolotl.continuumlabs.pro/downloading-models/available-models.md): Base Model + Model Type + Tokenizer Type
- [Configuration for Training](https://axolotl.continuumlabs.pro/configuration-for-training.md): Base Model + Model Type + Tokenizer Type
- [Datasets](https://axolotl.continuumlabs.pro/datasets.md)
- [Model Selection - General](https://axolotl.continuumlabs.pro/model-selection-general.md)
- [Phi 2.0](https://axolotl.continuumlabs.pro/phi-2.0.md)
- [Phi 2.0 - Model Configuration](https://axolotl.continuumlabs.pro/phi-2.0/phi-2.0-model-configuration.md)
- [Phi 2.0 - Model Quantization](https://axolotl.continuumlabs.pro/phi-2.0/phi-2.0-model-quantization.md)
- [Phi 2.0 - Data Loading and Paths](https://axolotl.continuumlabs.pro/phi-2.0/phi-2.0-data-loading-and-paths.md)
- [Phi 2.0 - Sequence Configuration](https://axolotl.continuumlabs.pro/phi-2.0/phi-2.0-sequence-configuration.md)
- [Phi 2.0 - Lora Configuration](https://axolotl.continuumlabs.pro/phi-2.0/phi-2.0-lora-configuration.md)
- [Phi 2.0 - Logging](https://axolotl.continuumlabs.pro/phi-2.0/phi-2.0-logging.md)
- [Phi 2.0 - Training Configuration](https://axolotl.continuumlabs.pro/phi-2.0/phi-2.0-training-configuration.md)
- [Phi 2.0 - Data and Precision](https://axolotl.continuumlabs.pro/phi-2.0/phi-2.0-data-and-precision.md)
- [Phi 2.0 - Optimisations](https://axolotl.continuumlabs.pro/phi-2.0/phi-2.0-optimisations.md)
- [Phi 2.0 - Extra Hyperparameters](https://axolotl.continuumlabs.pro/phi-2.0/phi-2.0-extra-hyperparameters.md)
- [Phi 2.0 - All Configurations](https://axolotl.continuumlabs.pro/phi-2.0/phi-2.0-all-configurations.md)
- [Phi 2.0 - Preprocessing](https://axolotl.continuumlabs.pro/phi-2.0/phi-2.0-preprocessing.md)
- [Phi 2.0 - Training](https://axolotl.continuumlabs.pro/phi-2.0/phi-2.0-training.md)
- [Uploading Models](https://axolotl.continuumlabs.pro/phi-2.0/uploading-models.md)
- [Llama2](https://axolotl.continuumlabs.pro/llama2.md)
- [Llama2 - Model Configuration](https://axolotl.continuumlabs.pro/llama2/llama2-model-configuration.md)
- [Llama2 - Model Quantization](https://axolotl.continuumlabs.pro/llama2/llama2-model-quantization.md)
- [Llama2 - Data Loading and Paths](https://axolotl.continuumlabs.pro/llama2/llama2-data-loading-and-paths.md)
- [Llama2 - Sequence Configuration](https://axolotl.continuumlabs.pro/llama2/llama2-sequence-configuration.md)
- [Llama2 - Lora Configuration](https://axolotl.continuumlabs.pro/llama2/llama2-lora-configuration.md)
- [Llama2 - Logging](https://axolotl.continuumlabs.pro/llama2/llama2-logging.md)
- [Llama2 - Training Configuration](https://axolotl.continuumlabs.pro/llama2/llama2-training-configuration.md)
- [Llama2 - Data and Precision](https://axolotl.continuumlabs.pro/llama2/llama2-data-and-precision.md)
- [Llama2 - Optimisations](https://axolotl.continuumlabs.pro/llama2/llama2-optimisations.md)
- [Llama2 - Extra Hyperparameters](https://axolotl.continuumlabs.pro/llama2/llama2-extra-hyperparameters.md)
- [Llama2- All Configurations](https://axolotl.continuumlabs.pro/llama2/llama2-all-configurations.md)
- [Llama2 - Training Configuration](https://axolotl.continuumlabs.pro/llama2/llama2-training-configuration-1.md)
- [Llama2 - Preprocessing](https://axolotl.continuumlabs.pro/llama2/llama2-preprocessing.md)
- [Llama2 - Training](https://axolotl.continuumlabs.pro/llama2/llama2-training.md)
- [Llama3](https://axolotl.continuumlabs.pro/llama3.md)
- [Downloading the model](https://axolotl.continuumlabs.pro/llama3/downloading-the-model.md)
- [Analysis of model files](https://axolotl.continuumlabs.pro/llama3/analysis-of-model-files.md)
- [Model Analysis - Configuration Parameters](https://axolotl.continuumlabs.pro/llama3/analysis-of-model-files/model-analysis-configuration-parameters.md)
- [Model Analysis - Safetensors](https://axolotl.continuumlabs.pro/llama3/analysis-of-model-files/model-analysis-safetensors.md)
- [Tokenizer Configuration Files](https://axolotl.continuumlabs.pro/llama3/analysis-of-model-files/tokenizer-configuration-files.md)
- [Model Analysis - tokenizer.json](https://axolotl.continuumlabs.pro/llama3/analysis-of-model-files/tokenizer-configuration-files/model-analysis-tokenizer-json.md): tokenizer.json
- [Model Analysis - Special Tokens](https://axolotl.continuumlabs.pro/llama3/analysis-of-model-files/tokenizer-configuration-files/model-analysis-special-tokens.md): tokenizer\_config.json
- [Llama3 - Model Configuration](https://axolotl.continuumlabs.pro/llama3/llama3-model-configuration.md)
- [Llama3 - Model Quantization](https://axolotl.continuumlabs.pro/llama3/llama3-model-quantization.md)
- [Llama3 - Data Loading and Paths](https://axolotl.continuumlabs.pro/llama3/llama3-data-loading-and-paths.md)
- [Llama3 - Sequence Configuration](https://axolotl.continuumlabs.pro/llama3/llama3-sequence-configuration.md)
- [Llama3 - Lora Configuration](https://axolotl.continuumlabs.pro/llama3/llama3-lora-configuration.md)
- [Llama3 - Logging](https://axolotl.continuumlabs.pro/llama3/llama3-logging.md)
- [Llama3 - Training Configuration](https://axolotl.continuumlabs.pro/llama3/llama3-training-configuration.md)
- [Llama3 - Data and Precision](https://axolotl.continuumlabs.pro/llama3/llama3-data-and-precision.md)
- [Llama3 - Optimisations](https://axolotl.continuumlabs.pro/llama3/llama3-optimisations.md)
- [Llama3 - Extra Hyperparameters](https://axolotl.continuumlabs.pro/llama3/llama3-extra-hyperparameters.md)
- [Llama3- All Configurations](https://axolotl.continuumlabs.pro/llama3/llama3-all-configurations.md)
- [Llama3 - Preprocessing](https://axolotl.continuumlabs.pro/llama3/llama3-preprocessing.md)
- [Llama3 - Training](https://axolotl.continuumlabs.pro/llama3/llama3-training.md)
- [Full Fine Tune](https://axolotl.continuumlabs.pro/llama3/full-fine-tune.md)
- [Special Tokens](https://axolotl.continuumlabs.pro/special-tokens.md)
- [Prompt Construction for Fine-Tuning Large Language Models](https://axolotl.continuumlabs.pro/prompt-construction-for-fine-tuning-large-language-models.md)
- [Memory-Efficient Fine-Tuning Techniques for Large Language Models](https://axolotl.continuumlabs.pro/memory-efficient-fine-tuning-techniques-for-large-language-models.md)
- [Training Ideas around Hyperparameters](https://axolotl.continuumlabs.pro/training-ideas-around-hyperparameters.md)
- [Hugging Face documentation on loading PEFT](https://axolotl.continuumlabs.pro/training-ideas-around-hyperparameters/hugging-face-documentation-on-loading-peft.md)
- [After fine tuning LLama3](https://axolotl.continuumlabs.pro/after-fine-tuning-llama3.md)
- [Merging Model Weights](https://axolotl.continuumlabs.pro/merging-model-weights.md)
- [Merge Lora Instructions](https://axolotl.continuumlabs.pro/merge-lora-instructions.md): merge\_lora
- [Axolotl Configuration Files](https://axolotl.continuumlabs.pro/axolotl-configuration-files.md)
- [Configuration Options](https://axolotl.continuumlabs.pro/axolotl-configuration-files/configuration-options.md): Sourced from the Axolotl documentation
- [Model Configuration](https://axolotl.continuumlabs.pro/axolotl-configuration-files/model-configuration.md): Model Configuration
- [Data Loading and Processing](https://axolotl.continuumlabs.pro/axolotl-configuration-files/data-loading-and-processing.md)
- [Sequence Configuration](https://axolotl.continuumlabs.pro/axolotl-configuration-files/sequence-configuration.md)
- [Lora Configuration](https://axolotl.continuumlabs.pro/axolotl-configuration-files/lora-configuration.md)
- [Logging](https://axolotl.continuumlabs.pro/axolotl-configuration-files/logging.md): Weights and Biases
- [Training Configuration](https://axolotl.continuumlabs.pro/axolotl-configuration-files/training-configuration.md)
- [Augmentation Techniques](https://axolotl.continuumlabs.pro/axolotl-configuration-files/augmentation-techniques.md)
- [Axolotl Fine-Tuning Tips & Tricks: A Comprehensive Guide](https://axolotl.continuumlabs.pro/axolotl-fine-tuning-tips-and-tricks-a-comprehensive-guide.md): tips and tricks from the community
- [Axolotl debugging guide](https://axolotl.continuumlabs.pro/axolotl-debugging-guide.md)
- [Hugging Face Hub API](https://axolotl.continuumlabs.pro/hugging-face-hub-api.md)
- [NCCL](https://axolotl.continuumlabs.pro/nccl.md): Troubleshooting NCCL issues from the Axolotl documentation
- [Training Phi 1.5 - Youtube](https://axolotl.continuumlabs.pro/training-phi-1.5-youtube.md): Great Youtube videos
- [JSON (JavaScript Object Notation)](https://axolotl.continuumlabs.pro/json-javascript-object-notation.md)
- [General Tips](https://axolotl.continuumlabs.pro/general-tips.md)
- [Datasets](https://axolotl.continuumlabs.pro/datasets-1.md)