Axolotl Dependencies
The libraries contained within the axolotl virtual environment
Library/Package | Description |
---|---|
auto-gptq | See expandable |
packaging | A library for parsing, comparing, and manipulating version numbers and version specifiers |
peft | A library for efficient fine-tuning of large language models using parameter-efficient techniques like adapter modules and prefix tuning. |
transformers | Huggingface Transformer library |
tokenizers | A fast and efficient tokenization library for NLP tasks |
bitsandbytes | A library for quantization and compression techniques in deep learning models. |
accelerate | A library for simplifying distributed training and mixed precision training in PyTorch |
deepspeed | A deep learning optimization library for training large models efficiently, providing techniques like ZeRO (Zero Redundancy Optimizer). |
pydantic | A library for data validation and settings management using Python type annotations |
addict | A dictionary library that allows accessing nested dictionaries using dot notation |
fire | A Python library by Google that automatically generates command-line interfaces (CLIs) from Python code. |
PyYAML | A YAML parser and emitter for Python, used for serializing and deserialising YAML data. |
datasets | A library providing a unified interface for loading and manipulating datasets in NLP and machine learning. |
flash-attn | A library for fast and memory-efficient attention mechanisms in transformer models. |
sentencepiece | A tokenization library for subword tokenization and byte-pair encoding (BPE) |
wandb | A tool for visualising and tracking machine learning experiments, making it easier to share results and progress. |
einops | Provides a more readable and flexible way to write tensor operations in deep learning models. |
xformers | library for efficient transformer implementations and attention mechanisms |
optimum | A library for optimizing and quantizing transformer models for deployment |
hf_transfer | A library for transfer learning and fine-tuning models from the Hugging Face ecosystem |
colorama | A Python module for producing colored terminal text and cursor positioning on multiple platforms. |
numba | A high-performance Python compiler that accelerates computation by generating native machine code. |
numpy | A package for scientific computing with Python, widely used for multi-dimensional array and matrix processing. |
bert-score==0.3.13 | A specific version of a library that provides an evaluation metric for text generation. |
evaluate==0.4.0 | An unknown library, possibly related to model evaluation or metrics. |
rouge-score==0.1.2 | A specific version of a library used for evaluating summarization and other text generation tasks by comparing against reference texts. |
scipy | A Python library used for scientific and technical computing, offering modules for optimization, integration, and statistics. |
scikit-learn | A popular machine learning library in Python, known for its easy-to-use API and performance in classification, regression, and clustering algorithms. |
pynvml | A Python wrapper for NVIDIA Management Library, used for monitoring and managing NVIDIA GPU devices. |
art | An unknown library, potentially related to ASCII art rendering or similar artistic transformations in text. |
fschat | A library for building chatbots and conversational AI systems |
gradio | An easy-to-use library to rapidly create UIs for machine learning models, enabling quick prototyping and sharing of ML models. |
tensorboard | A visualization toolkit for machine learning experimentation, providing metrics and visualizations for TensorFlow projects. |
s3fs | A Pythonic file interface to S3, allowing easy interaction with Amazon S3 buckets as if they are local files. |
gcsfs | A Pythonic file system interface to Google Cloud Storage, similar in functionality to |
mamba-ssm | A library for secure secret management in Python |
trl | A library for reinforcement learning in transformers |
zstandard | A compression library providing a fast and efficient compression algorithm |
fastcore | A library of core utilities for fast.ai, a deep learning library |
Last updated