| auto-gptq | See expandable |
| packaging | A library for parsing, comparing, and manipulating version numbers and version specifiers |
| peft | A library for efficient fine-tuning of large language models using parameter-efficient techniques like adapter modules and prefix tuning. |
| transformers | Huggingface Transformer library |
| tokenizers | A fast and efficient tokenization library for NLP tasks |
| bitsandbytes | A library for quantization and compression techniques in deep learning models. |
| accelerate | A library for simplifying distributed training and mixed precision training in PyTorch |
| deepspeed | A deep learning optimization library for training large models efficiently, providing techniques like ZeRO (Zero Redundancy Optimizer). |
| pydantic | A library for data validation and settings management using Python type annotations |
| addict | A dictionary library that allows accessing nested dictionaries using dot notation |
| fire | A Python library by Google that automatically generates command-line interfaces (CLIs) from Python code. |
| PyYAML | A YAML parser and emitter for Python, used for serializing and deserialising YAML data. |
| datasets | A library providing a unified interface for loading and manipulating datasets in NLP and machine learning. |
| flash-attn | A library for fast and memory-efficient attention mechanisms in transformer models. |
| sentencepiece | A tokenization library for subword tokenization and byte-pair encoding (BPE) |
| wandb | A tool for visualising and tracking machine learning experiments, making it easier to share results and progress. |
| einops | Provides a more readable and flexible way to write tensor operations in deep learning models. |
| xformers | library for efficient transformer implementations and attention mechanisms |
| optimum | A library for optimizing and quantizing transformer models for deployment |
| hf_transfer | A library for transfer learning and fine-tuning models from the Hugging Face ecosystem |
| colorama | A Python module for producing colored terminal text and cursor positioning on multiple platforms. |
| numba | A high-performance Python compiler that accelerates computation by generating native machine code. |
| numpy | A package for scientific computing with Python, widely used for multi-dimensional array and matrix processing. |
| bert-score==0.3.13 | A specific version of a library that provides an evaluation metric for text generation. |
| evaluate==0.4.0 | An unknown library, possibly related to model evaluation or metrics. |
| rouge-score==0.1.2 | A specific version of a library used for evaluating summarization and other text generation tasks by comparing against reference texts. |
| scipy | A Python library used for scientific and technical computing, offering modules for optimization, integration, and statistics. |
| scikit-learn | A popular machine learning library in Python, known for its easy-to-use API and performance in classification, regression, and clustering algorithms. |
| pynvml | A Python wrapper for NVIDIA Management Library, used for monitoring and managing NVIDIA GPU devices. |
| art | An unknown library, potentially related to ASCII art rendering or similar artistic transformations in text. |
| fschat | A library for building chatbots and conversational AI systems |
| gradio | An easy-to-use library to rapidly create UIs for machine learning models, enabling quick prototyping and sharing of ML models. |
| tensorboard | A visualization toolkit for machine learning experimentation, providing metrics and visualizations for TensorFlow projects. |
| s3fs | A Pythonic file interface to S3, allowing easy interaction with Amazon S3 buckets as if they are local files. |
| gcsfs | A Pythonic file system interface to Google Cloud Storage, similar in functionality to s3fs but for Google's cloud storage solution. |
| mamba-ssm | A library for secure secret management in Python |
| trl | A library for reinforcement learning in transformers |
| zstandard | A compression library providing a fast and efficient compression algorithm |
| fastcore | A library of core utilities for fast.ai, a deep learning library |