TransformerEngine
Machine-Learning Open SourceA library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.
About TransformerEngine
Supported Platforms
Related in Machine-Learning
tensorflow
An Open Source Machine Learning Framework for Everyone
prompts.chat
f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete privacy.
transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration
ML-For-Beginners
12 weeks, 26 lessons, 52 quizzes, classic Machine Learning for all