Blog

Passing the Torch: Training a Mamba Model for Smooth Handover

We present our explorations on training language models based on the new Mamba architecture, which deviates from the traditional Transformer architecture.

LightOn AI Meetup Creating a Large Dataset for Pretraining LLMs

Partenariat LightOn & Orange Business

Orange Business, LightOn et HPE s'associent pour offrir des solutions d'IA générative de confiance

Elevating Enterprise AI: Paradigm and Key Insights

WAICF 2024

The Magic of Tokens in Generative AI: A Deep Dive

Turning Up the Heat: The Role of Temperature in Generative AI

Unlock the Potential of Prompt Tuning with Paradigm by LightOn

The Powerhouse Behind Artificial Intelligence: Why GPUs Are Essential for Large Language Models

Fine-tuning vs. Efficient Fine-tuning: A Business Lens on AI Optimization with LightOn's Solutions