LightOn Pulse #1 Every Friday at LightOn, our demomeeting is a special moment where we share the latest advancements of our flagship product, Paradigm. Let'sopen the doors of this meeting to give you an exclusive look... Jul 21, 2024
Training Mamba Models on AMD MI250/MI250X GPUs with Custom Kernels TL;DR As the hardware landscape is becoming less homogenous and the access to GPU more intricate, what about making LLM training hardware-agnostic ? Training models on AMD hardware is becoming increas... GPU Mamba R&D hardware Jul 19, 2024
LightOn delivers an Artificial Intelligence solution with support from Hewlett Packard Enterprise Paris, July 17, 2024 - LightOn, a French deeptech company specializing in generative AI for enterprises, Today announced that it is collaborating with Hewlett Packard Enterprise (HPE) to develop a joi... Generative AI Paradigm hardware Jul 17, 2024
Transforming LLMs into Agents for Enterprise Automation In just a few months since the rise of transformer-based models, Large Language Models have demonstrated their stunning ability to engage in human-like conversations, revolutionizing business producti... Agents Generative AI Jun 25, 2024
Passing the Torch: Training a Mamba Model for Smooth Handover TL;DR We experiment with the Warmup-Stable-Decay (WSD) learning rate scheduler and a novel positional weighting of the loss for language model pre-training; We find that WSD outperforms the cosine sch... research technical Apr 10, 2024
LightOn AI Meetup Creating a Large Dataset for Pretraining LLMs This summary presents the key takeaways from a video featuring Guilherme Penedo from Hugging Face, discussing various aspects of training large language models (LLMs) and utilizing them effectively. L... Mar 22, 2024
Partnership LightOn & Orange Business Orange Business and LightOn launched a new offer for end-to-end and trusted generative AI projects in France. This strategic partnership between Orange Business, LightOn, and HPE, a leader in hybrid c... Mar 19, 2024
Elevating Enterprise AI: Paradigm and Key Insights The World AI Cannes Festival (WAICF) 2024 offered the ideal setting for LightOn to present Paradigm , a cutting-edge Generation AI (GenAI) software platform tailored for the enterprise sector. This un... Feb 15, 2024
Navigating Data Privacy and Compliance with LightOn's Innovative Large Language Model Factory In the rapidly evolving digital landscape, data privacy and compliance are paramount, especially when harnessing the power of Large Language Models (LLMs) to drive insights and innovation. LightOn ste... Dec 8, 2023
Introducing Alfred-40B-1023: We are thrilled to unveil Alfred-40B-1023, the latest iteration of our celebrated open-source Language Model. Building on the solid foundation of its predecessor, Alfred-40B-1023 represents a signific... Nov 17, 2023
Docaposte launches its 1st sovereign generative AI solution in partnership with French players LightOn, Aleia, and NumSpot. Docaposte, a key player in digital trust and a subsidiary of La Poste Group, joins forces with LightOn, Aleia, and NumSpot to offer its first sovereign and industrial generative AI solution. Available... Generative AI Oct 24, 2023
Task Factory: When Generative AI Transforms Business Productivity Once upon a time, in the bustling world of business, there were Chief Digital Officers and Chief Innovation Officers burdened with the significant task of answering the question: How do I deploy gener... Oct 6, 2023