LightOn AI

Team

company

Verified

https://lighton.ai

LightOnIO

lightonai

AI & ML interests

None defined yet.

Recent Activity

furtherai published a dataset about 1 hour ago

lightonai/lc_pdfs

raphaelsty updated a dataset about 13 hours ago

lightonai/embeddings-pre-training

staghado new activity about 13 hours ago

lightonai/LightOnOCR-1B-1025:Adding `transformers` as the library

View all activity

Articles

LightOnOCR-1B: The Case for End-to-End and Efficient Domain-Specific Vision-Language Models for OCR

Seq vs Seq: the Ettin Suite of Paired Encoders and Decoders

Finally, a Replacement for BERT: Introducing ModernBERT

furtherai

published a dataset about 1 hour ago

lightonai/lc_pdfs

Updated about 1 hour ago

raphaelsty

updated a dataset about 13 hours ago

lightonai/embeddings-pre-training

Viewer • Updated about 13 hours ago • 1.38B • 2.46k • 14

staghado

in lightonai/LightOnOCR-1B-1025 about 13 hours ago

Adding `transformers` as the library

#10 opened about 16 hours ago by

How to run inference without vLLM? (e.g., with standard transformers)

#1 opened 13 days ago by

staghado

in lightonai/LightOnOCR-1B-1025 1 day ago

remove base_model metadata

#9 opened 1 day ago by

MaxLSB

authored a paper 21 days ago

Luth: Efficient French Specialization for Small Language Models and Cross-Lingual Transfer

Paper • 2510.05846 • Published 29 days ago • 2

NohTow

authored 2 papers 4 months ago

Seq vs Seq: An Open Suite of Paired Encoders and Decoders

Paper • 2507.11412 • Published Jul 15 • 28

BioClinical ModernBERT: A State-of-the-Art Long-Context Encoder for Biomedical and Clinical NLP

Paper • 2506.10896 • Published Jun 12 • 4

MaxLSB

authored a paper 4 months ago

Splitformer: An improved early-exit architecture for automatic speech recognition on edge devices

Paper • 2506.18035 • Published Jun 22

ohallstrom

authored a paper 11 months ago

Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference

Paper • 2412.13663 • Published Dec 18, 2024 • 157

iacolippo

authored a paper 11 months ago

Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference

Paper • 2412.13663 • Published Dec 18, 2024 • 157

NohTow

authored 3 papers 11 months ago

Multitask Prompted Training Enables Zero-Shot Task Generalization

Paper • 2110.08207 • Published Oct 15, 2021 • 2

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Paper • 2211.05100 • Published Nov 9, 2022 • 34

Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference

Paper • 2412.13663 • Published Dec 18, 2024 • 157

staghado

authored a paper 11 months ago

Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference

Paper • 2412.13663 • Published Dec 18, 2024 • 157

NohTow

authored a paper about 1 year ago

Reducing the Footprint of Multi-Vector Retrieval with Minimal Performance Impact via Token Pooling

Paper • 2409.14683 • Published Sep 23, 2024 • 12

NohTow

authored a paper over 2 years ago

Three Bricks to Consolidate Watermarks for Large Language Models

Paper • 2308.00113 • Published Jul 26, 2023 • 14

Vermifuge

authored a paper over 2 years ago

Stay on topic with Classifier-Free Guidance

Paper • 2306.17806 • Published Jun 30, 2023 • 27

iacolippo

updated a Space over 2 years ago

README