Overview
News
Technologies
Salaries
Products
People
Growth
Financials

Overview

Coconut Mode . Kilian Haefeli, Simon Guo, Bonnie Li.

News

Blog 2 years ago
Ring Attention Explained
By Kilian Haefeli, Simon Zirui Guo, Bonnie Li Context length in Large Language Models has expanded rapidly over the last few years. From GPT 3.5's 16k tokens, to Claude 2's 200k tokens, and recently Gemini 1.5 Pro's 1 million tokens. The longer the contex
Read more
Report