Lab city, Israel
Tel Aviv
AI21 Labs, maker of the Jurassic and Jamba models, and research offices of the large US companies.
Tel Aviv is the centre of Israel's technology industry and home to AI21 Labs, founded in 2017 by Stanford professor Yoav Shoham, Ori Goshen and Mobileye co-founder Amnon Shashua. AI21 was one of the first companies outside the big US labs to train very large models, and Google, Meta, Microsoft and Nvidia run research teams in the city and nearby.
Jurassic and Jamba
AI21 released Jurassic-1 in August 2021 with 178 billion parameters, slightly more than GPT-3, and later its Jurassic-2 models. In March 2024 it released Jamba, one of the first production models to mix transformer layers with Mamba state-space layers and a mixture of experts, with open weights and a context of 256,000 tokens. AI21 also built Wordtune, a writing assistant.
Research and Hebrew
Israeli researchers have long worked on natural language processing at Tel Aviv University, the Technion in Haifa, Bar-Ilan and the Hebrew University. IBM Research in Haifa built Project Debater, which argued live against a human champion in 2019. Hebrew-specific models such as DictaLM, from the Dicta centre in Jerusalem, aim to do better in Hebrew than general models.