Yoav Shoham Avatar

Yoav Shoham

1 episode

Practical AI Practical AI #266

Mamba & Jamba

Play
2024-04-24T15:45:00Z #ai +1 🎧 21,329

First there was Mamba… now there is Jamba from AI21. This is a model that combines the best non-transformer goodness of Mamba with good ‘ol attention layers. This results in a highly performant and efficient model that AI21 has open sourced! We hear all about it (along with a variety of other LLM things) from AI21’s co-founder Yoav.

Player art
  0:00 / 0:00