Transformer models not suitable for AI agents
AI21 CEO Ori Goshen criticizes Transformer models as unsuitable for AI agents. They are too expensive and inefficient, Goshen told VentureBeat in an interview. Alternatives like Mamba and Jamba offer faster inference times and longer context. This makes them more suitable for agents that need to access multiple models. Goshen attributes the lack of reliability …