Vitor Sousa

← Back to blog

Published on 2024-10-10 08:00 by Vitor Sousa

Exploring the Differential Transformer: A Step Forward in Language Modeling

arq


microsoftdate arxiv


Introduction

Written by Vitor Sousa

← Back to blog
  • RAG with LlamaIndex, Elasticsearch and Llama3

    RAG with LlamaIndex, Elasticsearch and Llama3

    Implement Q&A using a RAG technique (Retrieval Augmented Generation) with Elasticsearch as a vector database

  • Exploring OpenELM The Intersection of Open Source and High Efficiency in AI

    Exploring OpenELM The Intersection of Open Source and High Efficiency in AI

    My analysis of OpenELM An Efficient Language Model Family with Open-source Training and Inference Framework, showcasing how Apple is pushing the boundaries of AI efficiency and accessibility.

  • Exploring the Differential Transformer A Step Forward in Language Modeling

    Exploring the Differential Transformer A Step Forward in Language Modeling

    My analysis of OpenELM An Efficient Language Model Family with Open-source Training and Inference Framework, showcasing how microsoft is pushing the boundaries of AI efficiency and accessibility.