LCM + Mapping Hidden Embedding = New Architecture Model
Recently I have been involved in training models from multimodal to text generation taking a look at the latest techniques to train the model. Scrolling from Twitter to Youtube, I was shocked to see another major change in the world of AI.
This is because the open source multimodal next-generation infrastructure model Large Scale Conceptual Model (LCM) was announced at Meta’s.
You may be familiar with the popular LLM (Large Language Model), such as ChatGPT. Their core mechanism is to predict the next word (token). But Meta has gone big this time. Their new model LCM (Large Concept Model) does not even look at the token, but directly understands the “meaning” of the sentence!
Say goodbye to “word by word” and welcome “overall grasp”. Imagine that when we understand a sentence, do we understand its meaning directly, rather than breaking it down into individual words first? LCM is like this. It no longer analyzes “word by word” like LLM, but encodes the entire sentence or paragraph into a...
The leading AI community and content platform
The leading AI community and content platform focused on making AI accessible to all. Check out our new course platform: https://academy.towardsai.net/courses/beginner-to-advanced-llm-dev. Learn AI Agent, LLMs, RAG & Generative AI. See everything I have to offer at the link below: https://linktr.ee/GaoDalie_AI.
