A
aditya gupta
Guest
- What is Language AI?
- What is a Large Language Model?
- What are common applications of LLMs?
- How can we use them ourselves?
What is Language AI?Artificial Intelligence (AI) is a computer system designed to perform tasks that usually require human intelligence.
Examples include:
Speech recognition (e.g., Siri, Alexa)
Language translation (e.g., Google Translate)
Visual perception (e.g., object detection in images)
Single Sentence: Intelligent Machine == AI == Intelligent Computer ProgramLanguage AI = Natural Language Processing (NLP)
Example of Language AI
Language is a tricky concept for computers. Text is unstructured data and loses meaning when represented in 0s and 1s.
Language as Pack of Words
The first step in processing text is to split a sentence into words or subwords (tokenization).
Some common tokenization methods:
- Splitting on whitespace
- Creating individual words
However, these methods have disadvantages. For example, some languages donβt use whitespace, making simple tokenization difficult. i.e Mandarin
Will update soon....
Continue reading...
