Llama 1 (February 2023)
| Parameter Size | Context Window | Key Features |
|---|---|---|
| 7B, 13B, 33B, 65B | 2048 tokens |
|
Notable Achievements:
- Comparable performance to GPT-3 with significantly fewer parameters
- Sparked a wave of open-source AI development and fine-tuning projects
Llama 2 (July 2023)
| Parameter Size | Context Window | Key Features |
|---|---|---|
| 7B, 13B, 70B | 4096 tokens |
|
Improvements:
- 40% more training data than Llama 1
- 2x longer context window (4096 tokens vs 2048)
- Constitutional AI techniques applied for better alignment
- Llama 2 Chat versions fine-tuned with over 1 million human annotations
Code Llama (August 2023 - January 2024)
| Parameter Size | Context Window | Key Features |
|---|---|---|
| 7B, 13B, 34B, 70B | 4096 tokens |
|
Capabilities:
- Code completion
- Code generation from natural language descriptions
- Code explanation and debugging
- Support for 20+ programming languages including Python, C++, Java, PHP, Typescript, C#, Bash
Llama 3 (April 2024)
| Parameter Size | Context Window | Key Features |
|---|---|---|
| 8B, 70B | 8192 tokens |
|
Planned Future Developments:
- Multimodal capabilities (text, image, audio)
- Expanded multilingual support
- Extended context window
- Overall performance enhancements across various tasks
Provide Feedback For This Article
We take your feedback seriously and use it to improve our content. Thank you for helping us serve you better!
😊 Thanks for your time, your feedback has been registered!
Comments & Discussion
Facing issues? Have questions? Post them here! We're happy to help!