model

CodeLlama 7B

modelactiveprovisionalcodellama-7b-619d64ff·1 events·first seen 15d ago

Aliases: CodeLlama 7B

Co-occurring entities

Mistral AI MT-Bench Mistral 7B Instruct v0.2 Sliding Window Attention FlashAttention-3 Llama 2 Mistral 7B CoreWeave MMLU HuggingFace Grouped-Query Attention vLLM

More like this (12)

Code Llama Llama 1B BioLlama3 Meta Llama 3.1 405B Llama 3.3 70B Instruct Mathstral 7B Llama3-8B-Instruct Llama-3 Llama 3.2 11B Vision Code2LoRA Meta Llama llama.cpp

Recent events (1)

8Mistral Ai News·15d ago·source ↗

Mistral 7B: Open-Weights 7B Model Outperforming Llama 2 13B

Mistral AI released Mistral 7B, a 7.3B parameter language model under the Apache 2.0 license that outperforms Llama 2 13B across all evaluated benchmarks and approaches Llama 34B on many tasks. The model employs Grouped-Query Attention (GQA) for faster inference and Sliding Window Attention (SWA) to handle longer sequences at reduced cost, achieving roughly 2x speed improvement at 16k sequence length. A fine-tuned chat variant, Mistral 7B Instruct, outperforms all 7B chat models on MT-Bench and is competitive with 13B-class chat models. The release includes deployment support for AWS, GCP, Azure, HuggingFace, and local use via vLLM.

Long Context Evolution Frontier Model Releases Mistral AI MT-Bench Mistral 7B Instruct v0.2 +13 more