Update README.md

README.md

@@ -12,7 +12,12 @@ widget:
 
 # Model Card for Mistral-7B-Instruct-v0.2
 
-The Mistral-7B-Instruct-v0.2 Large Language Model (LLM) is an improved instruct fine-tuned version of [Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1).
+The Mistral-7B-Instruct-v0.2 Large Language Model (LLM) is an instruct fine-tuned version of the Mistral-7B-v0.2.
+
+Mistral-7B-v0.2 has the following changes compared to Mistral-7B-v0.1
+- 32k context window (vs 8k context in v0.1)
+- Rope-theta = 1e6
+- No Sliding-Window Attention
 
 For full details of this model please read our [paper](https://arxiv.org/abs/2310.06825) and [release blog post](https://mistral.ai/news/la-plateforme/).
 
@@ -53,12 +58,6 @@ decoded = tokenizer.batch_decode(generated_ids)
 print(decoded[0])
 ```
 
-## Model Architecture
-This instruction model is based on Mistral-7B-v0.1, a transformer model with the following architecture choices:
-- Grouped-Query Attention
-- Sliding-Window Attention
-- Byte-fallback BPE tokenizer
-
 ## Troubleshooting
 - If you see the following error:
 ```