Instructions to use INSAIT-Institute/Zephyr-7B-MixAT-GCG with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use INSAIT-Institute/Zephyr-7B-MixAT-GCG with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("HuggingFaceH4/zephyr-7b-beta") model = PeftModel.from_pretrained(base_model, "INSAIT-Institute/Zephyr-7B-MixAT-GCG") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -8,7 +8,7 @@ license: apache-2.0
|
|
| 8 |
|
| 9 |

|
| 10 |
|
| 11 |
-
This is a model adapter for [HuggingFaceH4/zephyr-7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta), fine-tuned using the MixAT
|
| 12 |
|
| 13 |
|
| 14 |
## Use in 🤗 PEFT and Transformers (Quantized)
|
|
|
|
| 8 |
|
| 9 |

|
| 10 |
|
| 11 |
+
This is a model adapter for [HuggingFaceH4/zephyr-7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta), fine-tuned using the MixAT+GCG method. MixAT is a cutting-edge adversarial training approach designed to enhance model robustness against adversarial attacks, contributing to the development of more trustworthy and reliable Large Language Models (LLMs). For details, see our paper [MixAT: Combining Continuous and Discrete Adversarial Training for LLMs](https://arxiv.org/abs/2505.16947). Training and evaluation code is available in the [MixAT Github repository](https://github.com/insait-institute/MixAT).
|
| 12 |
|
| 13 |
|
| 14 |
## Use in 🤗 PEFT and Transformers (Quantized)
|