How to use Praise2112/Mistral-7B-Instruct-v0.1-int8-ct2 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Praise2112/Mistral-7B-Instruct-v0.1-int8-ct2", device_map="auto")
