Extracted LoRA (mergekit)
Collection
PEFT-compatible LoRA adapters produced by mergekit-extract-lora • 17 items • Updated • 4
How to use ngxson/LoRA-Qwen2.5-14B-Instruct-abliterated-v2 with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("ngxson/LoRA-Qwen2.5-14B-Instruct-abliterated-v2", dtype="auto")How to use ngxson/LoRA-Qwen2.5-14B-Instruct-abliterated-v2 with PEFT:
Task type is invalid.
This is a LoRA extracted from a language model. It was extracted using mergekit.
This LoRA adapter was extracted from huihui-ai/Qwen2.5-14B-Instruct-abliterated-v2 and uses Qwen/Qwen2.5-14B as a base.
The following command was used to extract this LoRA adapter:
mergekit-extract-lora huihui-ai/Qwen2.5-14B-Instruct-abliterated-v2 Qwen/Qwen2.5-14B OUTPUT_PATH --rank=64 --device=cuda