ghostai1 commited on
Commit
bcebeff
Β·
verified Β·
1 Parent(s): b7d0dee

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +55 -67
README.md CHANGED
@@ -17,9 +17,10 @@ tags:
17
  - quantization
18
  - ggml
19
  - llm
 
 
20
  ---
21
-
22
- # Halloween2B-Poltergeist v1.0 (GGUF)
23
 
24
  [![License: MIT](https://img.shields.io/badge/License-MIT-green.svg)](LICENSE)
25
  [![Format: GGUF](https://img.shields.io/badge/Format-GGUF-orange)](#quantized-files)
@@ -28,69 +29,61 @@ tags:
28
  [![Hugging Face](https://img.shields.io/badge/Hugging%20Face-Model-yellow)](https://huggingface.co/ghostai1/Halloween2B-Poltergeist)
29
  [![LinkedIn](https://img.shields.io/badge/LinkedIn-ccengineering-0A66C2?logo=linkedin&logoColor=white)](https://www.linkedin.com/in/ccengineering/)
30
 
31
- **Halloween2B-Poltergeist v1.0** is a compact seasonal model tuned for **spooky, cinematic, and playful** text generation.
32
- This repository provides **GGUF** builds optimized for **local inference** with **llama.cpp** and compatible runtimes.
33
 
34
- **Quick links**
35
- - Model: https://huggingface.co/ghostai1/Halloween2B-Poltergeist
36
- - Runtime: https://github.com/ggerganov/llama.cpp
37
- - Author (LinkedIn): https://www.linkedin.com/in/ccengineering/
38
 
39
  ---
 
 
40
 
41
- ## Overview
42
-
43
- This is a **tone/personality-focused** model geared toward Halloween-themed writing and roleplay. It aims for atmosphere, pacing, and character voice over strict factual accuracy.
 
 
44
 
45
- Recommended for:
46
- - Horror microfiction, campfire stories, and urban legends
47
- - Halloween roleplay (PG-13 by default)
48
- - Haunted-house narration, quests, and NPC dialogue
49
- - Local demos and low-resource systems
50
-
51
- Not optimized for:
52
- - Complex reasoning
53
- - Factual retrieval and citations
54
- - Long-horizon planning and tool use
55
 
56
  ---
57
-
58
- ## Model Details
59
-
60
- - **Model name:** Halloween2B-Poltergeist v1.0
61
- - **Base model:** Qwen2.5-2B-Instruct
62
- - **Fine-tuning:** LoRA (adapter-based; release may be merged depending on build)
63
- - **Language:** English
64
- - **Format:** GGUF (llama.cpp compatible)
65
- - **License:** MIT (base model license applies)
66
-
67
- ### Training Snapshot (from run log)
68
-
69
- - **Trainer:** Unsloth SFTTrainer (new-style)
70
- - **Unsloth version:** 2026.1.4
71
- - **LoRA:** r=64, alpha=64
72
- - **Patched layers:** 28 (QKV=28, O=28, MLP=28)
73
- - **Examples:** 189
74
- - **Epochs:** 3
75
- - **Total steps:** 36
76
- - **Batch:** 2
77
- - **Grad accumulation:** 8
78
- - **Effective batch:** 16
79
- - **Precision:** bf16=True (fp16=False)
80
- - **Trainable params:** 73,859,072 / 1,617,573,376 (4.57%)
81
- - **Train loss:** 2.5160
82
- - **Runtime:** 31m 31s
83
- - **Output adapter:** `trainmodel/runs/halloween2b/adapter_latest`
84
 
85
  ---
 
 
86
 
87
- ## Quantized Files
88
 
89
- All files are produced from the same model and differ only in quantization.
90
-
91
- > Replace the filenames below with your actual release artifact names.
92
-
93
- | File | Quantization | Approx. Size |
94
  |---|---|---:|
95
  | `release_v1.TQ1_0.gguf` | TQ1_0 | ~0.47 GB |
96
  | `release_v1.Q2_K.gguf` | Q2_K | ~0.68 GB |
@@ -103,23 +96,18 @@ All files are produced from the same model and differ only in quantization.
103
  | `release_v1.Q6_K.gguf` | Q6_K | ~1.27 GB |
104
  | `release_v1.Q8_0.gguf` | Q8_0 | ~1.65 GB |
105
 
106
- ### Recommendations
107
-
108
- - **Default (balanced):** `Q4_K_M`
109
- - **Higher quality:** `Q5_K_M`, `Q6_K`, `Q8_0`
110
- - **Low RAM systems:** `Q3_K_M`, `Q2_K`
111
- - **Ultra-low memory (experimental):** `TQ1_0`
112
 
113
  ---
114
-
115
- ## Usage (llama.cpp)
116
-
117
- ### CPU-only
118
-
119
  ```bash
120
  ./llama-cli \
121
  -m release_v1.Q4_K_M.gguf \
122
  -ngl 0 \
123
  -c 4096 \
124
- -p "Tell a spooky but playful Halloween story set in a small town. Keep it PG-13, vivid, and cinematic."
125
-
 
17
  - quantization
18
  - ggml
19
  - llm
20
+ - spooky-fun
21
+ - haunted-ai
22
  ---
23
+ # Halloween2B-Poltergeist v1.0 (GGUF) – Now With Extra Ghosts!
 
24
 
25
  [![License: MIT](https://img.shields.io/badge/License-MIT-green.svg)](LICENSE)
26
  [![Format: GGUF](https://img.shields.io/badge/Format-GGUF-orange)](#quantized-files)
 
29
  [![Hugging Face](https://img.shields.io/badge/Hugging%20Face-Model-yellow)](https://huggingface.co/ghostai1/Halloween2B-Poltergeist)
30
  [![LinkedIn](https://img.shields.io/badge/LinkedIn-ccengineering-0A66C2?logo=linkedin&logoColor=white)](https://www.linkedin.com/in/ccengineering/)
31
 
32
+ **Halloween2B-Poltergeist v1.0** is your go-to compact model for all things **spooky, cinematic, and downright playful** text generation. Think of it as that mischievous ghost in your machine, rattling chains and whispering eerie tales just in time for the witching hour. We've got GGUF builds ready for **local inference** via **llama.cpp** – perfect for when you want to summon AI without summoning the cloud.
 
33
 
34
+ **Quick Haunts (Links):**
35
+ - Model Tomb: https://huggingface.co/ghostai1/Halloween2B-Poltergeist
36
+ - Summoning Ritual: https://github.com/ggerganov/llama.cpp
37
+ - Mad Scientist (Author): https://www.linkedin.com/in/ccengineering/
38
 
39
  ---
40
+ ## The Haunting Overview
41
+ This bad boy is all about **tone and personality** – tuned to crank out Halloween vibes like a possessed typewriter. It's got that atmospheric drip, killer pacing, and voices that could make a skeleton shiver. Factual accuracy? Pfft, who needs it when you're brewing potions of pure imagination?
42
 
43
+ **Summon It For:**
44
+ - Bone-chilling microfiction, creepy campfire yarns, and those urban legends that keep you up at night
45
+ - Halloween roleplay (keeps it PG-13 unless you poke the bear... or ghost)
46
+ - Narrating haunted mansions, spooky quests, and chit-chat with undead NPCs
47
+ - Quick demos on your dusty old rig – low resources, high scares!
48
 
49
+ **Leave It In The Crypt For:**
50
+ - Brain-busting puzzles or deep math (it's more boo than IQ)
51
+ - Fact-checking missions or pulling up Wikipedia (ghosts don't cite sources)
52
+ - Epic sagas or AI that calls tools – this one's for short, sharp shocks
 
 
 
 
 
 
53
 
54
  ---
55
+ ## Spectral Specs (Model Details)
56
+ - **Model Moniker:** Halloween2B-Poltergeist v1.0
57
+ - **Base Haunt:** Qwen2.5-2B-Instruct
58
+ - **Tuning Tricks:** LoRA (adapter-style; might be merged in the final brew)
59
+ - **Tongue:** English (with a dash of eldritch whispers)
60
+ - **Format:** GGUF (plays nice with llama.cpp)
61
+ - **Curse (License):** MIT (but the base model's rules still lurk)
62
+
63
+ ### Training Terror Log
64
+ - **Trainer Ghoul:** Unsloth SFTTrainer (fresh off the slab)
65
+ - **Unsloth Vintage:** 2026.1.4 (future-proofed for maximum spook)
66
+ - **LoRA Lore:** r=64, alpha=64
67
+ - **Patched Phantoms:** 28 layers (QKV=28, O=28, MLP=28 – fully possessed)
68
+ - **Victim Count (Examples):** 189
69
+ - **Epochs of Torment:** 3
70
+ - **Steps to Madness:** 36
71
+ - **Batch Brew:** 2
72
+ - **Grad Graveyard:** 8 accumulations
73
+ - **Effective Elixir:** Batch size 16
74
+ - **Precision Potion:** bf16=True (fp16? Nah, we're floating point ghosts)
75
+ - **Trainable Torments:** 73,859,072 / 1,617,573,376 (4.57% – lightweight horror)
76
+ - **Final Scream (Train Loss):** 2.5160
77
+ - **Ritual Runtime:** 31m 31s (quicker than a witch's broom)
78
+ - **Spawn Point:** `trainmodel/runs/halloween2b/adapter_latest`
 
 
 
79
 
80
  ---
81
+ ## Quantized Crypts (Files)
82
+ All these spectral files come from the same unholy source – just quantized for your mortal hardware. Pick your poison!
83
 
84
+ > Note: Swap in your real file names, you lazy necromancer.
85
 
86
+ | File | Quantization | Approx. Size (in Soul GB) |
 
 
 
 
87
  |---|---|---:|
88
  | `release_v1.TQ1_0.gguf` | TQ1_0 | ~0.47 GB |
89
  | `release_v1.Q2_K.gguf` | Q2_K | ~0.68 GB |
 
96
  | `release_v1.Q6_K.gguf` | Q6_K | ~1.27 GB |
97
  | `release_v1.Q8_0.gguf` | Q8_0 | ~1.65 GB |
98
 
99
+ ### Summoning Suggestions
100
+ - **Balanced Brew (Default):** `Q4_K_M` – Solid spooks without draining your ectoplasm.
101
+ - **Premium Phantoms:** `Q5_K_M`, `Q6_K`, `Q8_0` – For when you want crystal-clear chills.
102
+ - **Budget Banshees:** `Q3_K_M`, `Q2_K` – Runs on a potato, still scares the pants off.
103
+ - **Micro-Malevolence:** `TQ1_0` – Experimental, for when your rig is basically a Ouija board.
 
104
 
105
  ---
106
+ ## Invocation Incantation (Usage with llama.cpp)
107
+ ### Pure Mortal (CPU-Only) Mode
 
 
 
108
  ```bash
109
  ./llama-cli \
110
  -m release_v1.Q4_K_M.gguf \
111
  -ngl 0 \
112
  -c 4096 \
113
+ -p "Tell a spooky but playful Halloween story set in a small town. Keep it PG-13, vivid, and cinematic."