Image-Text-to-Text
GGUF
Norwegian
Norwegian Bokmål
Norwegian Nynorsk
conversational
instruct
borealis
gemma3
quantized
norwegian
norwegian-bokmal
norwegian-nynorsk
full-release
🇪🇺 Region: EU
Instructions to use NbAiLab/borealis-12b-gguf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use NbAiLab/borealis-12b-gguf with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="NbAiLab/borealis-12b-gguf", filename="borealis-12b-BF16.gguf", )
llm.create_chat_completion( messages = [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] ) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use NbAiLab/borealis-12b-gguf with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf NbAiLab/borealis-12b-gguf:Q4_K_M # Run inference directly in the terminal: llama-cli -hf NbAiLab/borealis-12b-gguf:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf NbAiLab/borealis-12b-gguf:Q4_K_M # Run inference directly in the terminal: llama-cli -hf NbAiLab/borealis-12b-gguf:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf NbAiLab/borealis-12b-gguf:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf NbAiLab/borealis-12b-gguf:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf NbAiLab/borealis-12b-gguf:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf NbAiLab/borealis-12b-gguf:Q4_K_M
Use Docker
docker model run hf.co/NbAiLab/borealis-12b-gguf:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use NbAiLab/borealis-12b-gguf with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "NbAiLab/borealis-12b-gguf" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "NbAiLab/borealis-12b-gguf", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/NbAiLab/borealis-12b-gguf:Q4_K_M
- Ollama
How to use NbAiLab/borealis-12b-gguf with Ollama:
ollama run hf.co/NbAiLab/borealis-12b-gguf:Q4_K_M
- Unsloth Studio
How to use NbAiLab/borealis-12b-gguf with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for NbAiLab/borealis-12b-gguf to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for NbAiLab/borealis-12b-gguf to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for NbAiLab/borealis-12b-gguf to start chatting
- Atomic Chat new
- Docker Model Runner
How to use NbAiLab/borealis-12b-gguf with Docker Model Runner:
docker model run hf.co/NbAiLab/borealis-12b-gguf:Q4_K_M
- Lemonade
How to use NbAiLab/borealis-12b-gguf with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull NbAiLab/borealis-12b-gguf:Q4_K_M
Run and chat with the model
lemonade run user.borealis-12b-gguf-Q4_K_M
List all available models
lemonade list
| NB-License | |
| Version 1.0, June 2026 | |
| https://ai.nb.no/license/ | |
| This license (henceforth: NB-license) establishes terms and conditions for use | |
| of Borealis models with the following copyright notice: Borealis Copyright 2026 | |
| Nasjonalbiblioteket. | |
| This model is a fine-tuned derivative of Gemma 3, licensed under the Gemma Terms | |
| of Use. The original model is available from Google at | |
| https://deepmind.google/models/gemma/gemma-3/. Modifications, fine-tuning, and | |
| subsequent derivative works are distributed under the NB-license. The original | |
| Gemma Terms of Use notices, disclaimers, attribution, and use restrictions | |
| remain fully intact and are provided at https://ai.google.dev/gemma/terms. The | |
| additional usage restrictions apply only to our derivative work. | |
| 1. Definitions. | |
| - "License" means the terms and conditions for use, reproduction, and | |
| Distribution as defined in this document. | |
| - "Licensor" means the copyright owner or entity authorized by the copyright | |
| owner that is granting the License, including the persons or entities that may | |
| have rights in the Model and/or distributing the Model. | |
| - "You" (or "Your") means an individual or Legal Entity exercising permissions | |
| granted by this License and/or making use of the Model for whichever purpose and | |
| in any field of use, including usage of the Model in an end-use application - | |
| e.g. chatbot, translator, image generator. | |
| - "Third Parties" means individuals or legal entities that are not under common | |
| control with Licensor or You. | |
| - "Data" means a collection of information and/or content extracted from the | |
| dataset used with the Model, including to train, pretrain, or otherwise evaluate | |
| the Model. The Data is not licensed under this License. | |
| - "Output" means the results of operating a Model as embodied in informational | |
| content resulting therefrom. | |
| - "Model" means any accompanying machine-learning based assemblies (including | |
| checkpoints), consisting of learnt weights, parameters (including optimizer | |
| states), corresponding to the model architecture as embodied in the | |
| Complementary Material, that have been trained or tuned, in whole or in part on | |
| the Data, using the Complementary Material. | |
| - "Derivatives of the Model" means all modifications to the Model, works based | |
| on the Model, or any other model which is created or initialized by transfer of | |
| patterns of the weights, parameters, activations or output of the Model, to the | |
| other model, in order to cause the other model to perform similarly to the | |
| Model, including - but not limited to - distillation methods entailing the use | |
| of intermediate data representations or methods based on the generation of | |
| synthetic data by the Model for training the other model. | |
| - "Complementary Material" means the accompanying source code and scripts used | |
| to define, run, load, benchmark or evaluate the Model, and used to prepare data | |
| for training or evaluation, if any. This includes any accompanying | |
| documentation, tutorials, examples, etc, if any. | |
| - "Distribution" means any transmission, reproduction, publication or other | |
| sharing of the Model or Derivatives of the Model to a third party, including | |
| providing the Model as a hosted service made available by electronic or other | |
| remote means - e.g. API-based or web access. | |
| - “Use” includes accessing and utilizing a Model or Derivates of a Model, which | |
| may also include creating content, fine-tuning, updating, running, training, | |
| evaluating and/or re-parametrizing such Model or Derivates of a Model. | |
| - "Contribution" means any work of authorship, including the original version of | |
| the Model and any modifications or additions to that Model or Derivatives of the | |
| Model thereof, that is intentionally submitted to Licensor for inclusion in the | |
| Model. | |
| - "Contributor" means Licensor and any individual or Legal Entity on behalf of | |
| whom a Contribution has been received by Licensor and subsequently incorporated | |
| within the Model. | |
| 2. Grant of License. | |
| Subject to the terms and conditions of this License, each Contributor hereby | |
| grants to You a time-unlimited, worldwide, non-exclusive, no-charge, royalty- | |
| free license to use, make, have made, reproduce, prepare derivatives of the | |
| model, publicly display, publicly perform, sublicense, offer to sell, sell, | |
| import and otherwise transfer or distribute the model and derivatives of the | |
| model. | |
| 3. Redistribution | |
| You may reproduce and distribute copies of the model or derivatives of the model | |
| in any medium, with or without modifications, provided that You meet the | |
| following conditions: (a) You must give any other recipients of the model or | |
| derivatives of the model a copy of this License; and (b) You must retain all | |
| copyright notices in any redistribution of the model or derivatives of the | |
| model, excluding those notices that do not pertain to any part of a derivative | |
| of the model; and (c) You must include the use-based restrictions in section 4 | |
| as a condition precedent to effect any type of legal agreement (e.g. a license) | |
| governing the use and/or distribution of the model or its Derivatives, and give | |
| such notice to any subsequent Third Party recipients; | |
| 4. Use-based Restrictions. | |
| You can only use the Model in compliance with the following conditions: | |
| (a) You must comply with applicable laws and regulations. | |
| (b) You must not use the model to intentionally recreate material from the | |
| training data, whether protected by intellectual property rights or as personal | |
| data | |
| (c) Neither the name of the National library nor the names of creators or | |
| publishers of training data may be used to endorse or promote products derived | |
| from this model without specific prior written permission. | |
| (d) You must not use the Model or its outputs, to provide end-user services | |
| whose primary purpose is to summarize, restate, copy, or otherwise replace | |
| services for access to the press publications licensed as training data, unless you have a separate agreement with the | |
| copyright holders. This includes, but is not limited to, services that provide | |
| users with functional substitutes for access to the original press content. | |
| 5. Outputs. | |
| Except as set forth herein, Licensor claims no rights in the Output You generate | |
| with a model. You are accountable for the Output You generate and its subsequent | |
| uses. No use of the Output may contravene any provision as stated in this | |
| License, hereunder section 4 on use-based restrictions. | |
| 6. Disclaimer of Warranty. | |
| Unless required by applicable law or agreed to in writing, Licensor provides the | |
| Work (and each Contributor provides its Contributions) on an "AS IS" BASIS, | |
| WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied, | |
| including, without limitation, any warranties or conditions of TITLE, NON- | |
| INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A PARTICULAR PURPOSE. You are | |
| solely responsible for determining the appropriateness of using or | |
| redistributing the Work and assume any risks associated with Your exercise of | |
| permissions under this License. The Licensor makes no representations or | |
| warranties that the Model or its Output will be free from factual inaccuracies, | |
| biases, or potential misinterpretation of the underlying training data. You are | |
| solely responsible for ensuring that any use of the Model adheres to applicable | |
| legal and ethical standards. | |
| 7. Limitation of Liability. | |
| In no event and under no legal theory, whether in tort (including negligence), | |
| contract, or otherwise, unless required by applicable law (such as deliberate | |
| and grossly negligent acts) or agreed to in writing, shall any Contributor be | |
| liable to You for damages, including any direct, indirect, special, incidental, | |
| or consequential damages of any character arising as a result of this License or | |
| out of the use or inability to use the Work (including but not limited to | |
| damages for loss of goodwill, work stoppage, computer failure or malfunction, or | |
| any and all other commercial damages or losses), even if such Contributor has | |
| been advised of the possibility of such damages. | |
| 8. Accepting Warranty or Additional Liability. | |
| While redistributing the Work or Derivative Works thereof, You may choose to | |
| offer, and charge a fee for, acceptance of support, warranty, indemnity, or | |
| other liability obligations and/or rights consistent with this License. However, | |
| in accepting such obligations, You may act only on Your own behalf and on Your | |
| sole responsibility, not on behalf of any other Contributor, and only if You | |
| agree to indemnify, defend, and hold each Contributor harmless for any liability | |
| incurred by, or claims asserted against, such Contributor by reason of your | |
| accepting any such warranty or additional liability. | |
| 9. Term and Termination. | |
| The term of this Agreement will commence upon your acceptance of this Agreement | |
| and will continue in full force and effect until terminated in accordance with | |
| the terms and conditions herein. Licensor may terminate this Agreement if you | |
| are in breach of any term or condition of this Agreement. Upon termination of | |
| this Agreement, you shall cease use of the licensed model. Section 7 shall | |
| survive the termination of this Agreement. Termination of the agreement does not | |
| affect your continued rights to use parts of the model the licensed model was | |
| based on (if warm trained) under its original license. | |
| 10. Governing Law and Jurisdiction. | |
| This Agreement will be governed and construed under the laws of Norway. The Oslo | |
| District Court shall have exclusive jurisdiction of any dispute arising out of | |
| this Agreement. | |