Hugging Face CommunityOpen Weights
Gemma-2-Medical-GGUF-Q4_K_M
Specialized Domain LLM • Released 2024-11-11 • Last Verified 2025-02-01
Gemma-2-Medical-GGUF-Q4_K_M - Fine-tuned and quantized Medical domain model variant optimized for fast local host inference.
Context Window32k-128k
LicenseApache-2.0 / Community Open Source
Deployment
Local Model
API AvailableNo
Benchmark Performance
Medical Domain Score84
Hardware Requirements for Local Running
Requires 4GB-8GB VRAM
Strengths
- •High accuracy
- •Fast inference
Limitations & Weaknesses
- •Closed source API
API Sample CodePython / REST
import openai
client = openai.OpenAI()
response = client.chat.completions.create(
model="gemma-2-medical-gguf-q4-k-m",
messages=[
{"role": "system", "content": "You are a helpful expert assistant."},
{"role": "user", "content": "Explain quantum computing in 2 sentences."}
]
)
print(response.choices[0].message.content)Pricing Overview
Free Open Source (Hugging Face / Ollama)
Prices subject to provider tiers and volume discounts. Check documentation for current token rates.
Model Tags
#medical#ollama#huggingface#quantized#local
Similar Models from Hugging Face Community
Meta AI
Open Weights
Llama 3.3 70B
Open Weights LLM
Llama 3.3 70B - Meta AI open source model engineered for high efficiency, vision, and edge performance.
Context Window128k
MMLU65
Cloud API Local Run
#meta#llama
Meta AI
Open Weights
Llama 3.2 11B Vision
Vision LLM
Llama 3.2 11B Vision - Meta AI open source model engineered for high efficiency, vision, and edge performance.
Context Window128k
MMLU66
Cloud API Local Run
#meta#llama
Meta AI
Open Weights
Llama 3.2 90B Vision
Vision LLM
Llama 3.2 90B Vision - Meta AI open source model engineered for high efficiency, vision, and edge performance.
Context Window128k
MMLU67
Cloud API Local Run
#meta#llama