Hugging Face's logo
Pankaj Pandey's picture
Building on HF
2 2 12

Pankaj Pandey

pankajpandey-dev
kaushik-harsh-99's profile picture or99's profile picture lulavc's profile picture
Ā·

AI & ML interests

Natural Language Processing, Text Generation, Large Language Models, Quantization, Fine-Tuning, RLHF, Model Merging

Recent Activity

reacted to theirpost with šŸ”„ 1 day ago
šŸ‡®šŸ‡³ Gemma-3-1B Hindi Instruct ā€” a Hindi LLM that runs fully offline, anywhere. Last week I shipped Qwen3-4B Hindi. This week I went the other direction: how tiny can a useful Hindi model get? So I fine-tuned Gemma-3-1B on quality-filtered Hindi instruction data and shipped the full GGUF ladder. āœ… Fine-tune (16-bit): https://huggingface.co/pankajpandey-dev/gemma-3-1b-hindi-instruct āœ… GGUF (Q4/Q5/Q8): https://huggingface.co/pankajpandey-dev/gemma-3-1b-hindi-instruct-GGUF Runs in Ollama, llama.cpp, and LM Studio. The Q4_K_M is just 806 MB ā€” runs on CPU, a cheap laptop, even a Raspberry Pi. What I tried this round: chrF-filtered the training data to drop weak translations, and used response-only loss so the model learns how to answer, not how to repeat prompts. Honest note: at 1B, Hindi fluency is strong but coherence is bounded by size ā€” it's a lightweight/edge experiment, not a 4B replacement. Gemma-3-4B Hindi is next. Part of my Hindi LLM Series ā€” openly-licensed Indic models for local & edge use. Feedback welcome šŸ™ #Hindi #IndicNLP #GGUF #LocalLLM #Gemma #EdgeAI
liked a Space 4 days ago
pankajpandey-dev/qwen3-4b-hindi-demo
updated a Space 4 days ago
pankajpandey-dev/qwen3-4b-hindi-demo
View all activity

Organizations

LocalLLaMA's profile picture Hugging Science's profile picture nanochat students's profile picture