Hugging Face's logo
Not Lain's picture
Building on HF
245 452 584

Not Lain PRO

not-lain
chonkie-ai
NBakali's profile picture harish596's profile picture acarp3422's profile picture
Ā·
https://not-lain.github.io

AI & ML interests

custom AI models with HF integration, HuggingFace fellow šŸ¤—

Recent Activity

reacted to alvarobartt's post with šŸš€ about 24 hours ago
šŸ’„ `hf-mem` v0.4.1 now also estimates KV cache memory requirements for any context length and batch size with the `--experimental` flag! `uvx hf-mem --model-id ... --experimental` will automatically pull the required information from the Hugging Face Hub to include the KV cache estimation, when applicable. šŸ’” Alternatively, you can also set the `--max-model-len`, `--batch-size` and `--kv-cache-dtype` arguments (Ć  la vLLM) manually if preferred.
reacted to alvarobartt's post with šŸ”„ about 24 hours ago
šŸ’„ `hf-mem` v0.4.1 now also estimates KV cache memory requirements for any context length and batch size with the `--experimental` flag! `uvx hf-mem --model-id ... --experimental` will automatically pull the required information from the Hugging Face Hub to include the KV cache estimation, when applicable. šŸ’” Alternatively, you can also set the `--max-model-len`, `--batch-size` and `--kv-cache-dtype` arguments (Ć  la vLLM) manually if preferred.
upvoted a collection 1 day ago
Trinity-Large
View all activity

Organizations

Stanford AI's profile picture AI FILMS's profile picture OpenGVLab's profile picture MusicAI's profile picture BigScience Biomedical Datasets's profile picture OpenVINO Toolkit's profile picture Hugging Face Fellows's profile picture Gradio-Blocks-Party's profile picture scikit-learn's profile picture lora concepts library's profile picture DeepGHS's profile picture Open-Source AI Meetup's profile picture Arabic Machine Learning 's profile picture The introspector project's profile picture East China Normal University's profile picture Kornia AI's profile picture Tune a video concepts library's profile picture Keras Dreambooth Event's profile picture AI Zero to Hero's profile picture Stable Diffusion Dreambooth Concepts Library's profile picture The Waifu Research Department's profile picture M.O.F.U.'s profile picture AI Indonesia Community's profile picture ShoukanLabs's profile picture Blog-explorers's profile picture Arabic Clip's profile picture BangumiBase's profile picture CyberHarem's profile picture Touhou AI Experimental Group (MOFU)'s profile picture Tensor Diffusion's profile picture OpenOrca's profile picture huggingPartyParis's profile picture MultišŸ¤–Transformers's profile picture Team Tonic's profile picture That Time I got Reincarnated as a Hugging Face Organization's profile picture ZeroGPU Explorers's profile picture LocalLLaMA's profile picture BrainPulse's profile picture MLX Community's profile picture INNOVA AI's profile picture Pine's profile picture Social Post Explorers's profile picture Tunisia.AI's profile picture Cohere Labs Community's profile picture M4-ai's profile picture takara.ai's profile picture Dev Mode Explorers's profile picture Chinese LLMs on Hugging Face's profile picture Paris AI Running Club's profile picture AI4Health's profile picture Stable Diffusion Community (Unofficial, Non-profit)'s profile picture Hugging Face for Legal's profile picture Hugging Face Discord Community's profile picture phxia's profile picture Arilio's profile picture Data Tonic (Alignment Lab)'s profile picture Nerdy Face's profile picture open/ acc's profile picture Data Is Better Together Contributor's profile picture Donut Earthers šŸ©'s profile picture Chonkie Inc.'s profile picture None yet's profile picture Hugging Face Agents Course's profile picture Bitsandbytes Community's profile picture Hugging Face MCP Course's profile picture Agents-MCP-Hackathon's profile picture mermory's profile picture Hugging Science's profile picture MCP-1st-Birthday's profile picture nanochat students's profile picture