Super-squash branch 'main' using huggingface_hub

.gitattributes

@@ -0,0 +1,61 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-Q2_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-Q3_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-Q4_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-Q5_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-Q6_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Trinity-Mini-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,132 @@
+---
+license: apache-2.0
+language:
+- en
+- es
+- fr
+- de
+- it
+- pt
+- ru
+- ar
+- hi
+- ko
+- zh
+library_name: transformers
+base_model:
+- arcee-ai/Trinity-Mini
+base_model_relation: quantized
+---
+<div align="center">
+  <picture>
+    <img
+      src="https://cdn-uploads.huggingface.co/production/uploads/6435718aaaef013d1aec3b8b/i-v1KyAMOW_mgVGeic9WJ.png"
+      alt="Arcee Trinity Mini"
+      style="max-width: 100%; height: auto;"
+    >
+  </picture>
+</div>
+
+# Trinity Mini GGUF
+
+Trinity Mini is an Arcee AI 26B MoE model with 3B active parameters. It is the medium-sized model in our new Trinity family, a series of open-weight models for enterprise and tinkerers alike.
+
+This model is tuned for reasoning, but in testing, it uses a similar total token count to competitive instruction-tuned models.
+
+These are the GGUF files for running on llama.cpp powered platforms
+
+***
+
+Trinity Mini is trained on 10T tokens gathered and curated through a key partnership with [Datology](https://www.datologyai.com/), building upon the excellent dataset we used on [AFM-4.5B](https://huggingface.co/arcee-ai/AFM-4.5B) with additional math and code.
+
+Training was performed on a cluster of 512 H200 GPUs powered by [Prime Intellect](https://www.primeintellect.ai/) using HSDP parallelism.
+
+More details, including key architecture decisions, can be found on our blog [here](https://www.arcee.ai/blog)
+
+Try it out now at [chat.arcee.ai](http://chat.arcee.ai/)
+
+***
+
+## Model Details
+
+* **Model Architecture:** AfmoeForCausalLM
+* **Parameters:** 26B, 3B active
+* **Experts:** 128 total, 8 active, 1 shared
+* **Context length:** 128k
+* **Training Tokens:** 10T
+* **License:** [Apache 2.0](https://huggingface.co/arcee-ai/Trinity-Mini#license)
+* **Recommended settings:**
+    * temperature: 0.15
+    * top_k: 50
+    * top_p: 0.75
+    * min_p: 0.06
+
+***
+
+## Benchmarks
+
+![](https://cdn-uploads.huggingface.co/production/uploads/6435718aaaef013d1aec3b8b/UMV0OZh_H1JfvgzBTXh6u.png)
+
+<div align="center">
+  <picture>
+      <img src="https://cdn-uploads.huggingface.co/production/uploads/6435718aaaef013d1aec3b8b/sSVjGNHfrJKmQ6w8I18ek.png" style="background-color:ghostwhite;padding:5px;" width="17%" alt="Powered by Datology">
+  </picture>
+</div>
+
+### Running our model
+
+- [llama.cpp](https://huggingface.co/arcee-ai/Trinity-Mini#llamacpp)
+- [LM Studio](https://huggingface.co/arcee-ai/Trinity-Mini#lm-studio)
+- [API](https://huggingface.co/arcee-ai/Trinity-Mini#api)
+
+## llama.cpp
+
+Supported in llama.cpp release b7061
+
+Download the latest [llama.cpp release](https://github.com/ggml-org/llama.cpp/releases)
+
+```
+llama-server -hf arcee-ai/Trinity-Mini-GGUF:q4_k_m \
+  --temp 0.15 \
+  --top-k 50 \
+  --top-p 0.75
+  --min-p 0.06
+```
+
+## LM Studio
+
+Supported in latest LM Studio runtime
+
+Update to latest available, then verify your runtime by:
+
+1. Click "Power User" at the bottom left
+2. Click the green "Developer" icon at the top left
+3. Select "LM Runtimes" at the top
+4. Refresh the list of runtimes and verify that the latest is installed
+
+Then, go to Model Search and search for `arcee-ai/Trinity-Mini-GGUF`, download your prefered size, and load it up in the chat
+
+## API
+
+Trinity Mini is available today on openrouter:
+
+https://openrouter.ai/arcee-ai/trinity-mini
+
+```
+curl -X POST "https://openrouter.ai/v1/chat/completions" \
+  -H "Authorization: Bearer $OPENROUTER_API_KEY" \
+  -H "Content-Type: application/json" \
+  -d '{
+    "model": "arcee-ai/trinity-mini",
+    "messages": [
+      {
+        "role": "user",
+        "content": "What are some fun things to do in New York?"
+      }
+    ]
+  }'
+```
+
+## License
+
+Trinity-Mini is released under the Apache-2.0 license.

Trinity-Mini-IQ2_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bb2a02c5a8a76586e5e5fd51e85be7edff7cd85fe4ab07c0c34e687bafe77689
+size 8482186080

Trinity-Mini-IQ2_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b8fb6ac308a72fc018565f0a8f3872ac01f0407d3819b6dc85beac99fc0d5fa0
+size 7556293472

Trinity-Mini-IQ2_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:26b3d92dac7697b23f82c2a81f0e3e554dd1cc3cfeee90f40f4a9be33aa1beda
+size 7481099104

Trinity-Mini-IQ2_XXS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e565fc7b9730eb0c505a0316f4b7cb426580d3ce406c43a7c85fff3e87527a83
+size 6555206496

Trinity-Mini-IQ3_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3c6632e7be492b70d823633bd278f820359a83e73ce9d8ab73a518f53b14ee63
+size 12100780896

Trinity-Mini-IQ3_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3317e3922528e75c50382f1016807296e2ffed9c7c2fd0916a8bc4a06ef9241
+size 10981753696

Trinity-Mini-IQ3_XXS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4ff881a7f798537d7b5f348c280c49f23a1fc8f6d0b9fb425ecc083e03d35686
+size 10542080864

Trinity-Mini-IQ4_NL.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:648944086f877e7799d780e7f695e0d3a020dde9c745752b74541d4def49cebe
+size 14946935648

Trinity-Mini-IQ4_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:55384aa295b494793d18c6caf0ee67a0f50abca09b62aba28f36dda63724c527
+size 14160012128

Trinity-Mini-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0419d3ecf5b221a7f814071e32421cb7c1ec820f1e95fbd41eb848f155cb8db7
+size 9425052512

Trinity-Mini-Q2_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:639f9de7fc4c999379a3d6518aae102afc7448f45b55fa818f2156daed55aca0
+size 9825436512

Trinity-Mini-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fdad900de7982b1c1ffdc90dce55959a5037e3b67d05d057341d48ad5c0f000f
+size 12508676960

Trinity-Mini-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cc6a658c42ab13d688953a48f9df5218a12d5a4ec58793b875dd1aa1d7dbfcb3
+size 12104188768

Trinity-Mini-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8eb027c4b04aadedd309e38ece5270c0f2df91dca4219842eaf896ff6b88f28f
+size 11593859936

Trinity-Mini-Q3_K_XL.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9488847da15b834708d1f08be409db1147cd9b02c8bfeb7cad7d43bcef32fd9b
+size 12867421024

Trinity-Mini-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6cf2deb33136427f5591d93ea3adad8e0b5a3a1d95f3dfcda08c7ccea27da0d0
+size 15145640800

Trinity-Mini-Q4_1.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8f4c74c3a720762357ca97d24cbb5ec16ef1d1562c10d664c488f8edea0f0f09
+size 16501908320

Trinity-Mini-Q4_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8d09eeef5143de5589635a3199e7ae68de8a9fe08973cb5784bd2a837d014e44
+size 16240100192

Trinity-Mini-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7c2f0f2991923c21baee495340b79feb2a124b1c93b57dea0652f8aa27ba08e8
+size 15935808352

Trinity-Mini-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ecca85005b5a92ad47fe94da8854a5c573cae328b7756609ebeb684e35f7e693
+size 15416173408

Trinity-Mini-Q5_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fbea1da34ebe172acd26a459e9a6d20927131dd4cdb3c47caf5f931036f80b4f
+size 18890113888

Trinity-Mini-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:12152dc55123f03512ec4d74d4d6f69fea204a6a6b31f6864b7bc2803621b1b3
+size 18637071200

Trinity-Mini-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:162c19126ba80c3e197f137eb7a564818f133eea59b4c31ab40ef0903b0c8939
+size 18107999072

Trinity-Mini-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:45a436765975d1acc4c5ccc1cde89ba7c790e5057270ba2b9b85b0b1313aa0a4
+size 21516911456

Trinity-Mini-Q6_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f5b23e2a9b03151e4bad4c2ae375429a7b78018e5eea7ef81317c62f838bb287
+size 21715501920

Trinity-Mini-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7e39913b1f31c4f284605127f0b035abafc3b456efd26a988e53c2a3e12c6601
+size 27788002144