|
|
---
|
|
|
pipeline_tag: text-generation
|
|
|
library_name: transformers
|
|
|
language:
|
|
|
- en
|
|
|
license: fair-noncommercial-research-license
|
|
|
datasets:
|
|
|
- malte0621/test-dataset
|
|
|
---
|
|
|
# Test Model
|
|
|
This is a model created for testing purposes. It is one of the smallest models available on Hugging Face, designed to experiment with the capabilities of small/tiny models.
|
|
|
|
|
|
## Model Structure
|
|
|
The model is structured to handle text generation tasks. It is trained on a small dataset that consists of user prompts and AI responses, allowing it to generate text based on given inputs.
|
|
|
|
|
|
## Usage
|
|
|
You can use this model for text generation tasks, particularly for testing and experimentation with small models. It is not intended for production use or serious applications.
|
|
|
|
|
|
### Prompt format
|
|
|
```
|
|
|
<|user|>Your input prompt here<|ai|>The model's response will be generated here<|stop|>
|
|
|
```
|
|
|
|
|
|
### Example Usage
|
|
|
|
|
|
|
|
|
#### Transformers
|
|
|
```python
|
|
|
from transformers import AutoModelForCausalLM, AutoTokenizer
|
|
|
model_name = "Malte0621/test-model"
|
|
|
model = AutoModelForCausalLM.from_pretrained(model_name, gguf_file="model.gguf")
|
|
|
tokenizer = AutoTokenizer.from_pretrained(model_name)
|
|
|
prompt = "<|user|>Hi there!<|ai|>"
|
|
|
response = model.generate(tokenizer(prompt, return_tensors="pt").input_ids)
|
|
|
print(tokenizer.decode(response[0], skip_special_tokens=True))
|
|
|
```
|
|
|
|
|
|
#### llama.cpp
|
|
|
```bash
|
|
|
./llama-cli -m model.gguf -p "<|user|>Hi there!<|ai|>" -n 128 -no-cnv --rope-freq-scale 0.125
|
|
|
```
|
|
|
|
|
|
#### LM Studio
|
|
|
https://model.lmstudio.ai/download/Malte0621/test
|
|
|
**(Make sure to set the RoPE frequency scale to 0.125 in the model settings.)**
|
|
|
|
|
|
## License
|
|
|
This model is released under the [Fair Noncommercial Research License](https://huggingface.co/Malte0621/test/blob/main/LICENSE).
|
|
|
|
|
|
## Citation
|
|
|
If you use this model in your research, please cite it as follows:
|
|
|
```
|
|
|
@misc{test-model,
|
|
|
author = {Malte0621},
|
|
|
title = {Test-Model},
|
|
|
year = {2025},
|
|
|
url = {https://huggingface.co/Malte0621/test}
|
|
|
}
|
|
|
```
|
|
|
|
|
|
## Acknowledgements
|
|
|
This model was created as part of a personal project to explore the capabilities of small language models. It is not affiliated with any organization or commercial entity. |
