fasttext-language-detection-bahasa-en

FastText model to classify Bahasa {standard Malay, local Malay, Indonesian}, English {standard English, Manglish, Singlish} and other languages.

how to use

from huggingface_hub import hf_hub_download
import fasttext

filename = hf_hub_download(
    repo_id="mesolitica/fasttext-language-detection-bahasa-en", 
    filename="fasttext.ftz"
)
lang_model = fasttext.load_model(filename)
lang_model.predict('hello my name', k = 10)

Output,

(('__label__english', '__label__bahasa', '__label__other'),
 array([9.97674406e-01, 2.35472783e-03, 1.08091690e-05]))