Labib11

/

MUG-B-1.6

like 2

Evaluation results

• accuracy on MTEB AmazonCounterfactualClassification (en-ext)
  test set self-reported
  74.040
• ap on MTEB AmazonCounterfactualClassification (en-ext)
  test set self-reported
  23.622
• f1 on MTEB AmazonCounterfactualClassification (en-ext)
  test set self-reported
  61.681
• accuracy on MTEB AmazonCounterfactualClassification (en)
  test set self-reported
  72.388
• ap on MTEB AmazonCounterfactualClassification (en)
  test set self-reported
  35.145
• f1 on MTEB AmazonCounterfactualClassification (en)
  test set self-reported
  66.400
• accuracy on MTEB AmazonCounterfactualClassification (de)
  test set self-reported
  54.325
• ap on MTEB AmazonCounterfactualClassification (de)
  test set self-reported
  71.953
• f1 on MTEB AmazonCounterfactualClassification (de)
  test set self-reported
  52.507
• accuracy on MTEB AmazonCounterfactualClassification (ja)
  test set self-reported
  56.338
• ap on MTEB AmazonCounterfactualClassification (ja)
  test set self-reported
  12.671
• f1 on MTEB AmazonCounterfactualClassification (ja)
  test set self-reported
  46.128
• accuracy on MTEB AmazonPolarityClassification
  test set self-reported
  93.708
• ap on MTEB AmazonPolarityClassification
  test set self-reported
  90.586
• f1 on MTEB AmazonPolarityClassification
  test set self-reported
  93.698
• accuracy on MTEB AmazonReviewsClassification (en)
  test set self-reported
  50.850
• f1 on MTEB AmazonReviewsClassification (en)
  test set self-reported
  49.800
• accuracy on MTEB AmazonReviewsClassification (de)
  test set self-reported
  27.204
• f1 on MTEB AmazonReviewsClassification (de)
  test set self-reported
  26.601
• accuracy on MTEB AmazonReviewsClassification (es)
  test set self-reported
  34.878