---
license: llama2
pipeline_tag: text-generation
tags:
- code
model-index:
- name: coma-7B-v0.1
  results:
  - task:
      type: text-generation
    dataset:
      type: lm-evaluation-harness
      name: bbh
    metrics:
    - name: acc_norm
      type: acc_norm
      value: 0.3355
      verified: false
  - task:
      type: text-generation
    dataset:
      type: lm-evaluation-harness
      name: gpqa
    metrics:
    - name: acc_norm
      type: acc_norm
      value: 0.2587
      verified: false
  - task:
      type: text-generation
    dataset:
      type: lm-evaluation-harness
      name: math
    metrics:
    - name: exact_match
      type: exact_match
      value: 0.0104
      verified: false
  - task:
      type: text-generation
    dataset:
      type: lm-evaluation-harness
      name: mmlu
    metrics:
    - name: acc_norm
      type: acc_norm
      value: 0.1433
      verified: false
  - task:
      type: text-generation
    dataset:
      type: lm-evaluation-harness
      name: musr
    metrics:
    - name: acc_norm
      type: acc_norm
      value: 0.3844
      verified: false
  - task:
      type: text-generation
    dataset:
      type: lm-evaluation-harness
      name: hellaswag
    metrics:
    - name: acc
      type: acc
      value: 0.5182234614618602
      verified: false
    - name: acc_norm
      type: acc_norm
      value: 0.6834295956980682
      verified: false
base_model:
- DevQuasar/coma-7B-v0.1
---


I'm doing this to 'Make knowledge free for everyone', using my personal time and resources.

If you want to support my efforts please visit my ko-fi page: https://ko-fi.com/devquasar

Also feel free to visit my website https://devquasar.com/