Models

ISTA-DASLab/Llama-2-7b-AQLM-PV-2Bit-1x16-hf

Text Generation • 1B • Updated May 31, 2024 • 2

ISTA-DASLab/Llama-2-13b-AQLM-PV-2Bit-1x16-hf

Text Generation • 2B • Updated May 31, 2024

ISTA-DASLab/Llama-2-70b-AQLM-PV-2Bit-1x16-hf

Text Generation • 9B • Updated May 31, 2024

ISTA-DASLab/Mistral-7B-v0.1-AQLM-PV-2Bit-1x16-hf

Text Generation • 1B • Updated May 30, 2024 • 1

ISTA-DASLab/Phi-3-mini-4k-instruct-AQLM-PV-2Bit-1x16-hf

Text Generation • 0.7B • Updated Aug 3, 2024 • 22 • 2

ISTA-DASLab/Llama-2-7b-AQLM-PV-2Bit-2x8-hf

Text Generation • 2B • Updated May 31, 2024 • 2

ISTA-DASLab/Meta-Llama-3-8B-AQLM-PV-2Bit-1x16

Text Generation • 2B • Updated May 31, 2024 • 1 • 3

ISTA-DASLab/Meta-Llama-3-70B-AQLM-PV-2Bit-1x16

Text Generation • 11B • Updated May 31, 2024 • 4

TechxGenus/deepseek-coder-7b-instruct-v1.5-PV

Text Generation • 1B • Updated May 30, 2024 • 9

justheuristic/test-1bit

Text Generation • 0.9B • Updated May 31, 2024 • 1

ISTA-DASLab/Llama-2-7b-AQLM-PV-1Bit-1x16-hf

Text Generation • 0.9B • Updated May 31, 2024

ISTA-DASLab/Meta-Llama-3-8B-AQLM-PV-1Bit-1x16

Text Generation • 2B • Updated May 31, 2024

ISTA-DASLab/Meta-Llama-3-70B-AQLM-PV-1Bit-1x16

Text Generation • 7B • Updated Sep 14, 2024 • 1

ISTA-DASLab/Phi-3-medium-4k-instruct-AQLM-PV-1Bit-1x16-hf

Text Generation • 1B • Updated Jul 8, 2024 • 2

ISTA-DASLab/Phi-3-medium-4k-instruct-AQLM-PV-2Bit-1x16-hf

Text Generation • 2B • Updated Jul 8, 2024

ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-1Bit-1x16-hf

Text Generation • 2B • Updated Aug 9, 2024

ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-1Bit-1x16-hf

Text Generation • 2B • Updated Aug 9, 2024 • 1

ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-1x16-hf

Text Generation • 2B • Updated Aug 28, 2024 • 9

ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-2Bit-1x16-hf

Text Generation • 2B • Updated Aug 9, 2024 • 1 • 3

ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-2x8-hf

Text Generation • 3B • Updated Aug 9, 2024 • 65 • 2

ISTA-DASLab/Mistral-Nemo-Instruct-2407-AQLM-PV-2Bit-1x16-hf

3B • Updated Aug 16, 2024 • 3

ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16

Text Generation • 11B • Updated Sep 14, 2024 • 16 • 18

ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16

Text Generation • 11B • Updated Sep 17, 2024 • 5 • 46

ISTA-DASLab/Llama-3.2-3B-AQLM-PV-2Bit-2x8

Text Generation • 1B • Updated Nov 8, 2024

ISTA-DASLab/Llama-3.2-1B-AQLM-PV-2Bit-2x8

Text Generation • 0.5B • Updated Nov 8, 2024 • 12

ISTA-DASLab/Llama-3.2-1B-Instruct-AQLM-PV-2Bit-2x8

Text Generation • 0.5B • Updated Nov 8, 2024 • 7 • 1

ISTA-DASLab/Llama-3.2-3B-Instruct-AQLM-PV-2Bit-2x8

Text Generation • 1B • Updated Nov 8, 2024 • 1