EXAONE-Deep-32B-GGUF / README.md

apepkuss79

Update README.md

4e359ce verified 9 months ago

preview code

raw

history blame contribute delete

715 Bytes

metadata

license: other
license_name: exaone
license_link: LICENSE
model_name: EXAONE-Deep-32B
base_model: LGAI-EXAONE/EXAONE-Deep-32B
quantized_by: Second State Inc.
language:
  - en
  - ko
tags:
  - lg-ai
  - exaone
  - exaone-deep
pipeline_tag: text-generation
library_name: transformers

EXAONE-Deep-32B-GGUF

Original Model

LGAI-EXAONE/EXAONE-Deep-32B

Run with Gaianet

Prompt template

prompt template: exaone-deep-chat

Context size

chat_ctx_size: 32000

Run with GaiaNet

Quick start: https://docs.gaianet.ai/node-guide/quick-start
Customize your node: https://docs.gaianet.ai/node-guide/customize

Quantized with llama.cpp b4914