Carl Silva PRO

silvacarl's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in mistralai/Voxtral-Mini-3B-2507 4 months ago

no vllm?

2

#7 opened 4 months ago by

silvacarl

New activity in kaitchup-toolboxes/Llama3 10 months ago

github?

4

#2 opened 10 months ago by

silvacarl

New activity in kaitchup-toolboxes/Llama3 12 months ago

SFT notebooks

2

#1 opened 12 months ago by

silvacarl

New activity in fixie-ai/ultravox-v0_4_1-mistral-nemo about 1 year ago

no attribute tokenizer?

11

#1 opened about 1 year ago by

silvacarl

New activity in mistralai/Mistral-Small-Instruct-2409 about 1 year ago

vllm call for multiple GPUs, just fyi.

1

#16 opened about 1 year ago by

silvacarl

New activity in guillaumekln/faster-whisper-large-v2 over 1 year ago

Hosting an Inference endpoint

11

#6 opened over 2 years ago by

lukehansen

New activity in mistralai/Mistral-7B-Instruct-v0.2 over 1 year ago

Is there any vllm support for this version?

9

#49 opened almost 2 years ago by

Aloukik21

New activity in xai-org/grok-1 over 1 year ago

Loading and Running the Grok-1 Open-Weights Model

6

#54 opened over 1 year ago by

Ateeqq

New activity in berkeley-nest/Starling-LM-7B-alpha almost 2 years ago

extremely variable response time for inference?

9

#21 opened almost 2 years ago by

silvacarl

New activity in HuggingFaceH4/zephyr-chat about 2 years ago

API and prompt format?

1

#11 opened about 2 years ago by

silvacarl

New activity in mistralai/Mistral-7B-Instruct-v0.1 about 2 years ago

How to fine tune ?

14

#12 opened about 2 years ago by

NickyNicky

New activity in TheBloke/Llama-2-13B-chat-AWQ about 2 years ago

any idea how to test this for inferencing using vllm?

3

#1 opened about 2 years ago by

silvacarl

New activity in mistralai/Mistral-7B-Instruct-v0.1 about 2 years ago

key error

👍 8

15

#2 opened about 2 years ago by

NS-Y

New activity in huggingface-projects/llama-2-13b-chat over 2 years ago

RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx?

2

#13 opened over 2 years ago by

silvacarl

New activity in tiiuae/falcon-40b-instruct over 2 years ago

Prompt for instructions ?

👍 10

4

#1 opened over 2 years ago by

asach

Various Prompt Formats

8

#24 opened over 2 years ago by

gsaivinay

New activity in databricks/dolly-v2-12b over 2 years ago

GPU requirement for simply running the model

27

#9 opened over 2 years ago by

abhi24

New activity in nlpcloud/instruct-gpt-j-fp16 over 2 years ago

I am getting the CUDA OUT-Of-Memory on Tesla T4 but only with these prompts...

18

#5 opened over 2 years ago by

AayushShah

Licensing? Commercial use?

2

#4 opened over 2 years ago by

xjdeng

Few shot learning

4

#1 opened over 2 years ago by

iRanadheer