carsenk commited on
Commit
2247688
·
verified ·
1 Parent(s): 6b208dc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +34 -1
README.md CHANGED
@@ -28,4 +28,37 @@ This Phi3.5 model was trained 2x faster with [Unsloth](https://github.com/unslot
28
 
29
  Trained on 1 x 4080 SUPER over 10500 Epochs
30
 
31
- GGUFs are included in this repository for inference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
28
 
29
  Trained on 1 x 4080 SUPER over 10500 Epochs
30
 
31
+ GGUFs are included in this repository for inference
32
+
33
+
34
+ Running in transformers
35
+ ```py
36
+ # Use a pipeline as a high-level helper
37
+ from transformers import pipeline
38
+
39
+ messages = [
40
+ {"role": "user", "content": "Who are you?"},
41
+ ]
42
+ pipe = pipeline("text-generation", model="carsenk/phi3.5_mini_exp_825_uncensored")
43
+ pipe(messages)
44
+ ```
45
+
46
+
47
+ Running in llama.cpp (Use GGUF)
48
+ ```py
49
+ from llama_cpp import Llama
50
+
51
+ llm = Llama.from_pretrained(
52
+ repo_id="carsenk/phi3.5_mini_exp_825_uncensored",
53
+ filename="unsloth.BF16.gguf",
54
+ )
55
+
56
+ llm.create_chat_completion(
57
+ messages = [
58
+ {
59
+ "role": "user",
60
+ "content": "What is the capital of France?"
61
+ }
62
+ ]
63
+ )
64
+ ```