Post
4063
I am very sad to say that the budget in creating of SnowflakeCore-G1 1b and 7b MoE models ran out and I can't pre-train them anymore.
- 7 replies
AI & ML interests
Making funny and goofy LM's and AI's
aquiffoo
updated
a
collection
5 months ago
FlameF0X
updated
3
models
5 months ago
FlameF0X
published
a
model
5 months ago
Post
508
the training for SnowflakeCore-G1-1B and 7B would be retaken because now I implemented DeepSpeed and management to use two gpus.
FlameF0X
published
a
model
5 months ago
FlameF0X
updated
a
collection
5 months ago
aquiffoo
updated
a
model
5 months ago
FlameF0X
updated
a
collection
5 months ago
Adding `safetensors` variant of this model
#1 opened 5 months ago
by
SFconvertbot
FlameF0X
published
a
model
5 months ago
Post
271
The development of SnowflakeCore-G1-7B-MoE it getting delay. In the mean time I am working on SnowflakeCore-G1-1B-MoE witch would be a pre-train chatbot.
-
- 1 reply
Post
2954
The development of SnowflakeCore-G1-7B-MoE. I can't say when it would be publish yet because it's big and it requires a lot of computational power.
-
- 1 reply
Post
290
I just finished the benchmarks for https://huggingface.co/FlameF0X/SnowflakeCore-G1-Tiny and https://huggingface.co/FlameF0X/SnowflakeCore-G1-Tiny2 in comparation with
openai-community/gpt2 .
Post
313
Hello! Important announcement, I will rename SnowflakeCore-G1-Medium to SnowflakeCore-G1-Tiny2 because it's going to have the same parameters as the Tiny version, but this one is trained on more data.
- 1 reply
Post
745
Currently working on SnowflakeCore-G1-Medium. [Updated loss cruve]
-
- 3 replies
Post
155
Hello there world! I am happy to announce that you now can fine-tune https://huggingface.co/FlameF0X/SnowflakeCore-G1-Tiny , the code for that is in the model card.
I aslo lost the training log 😐
I aslo lost the training log 😐
Post
1206
Hello! I am sad to say but fine-tuning https://huggingface.co/FlameF0X/SnowflakeCore-G1-Tiny is complicated and the instruct version would need to wait some time.
-
- 2 replies