Curious about what model is best to use on my RTX 3080 + Ryzen 5 3600 since I’ve just found out about this.
You must log in or register to comment.
Llama3.1 8b,the other versions are too big to run on gpu
The Llama 3.1 models are probably the best all-rounders, with the Llama 3.1 8B version being the most popular.
