You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am quite new to the A.I. world, and I spent a week testing a lot of different models in very harsh conditions (cpu only and 16 gb of ram)
This is by far the best model of them all.
Who knows me will be suprised because I rarely praise something (anything) in this way.
I wonder how much it would deteriorate by reducing it's size to around 8gb....
I tested a gguf model of 16gb (wizardlm-13b-v1.2.Q4_0.gguf) and the results were amazing.
The text was updated successfully, but these errors were encountered:
I am quite new to the A.I. world, and I spent a week testing a lot of different models in very harsh conditions (cpu only and 16 gb of ram)
This is by far the best model of them all.
Who knows me will be suprised because I rarely praise something (anything) in this way.
I wonder how much it would deteriorate by reducing it's size to around 8gb....
I tested a gguf model of 16gb (wizardlm-13b-v1.2.Q4_0.gguf) and the results were amazing.
The text was updated successfully, but these errors were encountered: