@davel@lemmy.ml just ran across this model, and it seems to work a lot better than the other ones I’ve tried locally. Seems to be faster as well. One thing I noticed is that it helps to set temperature (which controls randomness) and Top P (which affects variety of output) values to 0 to keep it more focused.
@davel@lemmy.ml just ran across this model, and it seems to work a lot better than the other ones I’ve tried locally. Seems to be faster as well. One thing I noticed is that it helps to set temperature (which controls randomness) and Top P (which affects variety of output) values to 0 to keep it more focused.