Looking at the source they thankfully already use a temp of zero, but max tokens is 320. That doesn’t seem like much for code especially since most symbols are a whole token.
- 0 Posts
- 3 Comments
Joined 2 years ago
Cake day: July 4th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
Relevant section:
Intel made waves when it disabled AVX-512 support at the firmware level on 12th-gen Core processors and later models, effectively removing the SIMD ISA from its consumer chips.
*Ctrl+tab for those that don’t know.