• brucethemoose@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 day ago

      It’s a mixed bag TBH. The issue is that Qwen 3.8 27B is so good.

      It depends on the quant you are running though, and the way you are running it. If you have 16GB or less VRAM and a generous amount of CPU RAM, and you are running a regular GGUF instead of something exotic, Qwen next is probably better, with the right hybrid inference engine.