Podman para Containers e orquestração
2º no ranking · 28 ups · ver categoria
Opiniões da comunidade
- — nachiket_bhand
Hear hear. I'm "GPU poor" (16GB) but I agree. I'm using ByteShape's IQ4\_XS together with Raymond's KV cache streaming (context > 160k) and DFlash2 (at low context) and it's faster than any MoE I've used as well as good enough for me to use it as my only model for software dev, cybersec and IT adm. [ Podman containers for sandbox using a self-made MCP that handles their lifetimes as well as enforcing the tools. [ We've already passed the point of "good enough". All further development now just makes things even better.