Show HN: Llama.go – port of llama.cpp to pure Go https://ift.tt/gNn82Kx

Show HN: Llama.go – port of llama.cpp to pure Go It's April 12 - The First Man in Space* Day - and I'm releasing #ML framework I've been building for the last month :) It's written in #Go and allows #LLaMA #GPT inference having just regular PC - so no monster GPU cluster is needed to start experiment with: https://ift.tt/bAMHsQ7 The V1 is using FP32 math only, but will work with AVX2 data types and INT8 quantisation soon. * The first man in space was Yuri Gagarin from USSR https://ift.tt/bAMHsQ7 April 12, 2023 at 11:12PM