Llama-3.1-8B-Instruct IIRC. The Q6_K quant is 6.2GB, so fits into a 8GB GPU with just enough space for a small KV cache & your display memory etc. I really wasn’t expecting it to write working Ha… (View Post)

Apologies! Llama-3.1 is the model - from Meta (Facebook). 8B is the size of the model - 8 Billion weights. Instruct means it’s been instruction-tuned after the initial training, so it interacts like … (View Post)

Or it’s simply too expensive for Apple to run at a profit right now. All the current LLM companies are being heavily subsidised by investors in one way or another. Microsoft paid for OpenAI’s NVidia … (View Post)

So, since everyone hates inheritance taxes, I propose we ditch IHT altogether and replace it & CGT with a wealth tax. In fact, lets go the whole hog & bundle Council Tax in there too! Guarant… (View Post)

UK owners of corporations do pay IHT, so IHT ends up being paid on the asset one way or another if the ultimate owner is UK resident. There is a valid question here about the taxation of UK land owne… (View Post)