You can run it on a mac studio with 512gb ram, that's the easiest way. I run it ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

segmondy 5 months ago | parent | context | favorite | on: Kimi K2.5 Technical Report [pdf]

You can run it on a mac studio with 512gb ram, that's the easiest way. I run it at home on a multi rig GPU with partial offload to ram.

johndough 5 months ago [–]

I was wondering whether multiple GPUs make it go appreciably faster when limited by VRAM. Do you have some tokens/sec numbers for text generation?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact