TurboPrefill: 3.27× Prefill Speedup in Llama.cpp | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		TurboPrefill: 3.27× Prefill Speedup in Llama.cpp (devpost.com)
		2 points by trykhlieb 61 days ago \| hide \| past \| favorite \| 1 comment

trykhlieb 61 days ago | [–]

TurboPrefill by Trykhlieb is now also available for ik_llama.cpp by Ivan Kawrakow.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact