Follow on, great question (separately from John) can it run on Vulkan? He was sa... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Unheard3610 72 days ago \| parent \| context \| favorite \| on: Launch HN: LlamaFarm (YC W22) – Open-source framew... Follow on, great question (separately from John) can it run on Vulkan? He was saying he has a hard time finding stuff that doesn’t only run on CUDA or ROCm and sees this as a huge opportunity

rgthelen 72 days ago [–]

Yes! Vulcan support is in dev (will be in the next versioned release, probably tomorrow).

You can pull down the repo and run a few easy commands to get inference up and running.

https://docs.llamafarm.dev/docs/models#lemonade-runtime

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact