Can you manage your house with a local, no-cloud voice assistant? Mostly, yes. - eviltoast
  • CubitOom@infosec.pub
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    Ok, hmm I wonder how much work it would be to implement it using open source models. I think the hardest part would be translating the voice instructions to an API call that HA can use correctly.

    Then there is the whole hardware issue to fix too. I do know that some SOCs are getting good at running 7B parameter models locally but the cost is still probably going to be prohibitive.