@MrWhosetheboss video reveals Google's Pixel 8 Pro Tensor G3 off-loads all generative AI tasks to the cloud - eviltoast
  • ᗪᗩᗰᑎ@lemmy.ml
    link
    fedilink
    English
    arrow-up
    23
    arrow-down
    3
    ·
    1 year ago

    And a lot of those require models that are multiple Gigabytes in size that then need to be loaded into memory and are processed on a high end video card that would generate enough heat to ruin your phones battery if they could somehow shrink it to fit inside a phone. This just isn’t feasible on phones yet. Is it technically possible today? Yes, absolutely. Are the tradeoffs worth it? Not for the average person.