Saw Wendell do this on the latest GN video and for some reason just knew it needed to be a thing.

  • nixos_fan@lemmy.world
    link
    fedilink
    arrow-up
    1
    ·
    6 days ago

    It’s strange to think selfhosted models are systematically more efficient than cloud hosted ones, have you never heard of economy of scale? Of batching?

    • xbloodymajor@reddthat.com
      link
      fedilink
      English
      arrow-up
      1
      ·
      4 days ago

      Part true but don’t forget, an ai data center is only used for one purpose. Local ai can be used on an existing device that does other useful tasks.