• MintyAnt@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    19 hours ago

    This has been stated since ChatGPT was released and has not happened. The video cards released specifically for LLM usage do not benchmark particularly better than the previous generation. And it’s still unbelievably expensive to run these cards and maintain the facility and, again, you only get like 3 or 5 years out of them! That’s a crazy investment lol

    • NotMyOldRedditName@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      8 hours ago

      But the new GPUs absolutely can run the GPTs from back then better. We just dont want that anymore, we want the better bigger models that continue to be as or more expensive as what it was back then.

      When you replace the cards in 5 years it’ll run it even better. We just wont want that then.

      Edit: and gains dont have to be huge, even 5-10% between generations, but take that to 10 years like I said and it can be substantial.