• magz :3@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    4
    ·
    5 hours ago

    ehh not exactly. the current wave within ai was started in 2017 with the google paper “attention is all you need”, which introduced the transformer architecture (the T in GPT). deep neural networks were still used for NLP before this, it was just LSTMs instead of transformers, which had various limitations