A few years ago anything you wanted to search for would generate hundreds of pages of results. From sources all over. If you structured your query well you could dramatically cut down the irrelevant results and then spend a bit of time skimming through the offerings until you found your target.

Searching felt like a hunt, it could take you to far flung corners of the web, and hitting the jackpot on some obscure forum was part of the fun.

Now searching anything feels incredibly frustrating. You know what you are looking for is out there somewhere but it feels impossible getting to it. Basically we have only two main routes now, Google and Bing (and I swear Bing is just copying Google’s homework). I’ve tried a handful of others and they all fall very short.

Something has changed dramatically under the hood.

It seems like the results are very shallow and no amount of prodding will get either search engine to produce anything besides the laziest output. Any subject has a limited pool of sites they lean on and then pretend that that’s all of the Internet.

It generalizes very quickly and if you try to counter by putting things in quotations it gives up.

Even in the rare moments I’ve buckled and used their stupid AI, it takes even more time browbeating the program to just deliver the damned specifics.

What is going on??

How do we get our old search back?

I swear every day of trying to navigate the web feels worse than the day before.

How did we get here?

There’s got to be something better, right? Or something we can do to pave a new structure that benefits the denizens of the web better than the lazy slop our tech overlords scrape off the table for us. What can we do?

  • historicaldocuments@lemmy.world
    link
    fedilink
    arrow-up
    0
    ·
    2 months ago

    There was more money in showing you things than there was in helping you find things.

    If you ever watched any of the saturday morning, over the air, wrestling “news” shows in the 80s and 90s, then that’s all everything is now. There used to be a pretty good article about it.

  • SillyDude@lemmy.zip
    link
    fedilink
    arrow-up
    0
    ·
    2 months ago

    SEO and decent search results were having a fist fight for years, then AI showed up and shot it in the face.

  • gandalf_der_13te@feddit.org
    link
    fedilink
    arrow-up
    0
    ·
    2 months ago

    the reason why google search results went to shit is because google did some basic maths.

    99% of search queries actually ask for information that you can find on one of the top websites. only about 1% actually care about anything besides that.

    so if you deliver results only due to a rather superficial algorithm, you will still retain about 99% of your userbase, but the computation cost for finding these results would go down dramatically. so you save a lot of money on electricity, while serving almost as many ads. it pays off for google.

  • borokov@lemmy.world
    link
    fedilink
    arrow-up
    0
    ·
    2 months ago

    SEO did this. It started before LLM and chatGPT. Blogger make money be generating trafic. So they wrote shits in a format that please search engine.

    That’s why if you search “search into file Linux”, instead of just a grep command line, you end up on 2000 lines article with introduction, paragraph, explanation, blablabla. Because search engine boost this kind of content. Title, introduction paragraph that repeat the title, subsections, etc…

    • gandalf_der_13te@feddit.org
      link
      fedilink
      arrow-up
      0
      ·
      2 months ago

      yeah, most slop content already existed before chatgpt and was written by humans. kind of like a student is asked to write “a minimum of 500 words for their homework assignment”, too many bloggers copied that attitude to their blogs.

      • SpongyAneurysm@feddit.org
        link
        fedilink
        English
        arrow-up
        0
        ·
        2 months ago

        To my old ears, ‘bloggers’ sounds way too much like the self-employed people with a web-site about their hobby, that they are trying to make a living through.

        But there were already content farms, that paid an army of underpaid people to write something about a subject they had no clue about and plaster it with SEO keywords in order to attract ad revenue.

      • theparadox@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        2 months ago

        yeah, most slop content already existed before chatgpt and was written by humans.

        Sure, I’d say most topics already had slop content. However, LLMs can generate entire websites of slop content in minutes if not less. It’s pointlessly inefficient to employ people to generate slop by hand. Entire news sites are now just LLM generated slop because it was determined to be cheaper than human generated slop. Most slop content is now, and will going forward be, LLM generated.

  • HobbitFoot @thelemmy.club
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    Ever since the deployment of machine generated results for search engines, there has always been a competition between the search engines and various others using search engine optimization to get to the top of the results. It isn’t worth it for Alphabet or Microsoft to fix their search engines if they can push you to AI, so their non-AI results naturally degrade.

  • Ariselas@piefed.ca
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    It’s called enshitification, basically web services get worse so that you spend more time on them and see more adds. Switching from Google to Duck Duck Go has made things a little bit better for me.

    • MrOtingocni@lemmy.worldOP
      link
      fedilink
      arrow-up
      0
      ·
      2 months ago

      Sometimes I want a technically savvy person to explain the inner workings and how it’s changed, but lately I’m just so fed up with it I want to figuratively dump it all in the trash, cancel my data plan, and just live without any Internet at all.

      It feels like we lived through a golden age and it’ll never be that good ever again.

      • RampantParanoia2365@lemmy.world
        link
        fedilink
        arrow-up
        0
        ·
        2 months ago

        Yeah, that’s why I’d just like to write now. I’m done with it all. I’ll wrestle with a fucking word processor, and everyone else can eat a dick.

  • BurntBlueberry@literature.cafe
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    I read an article about it somewhere, but, can’t find it. Basically the guy in charge of search realized they were at the highest level of users they can get so the only way to increase search traffic is to make it just bad enough you have to search different phrasing a couple of times to get the result therefore increasing search traffic.

    • Miller@lemmy.world
      link
      fedilink
      arrow-up
      0
      ·
      2 months ago

      The thing that is eternally forgotten when people ask these sorts of questions, or perhaps it is just deliberately pushed to the back of their minds is that the corporations providing these services are not in the business of providing services, they are in the business of making profit, primarily by finding ways to push as much advertising as is possible. Remembering that is really the only true answer to these sorts of questions.

    • MrOtingocni@lemmy.worldOP
      link
      fedilink
      arrow-up
      0
      ·
      edit-2
      2 months ago

      I’ve read that, too. Probably that same article. I’ve read a few other explanations, about how SEO “ruined” the Internet. How they’ve deliberately handicapped search so you’d use AI, etc.

      I feel like all of this is true but there is also more to all these stories than meets the eye.

      To me it feels like back in the the day everyone just collectively allowed the tech giants to be lifeguards. But then we find out that they’ve been taking money on the side to let people shit in the pool.

      Now the pool is completely filled with the commercial sectors turds and the “lifeguards” want to sell us a scooper to get our carefully curated results out, sans logs.

  • HugeNerd@lemmy.ca
    link
    fedilink
    arrow-up
    0
    ·
    2 months ago

    Because the AI hallucinations are pushed ahead of traditional search engine results?

    This evening I was repairing something. My google search gave an AI summary that gave two important dimensions of a part I needed. I was like “OK let’s go eat”

    Two hours later, because I didn’t write anything down, I entered the same search verbatim and got a different AI summary missing one of the dimensions.

    We have made computing non-deterministic. We’re busy giving sentience to refrigerators that can’t keep ice cream frozen.

  • smiletolerantly@awful.systems
    link
    fedilink
    arrow-up
    0
    ·
    2 months ago

    I know it’s not the thing you likely want to hear, but… At this point, I’m glad I switched to a paid search engine (Kagi).

    Theoretically, there’s nothing stopping them from enshittifying down the road. But at least for now (and hopefully the future) they are a great search engine.

    They have their own index (so no relying on google/bing), and it actually works as I remember Google working 7+ years ago. Minus the ads, and plus a ton of flexibility permanently boosting/removing sites from your searches, auto-grouping/ignoring listicle-type articles in results, flagging sites as AI slop and punishing them for it,…

    They even have a fediverse search “lense” that actually works really well to search Lemmy/mastodon/…

    I just realized I sound like a paid shill. Sorry about that. I’m not.

    • tigerhawkvok@startrek.website
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      2 months ago

      I use Kagi too, it’s great.

      The other commenter corrected your index note.

      What I found most illuminating was a comment by the CEO in an interview, perhaps The Verge? The TLDR of it was that Google makes money when you dwell on their site (so they want the highest ad serves per search), and a paid search engine loses money every page they have to serve you (so they want to give you your answer fast).

      So, the user and Google are at odds, and the user and Kagi have the same goal.

    • ch00f@lemmy.world
      link
      fedilink
      arrow-up
      0
      ·
      2 months ago

      My understanding is that they use Google’s index. It’s just that unlike Google, they aren’t motivated to give you shit results to keep you on their page longer.

      • smiletolerantly@awful.systems
        link
        fedilink
        arrow-up
        0
        ·
        2 months ago

        …oh. My disappointment is immeasurable and my day is ruined.

        Looks like only their “small web” initiative is 100% self-indexed, and everything else is indeed a mixture of sources.

        Oof.

        I guess tue point still stands: the results are a lot better than plain Google, all the bullshit is stripped out and you get to customize your results in actually useful ways.

        Still sad though.

  • Duamerthrax@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    People with bad info put more effort into SEO than people with good info. Google changing focus from getting people good results to getting people to stay on their site. Powers that be filling the web with misinformation. There’s always been conspiracies and misinformation on the internet, but now there’s major money in pushing it.

  • blackbrook@lemmy.ml
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    There are leaked emails from Google (from many years ago) where it was proposed to purposely degrade search quality to increase ad clicks. While some at Google responded with dismay as this, it is not a great leap to assume that this faction eventually won and they did in fact deliberately do that. Advertising is Google’s main revenue source, they are clearly motivated to do so.