this post was submitted on 18 Apr 2026
97 points (98.0% liked)

Technology

84256 readers
3757 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
top 15 comments
sorted by: hot top controversial new old
[–] nyan@lemmy.cafe 13 points 1 week ago (3 children)

Hmm. Using the search term "small website discoverability crisis" . . .

On duckduckgo: original website is the third result (after what looks like a SEO firm's longform ad and ycombinator) without quotes and the first result with.

On startpage: original is the first result even without quotes

On mojeek: original is the first result even without quotes

I do not have accounts with any of these search engines and do not allow them to run Javascript or set cookies, although it's possible that duckduckgo may have noticed that someone with my ip often makes highly specific searches and looks at the long-tail results.

My conclusion from that, combined with other people's searches surfacing large sites first, is that the results you receive can be significantly distorted by the search engine's algorithm. Google in particular is likely trying to direct traffic to its advertising customers and should be avoided for that reason.

[–] lemmydividebyzero@reddthat.com 6 points 1 week ago* (last edited 1 week ago) (1 children)

Hmm. Using the search term “small website discoverability crisis” . . .

Well, do you think that it's realistic that the average user types that into the search engine's website ? When you already know the exact title of the post on that website, you probable already know the full URL and don't need a search engine. So, that has nothing to do with "discovering" in my opinion, which the blog post is about.

[–] gandalf_der_12te@discuss.tchncs.de 2 points 1 week ago* (last edited 1 week ago)

there's at least 3 layers of finding stuff:

  • you already know the full URL
  • you only know the exact article title
  • you don't know the article, but are interested in things of a specific topic
[–] poopkins@lemmy.world 3 points 1 week ago (1 children)

First result on mojeek! Sounds like discovery of the site is great then

[–] nyan@lemmy.cafe 5 points 1 week ago (1 children)

Point is, people are using the wrong tools to look for stuff. So it's a social problem more than a technical one. Those are always the most difficult type to solve.

[–] poopkins@lemmy.world 2 points 1 week ago

The only problem is that we need to change the behavior of about four billion people

[–] WhyJiffie@sh.itjust.works 1 points 1 week ago

first result now in ddg

[–] solrize@lemmy.ml 5 points 1 week ago (1 children)

If I want you to see my webpages I'll send you links or post them someplace relevant. That doesn't completely stop sloperators and other scrapers but it at least slows them down. The more private pages are password protected or whatnot.

[–] gandalf_der_12te@discuss.tchncs.de 2 points 1 week ago (1 children)

password protection means you'll have 0 visitors. it's better to do proof-of-work instead. which means, the visitor's computer solves some cryptographic puzzle to prove that it has spent energy and therefore money to visit the website. that makes scraping millions or billions of websites practically too expensive to do, while if you only visit a single website, it's still reasonably cheap to do.

[–] solrize@lemmy.ml 1 points 1 week ago

The password pages still have visitors. They just have to know the password.

[–] Quexotic@infosec.pub -2 points 1 week ago* (last edited 1 week ago) (2 children)
[–] lemmydividebyzero@reddthat.com 17 points 1 week ago (1 children)

The average user does not have the exact title of the web page.

[–] Quexotic@infosec.pub 1 points 1 week ago

Yep. Different server instances.

[–] Goodlucksil@lemmy.dbzer0.com 0 points 1 week ago (1 children)

For me the top response is Hacker News...

[–] Sxan@piefed.zip -2 points 1 week ago

Hacker News, YCombinator, Reddit, LinkedIn... þe original source page wasn't even on þe first page of results. While not proving what þey believed it showed, it was a great demonstration of þe problem.