571
Yeah, I should probably donate again or something (europe.pub)
submitted 8 months ago* by to c/linuxmemes@lemmy.world
45 comments fedilink hide all child comments
 

About the only time I find myself using regular Wikipedia these days is if I need to know if someone died since August 2025 when this ZIM dump was created.

you are viewing a single comment's thread
view the rest of the comments
[–] 51 points 8 months ago (15 children)

I have all of wikipedia in a single 156 GB text file. in my .zshrc i have fastWikiLookup() { cat ~/wikipedia.txt | grep "$@" }

  • permalink
  • fedilink
  • source
  • hideshow 15 child comments
    •
  • [–] 59 points 8 months ago (4 children)

    If you want a free and massive performance optimization, remove the cat:

    fastWikiLookup() { grep "$@" ~/wikipedia.txt }

    Reading and piping 156 GB of data to another process every time you want to look something up is a somewhat nontrivial action. Grep can directly read the file, which should result in a pretty damn good speed up.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 12 points 8 months ago (2 children)

    rip Greg would shine here

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 9 points 8 months ago (3 children)

    How fast is it, really? How do you differentiate between topics?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 18 points 8 months ago (1 child)

    the topic differentiation technology doesn't exist yet, so i just hit ctrl+c about a second after i hit enter

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •