blob42

joined 2 years ago
sorted by: new top controversial old
Cloudflare Starts Blocking Pirate Sites For UK Users - That's a Pretty Big Deal * TorrentFreak in c/piracy@lemmy.dbzer0.com
Anubis is awesome! Stopping (AI)crawlbots in c/selfhosted@lemmy.world
[–] blob42@lemmy.ml 2 points 4 days ago

We need a decentralized community owned cloudflare alternative. Anubis looks on good track.

Anubis is awesome! Stopping (AI)crawlbots in c/selfhosted@lemmy.world
[–] blob42@lemmy.ml 2 points 6 days ago (2 children)

Right I must have just blanket banned the whole /8 to be sure alibaba cloud is included. Did some time ago so I forgot

Anubis is awesome! Stopping (AI)crawlbots in c/selfhosted@lemmy.world
[–] blob42@lemmy.ml 10 points 6 days ago* (last edited 6 days ago) (4 children)

I am planning to try it out, but for caddy users I came up with a solution that works after being bombarded by AI crawlers for weeks.

It is a custom caddy CEL expression filter coupled with caddy-ratelimit and caddy-defender.

Now here's the fun part, the defender plugin can produce garbage as response so when a matching AI crawler fits it will poison their training dataset.

Originally I only relied on the rate limiter and noticed that AI bots kept trying whenever the limit was reset. Once I introduced data poisoning they all stopped :)

git.blob42.xyz {
    @bot <<CEL
        header({'Accept-Language': 'zh-CN'}) || header_regexp('User-Agent', '(?i:(.*bot.*|.*crawler.*|.*meta.*|.*google.*|.*microsoft.*|.*spider.*))')
    CEL


    abort @bot
    

    defender garbage {

        ranges aws azurepubliccloud deepseek gcloud githubcopilot openai 47.0.0.0/8
      
    }

    rate_limit {
        zone dynamic_botstop {
            match {
                method GET
                 # to use with defender
                 #header X-RateLimit-Apply true
                 #not header LetMeThrough 1
            }
            key {remote_ip}
            events 1500
            window 30s
            #events 10
            #window 1m
        }
    }

    reverse_proxy upstream.server:4242

    handle_errors 429 {
        respond "429: Rate limit exceeded."
    }

}

If I am not mistaken the 47.0.0.0/8 ip block is for Alibaba cloud

Gosuki: a privacy friendly, real time, multi-browser, extension-free bookmark manager in c/linux@lemmy.ml
[–] blob42@lemmy.ml 2 points 1 week ago

Not yet, it manages snaps but I can add flatpaks as well. I made it so all definitions are in a single file so that people can easily contribute by testing. I will update the documentation to reflect this.

Gosuki: a privacy friendly, real time, multi-browser, extension-free bookmark manager in c/linux@lemmy.ml
[–] blob42@lemmy.ml 1 points 1 week ago* (last edited 1 week ago)

I am not sure I understand the use case but as it stands now you can select a profile and run Gosuki once, it will import everything from said profile or even all profiles if you prefer.

Gosuki: a privacy friendly, real time, multi-browser, extension-free bookmark manager in c/opensource@lemmy.ml
[–] blob42@lemmy.ml 2 points 1 week ago (1 children)

Thanks for feedback, much appreciated. Yes I totally agree and multi device sync is a top priority that will be hopefully implemented in the next release.

I am developing this program out of personnel need so it keeps me motivated to keep improving it.

Gosuki: a privacy friendly, real time, multi-browser, extension-free bookmark manager in c/opensource@lemmy.ml
[–] blob42@lemmy.ml 1 points 1 week ago (1 children)

Packaging definitely on my todo list: it will cover all common unix platforms

Gosuki: a privacy friendly, real time, multi-browser, extension-free bookmark manager in c/linux@lemmy.ml
[–] blob42@lemmy.ml 5 points 1 week ago* (last edited 1 week ago)

Right now it's not yet built-in but it's on the high priority list of features and should be fairly easy to add soon. It will be either a self hosted sync server or a replicated architecture.

For mobile it can be achieved with the autoimport feature and Syncthing

https://gosuki.net/docs/features/multi_device_sync/

Gosuki: a privacy friendly, real time, multi-browser, extension-free bookmark manager in c/linux@lemmy.ml
Gosuki: a privacy friendly, real time, multi-browser, extension-free bookmark manager in c/linux@lemmy.ml
[–] blob42@lemmy.ml 4 points 1 week ago

Haha I literally had no idea even that Pocket was shutting down !! I guess one more argument to avoid subscription services.

Gosuki: a privacy friendly, real time, multi-browser, extension-free bookmark manager in c/linux@lemmy.ml
[–] blob42@lemmy.ml 13 points 1 week ago

Yes that's exactly how it works. It's the most difficult part of the project especially for Mozilla browsers.

I figured this is the last place browser vendors didn't dare yet to lock us out from it.

94
Gosuki: a privacy friendly, real time, multi-browser, extension-free bookmark manager (github.com)
submitted 1 week ago* (last edited 1 week ago) by blob42@lemmy.ml to c/opensource@lemmy.ml
10 comments fedilink
 

Hi all !

I just released the first version of Gosuki, a multi-browser real time bookmark manager I have been writing on and off for the past few years. It aggregates your bookmarks in real time across all browsers and even external APIs such as Reddit and Github.

I was always annoyed by the existing bookmark management solutions and wanted a tool that just works without relying on browser extensions, self-hosted servers or cloud services. As a developer and Linux user I also find myself using multiple browsers simultaneously depending on the needs so I needed something that works with any browser and can handle multiple profiles per browser.

The few solutions that exist require manual management of bookmarks. Gosuki automatically catches any new bookmark in real time so no need to manually export and synchronize your bookmarks. It allows a tag based bookmarking experience even if the native browser does not support tags. You just hit ctrl+d and write your tags in the title.

Feature Highlights:

  • A single binary with no dependencies or browser extensions necessary. It just work right out of the box.
  • Use the universal ctrl+d shortcut to add bookmarks and call custom commands.
  • Tag with #hashtags even if your browser does not support it. You can even add tags in the Title. If you are used to organize your bookmarks in folders, they become tags
  • Real time tracking of bookmark changes
  • Builtin, local Web UI which also works without Javascript (w3m friendly)
  • suki cli command for a dmenu/rofi compatible output
  • Modular and extensible: Run custom scripts and actions per tags and folders when particular bookmarks are detected
  • Browser Agnostic: Detects which browsers you have installed and watch changes across all of them
  • Also handles multiple profiles per browser
  • Stores bookmarks in a portable sqlite database compatible with the Buku. You can use any program that was made for buku.
  • Can fetch your bookmarks from external APIs (Reddit and Github for now).
  • Easily extensible to handle any browser or API

It's open source with an AGPLv3 license, Checkout the README and website docs for more details.

Edit: Multi device synchronization is not yet available but is on the top priority list and likely implemented in this next release.

37
Gosuki: a privacy friendly, real time, multi-browser, extension-free bookmark manager (github.com)
 

Hi all !

I just released the first version of Gosuki, a multi-browser real time bookmark manager I have been writing on and off for the past few years. It aggregates your bookmarks in real time across all browsers and even external APIs such as Reddit and Github.

I was always annoyed by the existing bookmark management solutions and wanted a tool that just works without relying on browser extensions, self-hosted servers or cloud services. As a developer and Linux user I also find myself using multiple browsers simultaneously depending on the needs so I needed something that works with any browser and can handle multiple profiles per browser.

The few solutions that exist require manual management of bookmarks. Gosuki automatically catches any new bookmark in real time so no need to manually export and synchronize your bookmarks. It allows a tag based bookmarking experience even if the native browser does not support tags. You just hit ctrl+d and write your tags in the title.

Feature Highlights:

  • A single binary with no dependencies or browser extensions necessary. It just work right out of the box.
  • Use the universal ctrl+d shortcut to add bookmarks and call custom commands.
  • Tag with #hashtags even if your browser does not support it. You can even add tags in the Title. If you are used to organize your bookmarks in folders, they become tags
  • Real time tracking of bookmark changes
  • Builtin, local Web UI which also works without Javascript (w3m friendly)
  • suki cli command for a dmenu/rofi compatible output
  • Modular and extensible: Run custom scripts and actions per tags and folders when particular bookmarks are detected
  • Browser Agnostic: Detects which browsers you have installed and watch changes across all of them
  • Also handles multiple profiles per browser
  • Stores bookmarks in a portable sqlite database compatible with the Buku. You can use any program that was made for buku.
  • Can fetch your bookmarks from external APIs (Reddit and Github for now).
  • Easily extensible to handle any browser or API

It's open source with an AGPLv3 license, Checkout the README and website docs for more details.

102
Gosuki: a privacy friendly, real time, multi-browser, extension-free bookmark manager (www.youtube.com)
submitted 1 week ago* (last edited 1 week ago) by blob42@lemmy.ml to c/linux@lemmy.ml
16 comments fedilink
 

Hello r/linux !

I just released the first version of Gosuki, a multi-browser real time bookmark manager I have been writing on and off for the past few years. It aggregates your bookmarks in real time across all browsers and even external APIs such as Reddit and Github.

I was always annoyed by the existing bookmark management solutions and wanted a tool that just works without relying on browser extensions, self-hosted servers or cloud services. As a developer and Linux user I also find myself using multiple browsers simultaneously depending on the needs so I needed something that works with any browser and can handle multiple profiles per browser.

The few solutions that exist require manual management of bookmarks. Gosuki automatically catches any new bookmark in real time so no need to manually export and synchronize your bookmarks. It allows a tag based bookmarking experience even if the native browser does not support tags. You just hit ctrl+d and write your tags in the title.

Feature Highlights:

  • A single binary with no dependencies or browser extensions necessary. It just work right out of the box.
  • Use the universal ctrl+d shortcut to add bookmarks and call custom commands.
  • Tag with #hashtags even if your browser does not support it. You can even add tags in the Title. If you are used to organize your bookmarks in folders, they become tags
  • Real time tracking of bookmark changes
  • Builtin, local Web UI which also works without Javascript (w3m friendly)
  • suki cli command for a dmenu/rofi compatible output
  • Modular and extensible: Run custom scripts and actions per tags and folders when particular bookmarks are detected
  • Browser Agnostic: Detects which browsers you have installed and watch changes across all of them
  • Also handles multiple profiles per browser
  • Stores bookmarks in a portable sqlite database compatible with the Buku. You can use any program that was made for buku.
  • Can fetch your bookmarks from external APIs (Reddit and Github for now).
  • Easily extensible to handle any browser or API

It's open source with an AGPLv3 license, Checkout the README and website docs for more details.

view more: next ›