piefed
Pixelfed is for images. Think Instagram without Meta breathing down your neck.
Piefed is for communities. Think Reddit without the corporate overlords.
But here’s the beauty: both run on the #Fediverse, which means they actually talk to each other. I’ve posted from Pixelfed right into Piefed—something you’ll never see in the walled gardens.
How to use Really Simple Licensing (RSL) to block all AI crawlers
RSL is a new initiative by a group of big internet publishers that seeks to define the conditions under which AI crawlers can harvest their content. Their guide describes the various ways the content can be made available, including for free or a paid royalty but only by digging deeper into their reference material was I able to figure out how to prohibit all usage.
Your robots.txt needs to link to a XML file, like this:
License: https://your-domain.tld/rsl.xml
Then in that file you want this:
<rsl xmlns="https://rslstandard.org/rsl"> <content url="/" server="https://rslcollective.org/api"> <license> <prohibits type="usage">all</prohibits> </license> </content></rsl>
That’s it.
If you want to be more liberal you could change the <prohibits> line to
<permits type="usage">search</permits>
That will let them use the content for search, which is probably quite similar to what traditional search engines do. More details in their reference docs.
Optionally to dispel any plausible deniability you can also add a link to rsl.xml as a Link header in every HTTP response.
Link: <https://example.com/rsl.xml>; rel="license"; type="application/rsl+xml"
It’s still too early to say whether AI crawlers will respect the terms of the license any publishers specify, it’ll probably take a court case or two to sort that out.
PieFed has added RSL to it’s code just now. Instance admins who wish to disable RSL can set the ALLOW_AI_CRAWLERS environment variable to anything.
Reppin’ the Fedi:
“I don’t use Youtube, I use #Peertube,
(for uploads, #Invidious for viewing), 
I won’t use Insta, it’s #Pixelfed,
I f**ked off Facebook for #Friendica,
X/Twitter, whatever, find me on #Mastodon,
I shed it: Reddit for #Piefed, 🔵
TikTok it won’t take long for your groups, 🩴
to flick flock to #Loops.”
🎶 https://spectra.video/w/mNieEJNJbV2Xg5zmUnsFsG 🕺
@peertube @invidious @pixelfed @Mastodon @andypiper @piefedadmin @dansup
there is currently a #Piefed Hackathon going on if anyone is interested in partaking. There are groups working on spanish, german, french and japanese translations, and a bunch of other things.
https://tarte.nuage-libre.fr/c/fediverse/p/221411/hackathon-this-week-7-8-febuary #fediverse #fedidev #activitypub
I've seen the raw HTML for some #piefed post content showing in the spoilerText field on some platforms via the mastodon api, including #gotosocial, #neodb (takahe/incarnator) and I think #pleroma. My current kludge is to check the spoilerText for html tags (specifically, a beginning <p>).
The first commit to the git repository was this day in 2023.
What a ride, how time flies, etc.
So many people have helped and contributed, in big and small ways. Code, translations, ideas, testing, feedback, writing docs, running instances - PieFed wouldn’t be what it is without you all!
Thank you to everyone who has been a part of this journey so far! Onwards to the next chapter!
PieFed is 3 years old today
https://piefed.social/c/piefed_meta@piefed.social/p/2241694/piefed-is-3-years-old-today
I can't explain how excited I am to be able to speak with @evan tomorrow, May 27th at 14:00 US Eastern time (UTC-4).
If you don't know Evan, he is co-editor of ActivityPub, the W3C standard for decentralized social networking used by platforms such as #Mastodon , #Bonfire , #GoToSocial , #Peertube , #Owncast , #Loops , #PixelFed , #Emissary , #Fedify , #FlohMarkt , #Lemmy , #Piefed , #WriteFreely , #Friendica , #GNUSocial , #Threads , #NodeBB , #Funkwhale , #Gancio , #Mobilizon , #BookWyrm , and MANY MANY MANY MORE + whatever YOU create next!
I've been speaking with folks and they've given him a very special nickname. You'll have to tune in tomorrow of catch the #VOD to catch it.
#livestream stream.firesidefedi.live
#vodcast tubefree.org/@firesidefedi
Or follow everything directly with @ozoned and @firesidefedi
And follow @when for listings of future episodes!
AI scrapers have been hammering fediverse servers for years with things getting especially intense lately. Fediverse developers have been slow to respond with solutions so desperate instance admins have been bolting on Anubis which is fragile and really hard to configure in a way that doesn’t break federation, mobile clients or web UI access. Anubis forces browsers to run some CPU-heavy javascript for a few seconds, increasing the cost to scrapers hopefully to the point where they go elsewhere instead.
PieFed now includes that functionality as a core feature, not a separate container, proxy or process that needs to be set up. Just set the ANOOBIS environment variable and you’re done. Yes, that spelling is intentional.
The amount of work a client needs to do can be tuned with the ANOOBIS_DIFFICULTY_DESKTOP and ANOOBIS_DIFFICULTY_MOBILE environment variables - the defaults are quite weak.
Early results are very promising and a 50% CPU and network reduction on the server is commonly seen. Clients that are not logged in will see a brief loading screen, once every 1000 days, before being taken to the post they were trying to view.
I’m sure this isn’t the end of this war but I’ve been enjoying a respite from it for the last week, long may it continue.
(Image supplied by @[email protected], thank you!)
PieFed 1.7.9 includes Anubis-like scraper blocking
And for my next trick: Catodon forums.
Yep. I'm bringing the threadiverse to the misskeyverse.
#catodon #lemmy #piefed #nodebb #threadiverse
MAU are tanking across every major platform and nobody wants to say what's obvious — the corporate social media model is broken.
People are sick of being fed algorithmic garbage and influencer ads disguised as content.
The fediverse is what social media was supposed to be.
Human connections.
No gamification.
No bullshit.
GotoSocial, Loops and Piefed aren't just part of the next chapter — we're writing it.
🚀
@FediFollows you ought to include the contacts of #opensource champions like the #developers of #linux #distros like #mxlinux #linuxMint #debian #archlinux, #developers of some prime #mastodon instances, #piefed instances, #codeberg , #github and email services like #mailo and #proton.
That way, we would be able to reach out to them through #socialmedia whenever we need their support.
This informal channel is oftentimes better than your regular email.
