moved to username e-five on the same instance
It looks like their instance is having some issues https://programming.dev/post/4308156 granted that says outbound but I just joined their matrix and there are other issues being discussed as well, I might wait on this to see if it’s still happening once things get more sorted
edit: i posted in their matrix support channel to see if they noticed anything odd as well 🤞
That is very weird, their /instances page says kbin still… I wonder if they stopped federating / it got marked as an inactive instance by mistake? lemmy.world for instance shows fedia as mbin… I’m not quite sure what this means but they clearly haven’t gotten node info in a while
this might be https://github.com/MbinOrg/mbin/issues/35
it was fixed in the docs but requires manual change by instance owners that were affected, which this instance appears to be. tl;dr the docs recommended the nginx config add_header Referrer-Policy "no-referrer" always; which broke the style of redirects that were being used, it’s now been changed to recommend add_header Referrer-Policy "same-origin" always;
edit: I promise I can read… Your description is slightly different, so it might not be this, but still worth trying it out to see if it helps
Both servers are larger than the single server that infosec.pub runs on, yet infosec.pub has about 10x the traffic, and kbin is struggling under the load.
I wonder what the difference is. One thing I have always wondered is if the double comment / post issue is causing tons of double traffic, not to mention double storage / bandwidth / network costs. I really wish there was an easy solution but I haven’t been able to find any answers. The random thing I thought was like, it looks like everything federates with both fedia.io and www.fedia.io, so I was like maybe everything is double sending on its side? (E.G. if you look at lemmy.world or lemm.ee etc they all list fedia twice.) But people didn’t seem that was likely to be the cause, as hopefully everything is deduped by signing keys rather than hostnames. I don’t know enough to investigate further myself.
One thing I’m trying to keep an eye on is sup. Not much information at all besides a snippet of 1 to 1 encrypted messaging for activitypub, but the tidbit of working with any fediverse account is interesting. Potentially that could help deal with the different fediverse implementations of messaging. Of course, like I said, this is just me making up assumptions, it could not work the way I envision it at all. The creator just posted something 5d ago about it with “soon” though, so I’m hoping to read more about it
The short answer is no but the longer answer for what happens in each situation was detailed here: https://codeberg.org/Kbin/kbin-core/issues/1051
lemmy -> kbin = pretends to send but doesn’t
Maybe gremlins, looks like it’s working now. (I have noticed some 500s, but I assume jerry is still running his auto-null-image-fixer script and it will start working eventually). It’s empty though as is the case with federation they don’t automatically pull in things until added so the past content isn’t there
You can set the default landing page here https://fedia.io/settings/general it’s the first option for homepage. The options are all, subscribed, favorites, and moderated, make sure to click save near the bottom and not the delete account button.
The closest you can get is blocking those domains, it won’t remove everything from them but there isn’t a block instance option at the moment, so remote link posts will still appear from them.
Appreciate the level-headed reply in this thread. There’s a lot of fingerpointing and hostility going on and I’d appreciate it if people would make less assumptions / jumps to attack people. I’m not sure if you or anyone else can confirm, but I agree with ernest that federation of mod actions was working once before. Without knowing exactly why it stopped, it’s hard to say what is going on.
For instance, I just coordinated with the admins of startrek.website as their latest maintenance started blocking user agents with curl in it, which is what kbin sends, meaning all kbin instances stopped being able to get images from their instance. It seems like this is true for multiple other lemmy instances. I didn’t follow up with any other admins at the moment, but I think from that, and the fact that back when I originally signed up people would constantly complain kbin federation was broken when it was lemmy.ml that was blocking kbin, it’s not a good idea to jump to assumptions on why something isn’t working.
Not just on the roadmap, already in :) (fingers crossed no bugs, no promises ><) example
If it’s avatar uploads hopefully it’s something simple like being caught inbetween it being broken and fixed for example https://codeberg.org/Kbin/kbin-core/issues/1022 and all it requires is an update
So my profile as you can see still 500s. There’s also the duplicate thread / comments issue which persists.
jerry just updated to latest yesterday, so fedia now has a lot of the new changes which should hopefully make it a little more stable, though there was a big effort to fix a lot of the 500s riiiiggghhhhtttt as he updated so I’m not sure if he snuck in the middle of those updates or caught them all. Some times I might get a 500 looking at my sub list, but it will fix itself later. I assume jerry is still running scripts which basically try to resolve those issues on a cron job so it might not work for a bit but then work later.
Just to follow up on this, contributors to kbin investigated and found that startrek.website appears to block user agents that contain “curl” in it now.
Example:
curl -v --user-agent "curl" https://startrek.website/pictrs/image/3ff1b940-75da-4e6b-8948-834ebd4b454c.jpeg
times out while:
curl -v --user-agent "anything-else" https://startrek.website/pictrs/image/3ff1b940-75da-4e6b-8948-834ebd4b454c.jpeg
works. kbin apparently sends User-Agent: Symfony HttpClient (Curl) in its requests for images, which is different than how it handles other fetch requests. they’ve made a PR to change kbin to send the user agent it uses elsewhere in those image requests https://codeberg.org/Kbin/kbin-core/pulls/1098 once that is approved / merged they should start working again as instances update. It’d be nice if, assuming this is all accurate, the block on curl could be removed so people don’t have to wait for the PR / instances to update but I understand if that is difficult
This isn’t really a me thing, this is kbin servers themselves. They all fetch the image from the posts and cache it to make thumbnails on their server which they host themselves. Ever since maintenance, the kbin instances appear to have trouble fetching the images to cache them. I’ll try to gather more data from instance admins, perhaps something changed with the request/response headers or something else that is causing them to get blocked.
It looks like ever since this maintenance, no kbin instances can get images from startrek.website:
https://kbin.run/d/startrek.website
https://kbin.social/d/startrek.website?p=3
https://kbin.cafe/d/startrek.website?p=3
https://fedia.io/d/startrek.website/newest?p=4
(the links atm go to ~3 days ago when maintenance happened but ofc will start to drift as more posts are made)
You can see the thumbnails disappear exactly at the mark of the maintenance and ever since then they’re gone. If you see thumbnails after that, they’re usually wrong ones that are being loaded from different posts (there’s a separate issue in for that now). I was wondering if you were aware of any issues or changes that happened because of this maintenance that would prevent kbin instances from fetching thumbnails? I’ve raised this in the kbin matrix chat as well
This might be better reported to the kbin issue tracker https://codeberg.org/Kbin/kbin-core/issues
my profile, as well as hitstuns apparently - https://fedia.io/u/e569668 https://fedia.io/u/hitstun
my microblog sub feed - https://fedia.io/sub/microblog … that doesn’t help you I guess lol, let’s see it appears to be https://fedia.io/m/kbin@kbin.social/microblog and https://fedia.io/m/FloatingIsFun/microblog for me
Definitely can confirm posts that were 500ing for me yesterday are working now though, so thank you for taking the time to fix things up
Regarding image thumbnails, it is quite a mess :( There must be some bugs happening somewhere with the pipeline for caching, and they started being mixed up on kbin.social as well which is worrying
For instance, look at this user https://fedia.io/u/@Facelikeapotato@lemmy.ml almost all of their thumbnails are wrong. Really you can browse https://fedia.io/m/cat@lemmy.world and just look for non-cat pictures. I’ve seen all kinds like nsfw, git repos, news thumbnails, but here are some examples [1] [2] [3].
I posted a theory here https://fedia.io/m/kbinMeta@kbin.social/t/221067/-/comment/1196287 when I noticed that: it seems to happen a lot on instances that go down often or don’t respond quickly, so my guess was it’s having trouble getting a response, and then it just fails and, potentially, uses the next thumbnail value it gets. That’s based off of the thumbnails for nearby entries being similar, as I posted in that comment the one that was wrong was using the same image as a post 31 seconds after it was made
As I posted here https://fedia.io/m/fedia/p/66268 I notice it’s easier to browse with show thumbnails turned off, as that stops the 500s when the image thumbnail has issues. Sadly it still happens on some pages and I ~think that’s because avatars for users, which are also cached, are shown on that page, like the notifications page, and there is no way to disable displaying user avatars on those pages
Minor problem: there’s a new feature of 2fa, but at least for me, going to https://fedia.io/settings/2fa to set it up shows a broken qr code. looks like it’s returning an nginx 404 at the moment