cross-posted from: https://lemmy.world/post/23471887
About updating Lemmy & explanation of recent federation issues with lemmy.ml
Hello World,
as many of you know, several newer Lemmy versions have been released since the once we are currently using.
As this is a rather long post, the TLDR is that we’re currently planning for late January/early February to update Lemmy.World to a newer Lemmy release.
We’re currently running Lemmy 0.19.3 with a couple patches on top to address some security or functionality issues.
As new Lemmy versions have been released, we’ve been keeping an eye on other instances’ experiences with the newer versions, as well as tracking certain issues on GitHub, which might impact stability, moderation experience or user experience.
We updated to Lemmy 0.19.3 back in March this year. At that point, 0.19.3 had been released for a little over a month already and at that point all the major issues that troubled the earlier 0.19 releases had been addressed.
Several months later, in June, Lemmy 0.19.4 was released with several new features. This was a rather big release, as a lot of changes had happened since the last release. Only 12 days later 0.19.5 was released, which fixed a few important issues with the 0.19.4 release. Unfortunately, Lemmy 0.19.5 also introduced some changes that were, and to some part are still not fully addressed.
Prior to Lemmy 0.19.4, regular users may see contents of removed or deleted comments in some situations, primarily when using third party apps. Ideally, this would have been fixed by restricting access to contents of removed comments to community moderators in the communities they moderate, as well as admins on each instance. Deleted comments will be overwritten in the database after some delay, but they might still be visible prior to that. This is especially a problem when moderators want to review previously removed comments to either potentially restore them or to understand context in a thread with multiple removed comments. Lemmy modlog does not always record individual modlog entries for bulk-removed items, such as banning a user while also removing their content would only log their ban but not the individual posts or comments that were removed.
We were considering writing a patch to restore this functionality for moderators in their communities, but this is unfortunately a rather complex task, which also explains why this isn’t a core Lemmy feature yet.
While admins can currently filter modlog for actions by a specific moderator, this functionality was lost somewhere in 0.19.4. While this isn’t something our admin team is using very frequently, it is still an important feature to have available for us for the times we need it.
This also included a few security changes for ActivityPub handling, which resulted in breaking the ability to find e.g. Mastodon posts in Lemmy communities by entering the post URL in the search. It also caused issues with changes to communities by remote moderators.
The 0.19.4 release also broke marking posts as read in Sync for Lemmy. Although this isn’t really something we consider a blocker, it’s still worth mentioning, as there are still a lot of Sync for Lemmy users out there that haven’t noticed this issue yet if they’re only active on Lemmy.World. Over the last 2 weeks we’ve had nearly 5k active Sync for Lemmy users . This is unfortunately something that will break during the upgrade, as the API has changed in upstream Lemmy.
There were also several instances reporting performance issues after their upgrades, although they seemed to mostly have been only for a relatively short time after the upgrades and not persistent.
Lemmy 0.19.6 ended up getting released in November and introduced quite a few bug fixes and changes again, including filtering the modlog by moderator. Due to a bug breaking some DB queries, 0.19.7 was released just 7 days later to address that.
Among the issues fixed in this release were being able to resolve Mastodon URLs in the search again and remote moderators being able to update communities again.
0.19.6 also changed the way post thumbnails generated, which resulted thumbnails missing on various posts.
A month later, now we’re in December, 0.19.8 was released.
One of the issues addressed by 0.19.8 was Lemmy returning content of removed comments again for admins. For community moderators this functionality is not yet restored due to the complexity of having to check mod status in every community present in the comment listing.
At this point it seems that most of the issues have been addressed, although there seem to still be some remaining issues relating to thumbnails not reliably being created in some cases. We’ll keep an eye on any updates on that topic to see if it might be worth waiting a little longer for another fix or possibly deploying an additional patch even if it may not be part of an official Lemmy release yet at the time.
While we were backporting some security/stability related changes, including a fix for a bug that can break federation in some circumstances when a community is removed, we accidentally reverted this patch while applying another backport, which resulted in our federation with lemmy.ml breaking back in November. This issue was already addressed upstream a while back, so other instances running more recent Lemmy versions were not affected by this.
Among the new features released in the Lemmy versions we have missed out on so far, here are a couple highlights:
- Users will be able to see and delete their uploads on their profile. This will include all uploads since we updated to 0.19.3, which is the Lemmy version that started tracking which user uploaded media.
- Several improvements to federation code, which improve compatibility with wordpress, discourse, nodebb.
- Fixing signed fetch for federation, enabling federation with instances that require linked instances to authenticate themselves when fetching remote resources. Not having this is something we’ve seen cause issues with a small number of mastodon instances that require this.
- Site bans will automatically issue community bans, which means they’re more reliable to federate.
- Deleted and removed posts and comments will no longer show up in search results.
- Bot replies and mentions will no longer be included in notification counts when a user has blocked all bots.
- Saved posts and comments will now be returned in the reverse order of saving them rather than the reverse order of them being created.
- The image proxying feature has evolved to a more mature state. This feature intends to improve user privacy by reducing requests to third party websites when browsing Lemmy. We do not currently plan on enabling it with the update, but we will evaluate it later on.
- Local only communities. We don’t currently see a good use for these, as they will prevent federation of such communities. This cuts off users on all other instances, so we don’t recommend using them unless you really want that.
- Parallel sending of federated activities to other instances. This can be especially useful for instances on the other side of the world, where latency introduces serious bottlenecks when only sending one activity at a time. A few instances have already been using intermediate software to batch activities together, which is not standard ActivityPub behavior, but it allows them to eliminate most of the delays introduced by latency. This mostly affects instances in Australia and New Zealand, but we’ve also seen federation delays with instances in US from time to time. This will likely not be enabled immediately after the upgrade, but we’re planning to enable this shortly after.
Last time we spammed this community with sinks the app was updated a few days later …
As someone who used sync on reddit for many years, I switched to Summit a few weeks ago and it’s great. This post comparing a lot of lemmy apps made me finally take the plunge: https://lemmy.world/post/18159531
Same for me. I used Sync since switching to Lemmy but this issue with marking as read is a deal breaker for me. Especially since I actually paid for Sync. Now on Summit and I’m very satisfied. I highly recommend everyone checking it out!
Thanks for this. Summit is great. Smooth, clean, has gesture support that’s similar to sync.
I didnt even realize the “empty comments” was a sync issue and not a lemmy issue. Looks like its time to move on.
I quit Sync months ago, I’ve been using Voyager and I love it. It actually has better functionality than Sync and somehow it manages to stay within 12 months of being up to date with the rest of the Fediverse.
Frankly LJD burned any good will and I don’t plan on ever returning. Save your money and time and go with a FOSS alternative.
Jerboa for the win.
You could try emailing. If enough people do maybe he’ll pay attention.
As someone who came over from reddit basically via Sync, this is normal. Dev likes to go MIA for extended periods of time and suddenly appears with huge updates.
Doesn’t suit the still developing environment here, though.
I get that it’s always been like that. I’ve used sync for as long as it’s been around basically.
Just switched recently to Thunder. It’s a bit slower but has a lot of options. Its working fine… And this is from a person who has been many times over the years and is currently paying for sync.
Sync is more reddit than reddit was. And is my Lemmy experience up until a few days ago.
Also just extremely rude… Everyone would understand if he puts out a short message like “busy with work for the next few months”. Randomly leaving for months while people pay for something you make is crazy.
I wouldn’t characterize that as “extremely rude”.
Idk, we don’t have to use it, tons of clients out there…
Sure we don’t, but as a long time subscriber on reddit then Lemmy, who doesn’t even need the ultra features but wanted to support the dev, I’ve been feeling bamboozled for a few months now…
Dude saw the project of his life absolutely destroyed by Reddit. I can understand he just wants to move to the next chapter of his life.
Sure a bit of communication is always appreciated but it’s already pretty cool he ported the app to Lemmy.
Dude saw the project of his life absolutely destroyed by Reddit. I can understand he just wants to move to the next chapter of his life.
Yeah, no. That doesn’t hold water when you’re actively accepting payments for an app on a new platform but not maintaining it for long periods of time.
He didn’t move on with his life. He ported sync to lemmy, dramatically increased the pricing model, and now seems to go AWOL for extended periods of time often resulting in broken functionality.
Still very shitty behavior when you’re asking for 20€
Wait, what?! I’m on sync right meow and haven’t noticed anything off about it. But i also don’t have any other source of news or social media to compare to lol.
The most shocking revelation tho is that I haven’t paid a dime to use synce and it’s been my only means of accessing Lemmy since I annexed from reddit. There is an option for premium but there is nothing about the free version that I would feel I’m missing out on something enough to pay for it.
When the dev announced he’d be porting Sync to Lemmy, he mentioned that he’d have to raise the premium price to cover costs. I gladly paid to support him, but that was under the assumption he wouldn’t go AWOL for months with outstanding bugs.
Just an inefficient service.
As a sync user on an instance that’s up-to-date, this is not too annoying. If you up/downvote it will still show as read. But I hope lj comes back soon. We are due an update for a long time.
Yes sad that @[email protected] have been inactive for so long, and without him support Sync I am afraid Sync will die.
Yeah. If the problems start stacking up and making it near unusable, I’ll have to switch to another app. And I hope it doesn’t come to that, because the user experience and customizability is leagues above other apps.
If you have to switch, give Thunder a try. It is a very well put together app. And I enjoy it, and you might as well.
I have over a dozen apps locked and loaded. But I can’t quit sync yet
Yeah same. It just looks and feels the best sadly.
The 0.19.4 release also broke marking posts as read in Sync for Lemmy. Although this isn’t really something we consider a blocker, it’s still worth mentioning, as there are still a lot of Sync for Lemmy users out there that haven’t noticed this issue yet if they’re only active on Lemmy.World. Over the last 2 weeks we’ve had nearly 5k active Sync for Lemmy users . This is unfortunately something that will break during the upgrade, as the API has changed in upstream Lemmy.
