Skip to content

Why is data congregation so hard on Mastodon?

Fediverse
9 5 11
  • This applies to any of the microblogging software. Akkoma, IceShrimp, etc. I go to any Lemmy instance, big or small, and the up/downvote data and replies are basically all the same. The same goes for Peertube, and most services that aren't Mastodon and the gang. Why is this? Is it because of older design? Unexpected issues cropping up with scale? It seems to be such a big struggle over there, but for everyone else, it's whatevs.

    I would love to permanently reside on a smaller Mastodon instance or host my own, but I often find that many posts are unavailable and a lot of replies I want to reply to don't exist. It is an incredibly frustrating experience.

  • This applies to any of the microblogging software. Akkoma, IceShrimp, etc. I go to any Lemmy instance, big or small, and the up/downvote data and replies are basically all the same. The same goes for Peertube, and most services that aren't Mastodon and the gang. Why is this? Is it because of older design? Unexpected issues cropping up with scale? It seems to be such a big struggle over there, but for everyone else, it's whatevs.

    I would love to permanently reside on a smaller Mastodon instance or host my own, but I often find that many posts are unavailable and a lot of replies I want to reply to don't exist. It is an incredibly frustrating experience.

    Lemmy and lots of other software use a fediverse extension called 1b12 to keep everything in sync.

    In a nutshell it means Lemmy communities can follow other communities, and they keep each other in sync. The same applies for other types of communities, like PieFed communities, Mbin magazines, NodeBB categories, etc.

    Mastodon doesn't have a concept of community or categories, so they don't support this kind of synchronization.

  • Thank you, this makes sense. Is there any hope for Mastodon and other services to achieve a similar level of parity without eating up a ton of space? I feel like it is a big hurdle for Fedi, but I understand these things take time and a ton of work.

  • Thank you, this makes sense. Is there any hope for Mastodon and other services to achieve a similar level of parity without eating up a ton of space? I feel like it is a big hurdle for Fedi, but I understand these things take time and a ton of work.

    Sure, check out my post about it here:

    There are steps being taken in the right direction.

  • This applies to any of the microblogging software. Akkoma, IceShrimp, etc. I go to any Lemmy instance, big or small, and the up/downvote data and replies are basically all the same. The same goes for Peertube, and most services that aren't Mastodon and the gang. Why is this? Is it because of older design? Unexpected issues cropping up with scale? It seems to be such a big struggle over there, but for everyone else, it's whatevs.

    I would love to permanently reside on a smaller Mastodon instance or host my own, but I often find that many posts are unavailable and a lot of replies I want to reply to don't exist. It is an incredibly frustrating experience.

    Its all about pub sub relations. Being on a smaller instance in mastodon means u miss a whole bunch of activity and thus don't have the full picture.

    Lemmy and others have a community which means a community receives an activity and then that community pushes that activity to all its subscribed instances. So in lemmy u need at least 1 user from ur instance to subscribe to a community for its activity to be sent to ur instance.

    On mastodon all activity by a user is sent to all instances with at least one user who follows that user. So if nobody on ur instance follows a specific user then their content will never show up on ur instance. Its a difficult problem to solve as u can't just send all activity to all instances cos that will overload most instances. Their are relays that relay activities from its member instances to other instances but as u would expect the larger the relay the more content u must deal with on ur instance and u can get overloaded pretty quick.

    The whole point of federation is to send activities only to instances that need them as not to force everyone to have the entire fediverse on their server and handle and activities from the entire fediverse (one of the reasons bluesky federation doesn't work for small instances).

  • Very interesting read!

  • This applies to any of the microblogging software. Akkoma, IceShrimp, etc. I go to any Lemmy instance, big or small, and the up/downvote data and replies are basically all the same. The same goes for Peertube, and most services that aren't Mastodon and the gang. Why is this? Is it because of older design? Unexpected issues cropping up with scale? It seems to be such a big struggle over there, but for everyone else, it's whatevs.

    I would love to permanently reside on a smaller Mastodon instance or host my own, but I often find that many posts are unavailable and a lot of replies I want to reply to don't exist. It is an incredibly frustrating experience.

    I started my own GoToSocial instance this week, and found the same. TBH, from my exported list of about 160 people I from followed on Mastodon, I only re-followed 6.

    These were all longstanding relationship - a couple of which started on Twitter when it was OK.

  • This was very interesting! While I don't fully understand everything, based on what I can, I'm partial to the second one. If the the instance disappears, I doubt the hoster wants that stuff up anyway. It makes it easier on everyone, and the replies seem (?) to stay up as well. A win-win. Either way it goes, I can only be thankful to the engineers working so hard to make this a reality. 🙏

  • This was very interesting! While I don't fully understand everything, based on what I can, I'm partial to the second one. If the the instance disappears, I doubt the hoster wants that stuff up anyway. It makes it easier on everyone, and the replies seem (?) to stay up as well. A win-win. Either way it goes, I can only be thankful to the engineers working so hard to make this a reality. 🙏

    Thanks! It's something that I personally feel is more performant and future proof for other important things like private discussions (which Mastodon also doesn't support natively yet — mention spamming doesn't count.)

Diese Artikel könnten Dich auch interessieren.

  • 0 Stimmen
    4 Beiträge
    0 Aufrufe
    julian@community.nodebb.orgJ
    box464@mastodon.social we're thrilled to have been funded for another round! There's a lot we want to accomplish and we'll be working on our milestone list in the coming weeks. Context discovery is just one exciting thing we have planned!
  • OF alternative fediverse?

    Uncategorized fediverse
    12
    0 Stimmen
    12 Beiträge
    14 Aufrufe
    julian@community.nodebb.orgJ
    Tell me about it! There are some very cool people (i.e. thisismissem@hachyderm.io) working on content classification and tagging so that the burden of filtering out this kind of content isn't borne by server admins directly.
  • Voting in the threadiverse

    Uncategorized fediverse
    18
    1
    0 Stimmen
    18 Beiträge
    18 Aufrufe
    julian@community.nodebb.orgJ
    snoopy@jlai.lu personally, since I create AP enabled software I am on the side of votes being public data. We already have enough issues with votes being out of sync with each other. Mixing in private voting is just asking for trouble. Emoji reactions are neat, although niche to those softwares that utilise it. They allow for greater expression which is nice. They're useless for deriving value (for ranking purposes) unless you assign value to them.
  • UPDATE: That only took a minute after my toot!

    Uncategorized peertube framasoft fediverse
    2
    1
    0 Stimmen
    2 Beiträge
    4 Aufrufe
    jwildeboer@social.wildeboer.netJ
    Yeeeeeeaaahhh! €55k done, let's max it out in the next 30 hours Peertube is going places!
  • 0 Stimmen
    16 Beiträge
    37 Aufrufe
    julian@community.nodebb.orgJ
    For what it's worth your blog does show up fine in NodeBB as well. Perhaps you are missing the @context property and so Mastodon is refusing to parse it?
  • Missing project?

    Uncategorized fediverse
    11
    0 Stimmen
    11 Beiträge
    57 Aufrufe
    julian@community.nodebb.orgJ
    m_f@discuss.online not directly, but there was a session at FediForum on Thursday that discussed the website and next steps for updating it. It's been stagnant for quite awhile but evan@cosocial.ca and j12t@j12t.social finally have write access to the repo and control of the domain.
  • Slrpnk.net outage

    Uncategorized fediverse
    96
    0 Stimmen
    96 Beiträge
    379 Aufrufe
    julian@community.nodebb.orgJ
    blazeknave@lemmy.world beep beep boop boop boop boop beep... EEEEEEEEEEeeeeeeee awwwwwww ka-dong ka-dong da kshhhhhhhhhhhhhhHHHHHHHHHHHHHHHHHHHHHHHHHH eerie silence
  • Blogtastisch: 2. Blogs und das Fediverse

    notizBlog activitypub blogs fediblog fediverse weblogs
    17
    1
    0 Stimmen
    17 Beiträge
    181 Aufrufe
    caromite@troet.cafeC
    @pfefferle Wow, danke für das super Video! Für mich ist das Fediverse noch ganz neu, hab jetzt mein Blog föderiert und mir einen Account bei Mastodon erstellt. Fühle mich noch etwas verloren, aber bin überzeugt auf dem richtigen Weg zu sein