Mastadon Toot Collection
In order to analyze social structures, I want to collect as many statuses as possible.
I need a NoSQL instance that is fed with toots by workers.
# Nodes
# Database
Hosts a NoSQL database.
It should contain a collection for Toots, as well as a collection for Mastodon instances.
It probably also can do some maintenance tasks like discovering new Mastodon servers.
# Workers
Many worker nodes that fetch Toots from the public timeline of each Mastodon instance. Every day, they fetch unscanned instances from the database and fetch all toots from the instance starting from the newest toot in the database.