As many of you noticed, Singlelink experienced an extended outage yesterday as a result of our service provider MongoDB Atlas failing to throttle another user properly on our shared database, leading to a rare cluster-wide crash that proved inoperable by several members staff for over 12 hours, despite it's critical status.
Despite this, our team worked ruthlessly hard throughout the night and was able to finally obtain access to a backup after several hours and perform a manual restore onto an alternate service provider, being our trusted partners at DigitalOcean.
Moving forward, we're increasing our efforts to maintain our existing software and ensure it's reliability through extended testing, improved public monitoring
, as well as eliminating tech-debt in the stack to prevent future reoccurances. Alongside this, all of our database operations have been moved from our previous service provider to our new provider, DigitalOcean
, effective immediately on Thursday, October 29th, 2020.
We're extremely apologetic for any disruptions this might have cost, as we know many of you depend on Singlelink - and we would hate to lose your trust. We were able to mitigate data-loss, however, we're certain some of you may have been effected in unpredictable ways.
In the event that any of you need help with your profile or want to discuss last-night's event or how we're preventing outages moving forward, my inbox is open and I've listed my phone number below for you to call with your questions & concerns.
Thanks so much for using Singlelink, we appreciate every one of our community members helping us to make the world open-source.
Founder & President of Neutron Creative | Maintainer @ Singlelink
Email: [email protected]
Phone Number: (919) 653-0790