Fastmail partially interrupted for nearly 24 hours

[Berenburger]

And not a single reaction. Glory days are over here.

[BritTim]

Another interpretation of the lack of reaction is that only a very small percentage of the users were inconvenienced.

[xyzzy]

I never noticed a problem. Current status page (as of 7/1 at 8:16PM PDT) says everything is OK but it does mention some users were experiencing a problem. I guess not enough users were affected or it was fixed fast, or the FastMail users that know this forum even exists didn't think it worth mentioning. Well, excluding Berenburger of course!

[Terry]

Must be local.........All good in AU

[Fenman]

I wasn't affected so I didn't post. FWIW the Reddit page received 71 responses so far.

[Bamb0]

I sure hope things are ok!!

[n5bb]

The Fastmail Status page shows that it was an internet routing issue external to Fastmail a couple of days ago. I (and my friends with Fastmail accounts) had no problems. We are in the US. From the status page:

This incident has been resolved. Network connectivity on a limited set of routes had been interrupted due to damage to a cross-site connection. No mail has been lost as a result of this incident, although external delivery of some mail was delayed. We will be taking steps to ensure future incidents like this will be resolved more quickly.

Bill

[Berenburger]

Originally Posted by Fenman

I wasn't affected so I didn't post. FWIW the Reddit page received 71 responses so far.

And on Hacker News 118.

[Berenburger]

Postmortem is out.

[TenFour]

For about 19 hours, Fastmail and a portion of the internet were completely unable to communicate with each other, including a fraction of our customers, and also some email servers.

Interesting read, but what caused the problem?

[BritTim]

Originally Posted by TenFour

Interesting read, but what caused the problem?

Routing table errors on some networks that were out of the control of Fastmail. All Fastmail could do was diagnose which networks seemed to be affected (not easy) and try to locate those responsible for the networks' administration.

[TenFour]

Routing table errors on some networks that were out of the control of Fastmail.

Curious how you know that? Isn't the Internet designed so that traffic automatically moves to other routes if one is blocked?

[BritTim]

Originally Posted by TenFour

Curious how you know that? Isn't the Internet designed so that traffic automatically moves to other routes if one is blocked?

When correctly configured, it is possible for traffic to be routed around temporarily unavailable routes. However, the Internet is not designed to be resilient against configuration errors.