Load Issues on Orderbox

RCA : The issue was caused due to high latency in DNS resolution on our relay server,  creating a cascading effect on our SMTP and database servers causing it to slow down. 

As a permanent fix, we are making a few infrastructure changes and adding a check to monitor the DNS resolution via our monitoring scripts. 

The issue has been fixed. Orderbox is up and all services are functioning normally. A detailed RCA will be posted by us in the next few hours. 

This issue has been hot-fixed and we're currently in the process of a permanent fix. 

OrderBox is stable and loading as normal. We're continuing to monitor this issue. 

The issue has been identified and we are working towards fixing it at the earliest. Initial debugging has confirmed that there was an issue with our email queue which caused stale connections in our database.

We will post more details in a bit. 

We are currently encountering load on our Orderbox servers, due to which you may face intermittent issues while trying to login to your control panel.

Our System Admin team is already working on this, and efforts are on to resolve the issue at the earliest. We will update this thread as soon as we have any further information.