tag:status.upflow.io,2005:/historyUpflow Status - Incident History2024-03-28T18:39:37ZUpflowtag:status.upflow.io,2005:Incident/191948862023-11-15T18:30:00Z2023-11-22T13:20:54ZApplication outage<p><small>Nov <var data-var='date'>15</var>, <var data-var='time'>18:30</var> UTC</small><br><strong>Resolved</strong> - The application was unavailable for 13 minutes.</p>tag:status.upflow.io,2005:Incident/191948752023-11-03T16:00:00Z2023-11-22T13:19:46ZApplication outage<p><small>Nov <var data-var='date'> 3</var>, <var data-var='time'>16:00</var> UTC</small><br><strong>Resolved</strong> - Application was unavailable for 20 minutes.</p>tag:status.upflow.io,2005:Incident/185389622023-09-19T12:37:06Z2023-09-19T12:37:06ZDelays in sending emails<p><small>Sep <var data-var='date'>19</var>, <var data-var='time'>12:37</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Sep <var data-var='date'>18</var>, <var data-var='time'>20:39</var> UTC</small><br><strong>Investigating</strong> - We are experiencing delays in sending action emails. We are investigating and we will keep you updated.</p>tag:status.upflow.io,2005:Incident/184449892023-09-09T12:37:03Z2023-09-09T12:37:03ZMigration to Google Cloud Platform<p><small>Sep <var data-var='date'> 9</var>, <var data-var='time'>12:37</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Sep <var data-var='date'> 9</var>, <var data-var='time'>08:02</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'> 9</var>, <var data-var='time'>07:59</var> UTC</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance during this time.</p>tag:status.upflow.io,2005:Incident/169603472023-04-25T10:10:39Z2023-04-25T10:10:39ZInability to login with Google Sign-in<p><small>Apr <var data-var='date'>25</var>, <var data-var='time'>10:10</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Apr <var data-var='date'>25</var>, <var data-var='time'>09:31</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and users should be able to properly login with Google Sign-in</p><p><small>Apr <var data-var='date'>25</var>, <var data-var='time'>09:01</var> UTC</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Apr <var data-var='date'>25</var>, <var data-var='time'>06:00</var> UTC</small><br><strong>Identified</strong> - Some users aren't able to login with Google Sign-in. We are working on a resolution.</p>tag:status.upflow.io,2005:Incident/169114132023-04-19T14:00:00Z2023-04-19T13:40:02ZPartial outage<p><small>Apr <var data-var='date'>19</var>, <var data-var='time'>14:00</var> UTC</small><br><strong>Resolved</strong> - We experienced a partial outage.<br />Here is the list of affected features:<br /> - Native integration synchronization: Netsuite, QuickBooks, Xero, Sellsy, Zuora, Sage Intacct<br /> - Automatic collection emails<br /> - Payment receipts<br /> - Autopay<br /> - Invoice status update from "DUE" to "OVERDUE"</p>tag:status.upflow.io,2005:Incident/167106432023-04-01T08:29:47Z2023-04-01T08:29:47ZApplication planned maintenance<p><small>Apr <var data-var='date'> 1</var>, <var data-var='time'>08:29</var> UTC</small><br><strong>Completed</strong> - Maintenance is over</p><p><small>Apr <var data-var='date'> 1</var>, <var data-var='time'>08:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'>31</var>, <var data-var='time'>15:50</var> UTC</small><br><strong>Scheduled</strong> - The application won't be available due to a planned maintenance.</p>tag:status.upflow.io,2005:Incident/110957642022-09-10T13:58:57Z2022-09-10T13:58:57ZDatabase version upgrade<p><small>Sep <var data-var='date'>10</var>, <var data-var='time'>13:58</var> UTC</small><br><strong>Completed</strong> - Scheduled maintenance is still in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'>10</var>, <var data-var='time'>13:10</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'>10</var>, <var data-var='time'>13:06</var> UTC</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance during this time.</p>tag:status.upflow.io,2005:Incident/108981342022-08-23T23:30:00Z2022-08-24T09:21:17ZUpflow app is not available<p><small>Aug <var data-var='date'>23</var>, <var data-var='time'>23:30</var> UTC</small><br><strong>Resolved</strong> - Upflow experienced a full downtime between 2022-08-23 23:26 UTC and 2022-08-24 00:56 UTC because of an issue with our cloud provider's DNS. See here: https://status.heroku.com/incidents/2453</p>tag:status.upflow.io,2005:Incident/102003142022-06-09T13:30:20Z2022-06-09T14:07:36ZEmails can't be sent from the Upflow app<p><small>Jun <var data-var='date'> 9</var>, <var data-var='time'>13:30</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jun <var data-var='date'> 9</var>, <var data-var='time'>12:31</var> UTC</small><br><strong>Investigating</strong> - Our email provider, Mailgun, is undergoing a major outage. They are currently investigating the issue.</p>tag:status.upflow.io,2005:Incident/99749422022-05-06T06:00:00Z2022-05-12T12:40:48ZPartial outage on email sending<p><small>May <var data-var='date'> 6</var>, <var data-var='time'>06:00</var> UTC</small><br><strong>Resolved</strong> - From May 6, 2022 (08:30 CET/02:00 ET) to May 11, 2022 (14:00 CET/08:00 ET), a small percentage of our customer base was affected by an outage on manual & automated email sending. The problem was due to our email provider (Mailgun) and is now resolved.</p>tag:status.upflow.io,2005:Incident/98500022022-04-25T13:50:49Z2022-04-25T13:50:49ZSome users can't access the application<p><small>Apr <var data-var='date'>25</var>, <var data-var='time'>13:50</var> UTC</small><br><strong>Resolved</strong> - The issue has been resolved. Sorry for the inconvenience. Please refresh the page if needed.</p><p><small>Apr <var data-var='date'>25</var>, <var data-var='time'>13:12</var> UTC</small><br><strong>Identified</strong> - We have identified a bug blocking some users of accessing the application. We are working on a solution.</p>tag:status.upflow.io,2005:Incident/90462072022-01-10T15:02:55Z2022-01-10T15:02:55ZUnable to sign-in with Google<p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>15:02</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>14:57</var> UTC</small><br><strong>Monitoring</strong> - A fix has been deployed. Google sign-in should be working again.</p><p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>14:30</var> UTC</small><br><strong>Identified</strong> - Users could be unable to sign-in with Google. We are working on a solution.</p>tag:status.upflow.io,2005:Incident/89607272021-12-29T19:31:39Z2021-12-29T19:31:39ZCustomer timelines might not display correctly<p><small>Dec <var data-var='date'>29</var>, <var data-var='time'>19:31</var> UTC</small><br><strong>Resolved</strong> - The issue has been fixed. Please refresh the page if needed.</p><p><small>Dec <var data-var='date'>29</var>, <var data-var='time'>19:07</var> UTC</small><br><strong>Identified</strong> - Customer timelines might not display correctly. This could prevent user from sending manual action. The issue has been identified and is getting fixed.</p>tag:status.upflow.io,2005:Incident/78418172021-08-25T13:30:00Z2021-08-25T17:06:48ZUpflow app is not available<p><small>Aug <var data-var='date'>25</var>, <var data-var='time'>13:30</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p>tag:status.upflow.io,2005:Incident/77472232021-08-12T14:57:46Z2021-08-12T14:57:46ZUpflow app is not available<p><small>Aug <var data-var='date'>12</var>, <var data-var='time'>14:57</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Aug <var data-var='date'>12</var>, <var data-var='time'>14:44</var> UTC</small><br><strong>Monitoring</strong> - The application is now available; we will write down a Root Cause Analysis document to explain what happened and implement a solution so it doesn't happen again. <br />We are very sorry for the inconvenience.</p><p><small>Aug <var data-var='date'>12</var>, <var data-var='time'>14:17</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating the issue and will make sure to get the app available as soon as possible.</p>tag:status.upflow.io,2005:Incident/69160362021-05-04T15:11:05Z2021-05-04T15:11:05ZCustomer portal email links unreachable<p><small>May <var data-var='date'> 4</var>, <var data-var='time'>15:11</var> UTC</small><br><strong>Resolved</strong> - The issue has now been solved, the links in the emails are now available even for emails sent during the outage. <br />We'll investigate which platforms were impacted and share with them the RCA as well as the impact on their collection emails. We are sorry for the inconvenience.</p><p><small>May <var data-var='date'> 4</var>, <var data-var='time'>14:28</var> UTC</small><br><strong>Identified</strong> - We have identified the current issue. <br />For our users who haven't set up their email domain, a bug was introduced in the app where the portal links are written with HTTPS instead of HTTP. We are working on a fix and will keep you posted as soon as possible.</p><p><small>May <var data-var='date'> 4</var>, <var data-var='time'>14:03</var> UTC</small><br><strong>Investigating</strong> - For a subset of our users, the links in the collection emails are unreachable. <br />We are investigating the issue and are sorry for the inconvenience.</p>tag:status.upflow.io,2005:Incident/68785562021-04-23T17:30:16Z2021-04-30T08:50:27ZAutomated email content regression<p><small>Apr <var data-var='date'>23</var>, <var data-var='time'>17:30</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Apr <var data-var='date'>23</var>, <var data-var='time'>12:30</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p>tag:status.upflow.io,2005:Incident/66473532021-03-26T09:00:00Z2021-03-31T08:51:50ZProcessing delays on integrations and CSV imports<p><small>Mar <var data-var='date'>26</var>, <var data-var='time'>09:00</var> UTC</small><br><strong>Resolved</strong> - Following the deployment of a new version of the app, several services were slow down, including data synchronization from integration and CSV imports.<br />This was due to a large number of additional resource-intensive jobs triggered by this update.<br />On Monday, 29th of March, we reverted those changes and the services were back to normal the same day at 10:21 AM UTC.<br />We are sorry for the inconvenience caused.</p>tag:status.upflow.io,2005:Incident/66089222021-03-25T16:56:11Z2021-03-25T16:56:11ZCDN issues<p><small>Mar <var data-var='date'>25</var>, <var data-var='time'>16:56</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved, the website (https://upflow.io) is available.<br />Whereas Netlify is still experiencing issues, we found an alternative way to deploy the website.</p><p><small>Mar <var data-var='date'>25</var>, <var data-var='time'>16:18</var> UTC</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Mar <var data-var='date'>25</var>, <var data-var='time'>16:13</var> UTC</small><br><strong>Identified</strong> - Our CDN provider (netlify) is currently experiencing issues which is affecting our website (https://upflow.io). They are currently investigating. Our application (https://app.upflow.io) remains functional.</p>tag:status.upflow.io,2005:Incident/64057462021-02-25T13:03:05Z2021-03-16T13:50:22ZThis is an example incident<p><small>Feb <var data-var='date'>25</var>, <var data-var='time'>13:03</var> UTC</small><br><strong>Resolved</strong> - Empathize with those affected and let them know everything is operating as normal.</p><p><small>Feb <var data-var='date'>25</var>, <var data-var='time'>12:53</var> UTC</small><br><strong>Monitoring</strong> - Let your users know once a fix is in place, and keep communication clear and precise.</p><p><small>Feb <var data-var='date'>25</var>, <var data-var='time'>12:59</var> UTC</small><br><strong>Identified</strong> - As you continue to work through the incident, update your customers frequently.</p><p><small>Feb <var data-var='date'>25</var>, <var data-var='time'>13:29</var> UTC</small><br><strong>Investigating</strong> - When your product or service isn’t functioning as expected, let your customers know by creating an incident. Communicate early, even if you don’t know exactly what’s going on.</p>