Archive

15 Apr 2024
We will be performing scheduled server maintenance in our EU-WS data center. Due to upcoming migration of the datacenter from Linode to AWS a full cluster restart is required. Maintenance is scheduled for Sunday 21st of April at 23:00 CEST (Sunday 21:00 UTC). We expect service degradation (ticket / filters non visible) which will take around ~30 minutes.
05 Apr 2024
We will be performing scheduled server maintenance in our US-NJ data center. Due to upcoming migration of the datacenter from Linode to AWS a full cluster restart is required. Maintenance is scheduled for Sunday 7th of April at 3am EDT (07:00 UTC / 9:00 CEST). We expect service degradation (ticket / filters non visible) which will take around ~30 minutes.
26 Mar 2024
Resolved in 1 hours and 0 minutes
resolved
We are delighted to announce that the call center outage affecting our customers has been successfully resolved, and all affected services are now fully restored. Our technical team managed to address the root cause of the issue and implement the necessary fixes to ensure a smooth and stable experience for all our users. We apologize for any inconvenience this outage may have caused.
2024-03-26 12:00 UTC
investigating
We are currently experiencing an unexpected call center outage affecting our Singapore data center(s). This outage has resulted in limited access to call center services. Our technical team is actively working to identify the root cause of the issue and restore full functionality ASAP. We understand the inconvenience this may cause and assure you that we are taking all necessary steps to resolve this incident promptly. We will continue to provide updates on our status page and will notify you once the services are fully restored. We appreciate your patience and understanding during this time.
2024-03-26 11:00
16 Mar 2024
Resolved in 0 hours and 23 minutes
resolved
We are delighted to announce that the outage affecting our customers has been mitigated, and all affected services are now restored. Our team will continue monitoring the status of our servers. We apologize for any inconvenience this outage may have caused.
2024-03-16 10:51 UTC
investigating
We are currently experiencing an unexpected outage affecting our Europe data center. This outage has resulted in limited access to the panel and our services. Our team is actively working to identify the root cause of the issue and restore full functionality as soon as possible. We understand the inconvenience this may cause and assure you that we are taking all necessary steps to resolve this incident promptly. We will continue to provide updates on our status page and will notify you once the services are fully restored.
2024-03-16 10:28
28 Feb 2024
Resolved in 0 hours and 19 minutes
resolved
We are delighted to announce that the connectivity outage affecting our customers has been successfully resolved, and all affected services are now fully restored. Our technical team managed to address the root cause of the issue and implement the necessary fixes to ensure a smooth and stable experience for all our users. We apologize for any inconvenience this outage may have caused.
2024-02-28 01:55 UTC
investigating
We are currently experiencing an unexpected connectivity outage affecting our US - New Jersey data center(s). This outage has resulted in limited access to the following services: Admin, Calls, Tickets and Emails. Our technical team is actively working to identify the root cause of the issue and restore full functionality ASAP. We understand the inconvenience this may cause and assure you that we are taking all necessary steps to resolve this incident promptly.
2024-02-28 01:36
23 Jan 2024
Resolved in 2 hours and 2 minutes
resolved
We are delighted to announce that the degradation affecting our customers has been successfully resolved, and all affected services are now fully restored. Our technical team managed to address the root cause of the issue and implement the necessary fixes to ensure a smooth and stable experience for all our users. The issue was caused by slow response times of the service which is responsible for email fetching. We apologize for any inconvenience this outage may have caused.
2024-01-23 11:35 UTC
investigating
We are currently experiencing an unexpected service degradation affecting our German data center(s). This degradation has resulted in limited access to the following services: Emails. Our technical team is actively working to identify the root cause of the issue and restore full functionality ASAP. We understand the inconvenience this may cause and assure you that we are taking all necessary steps to resolve this incident promptly. We will continue to provide updates on our status page and will notify you once the services are fully restored. We appreciate your patience and understanding during this time.
2024-01-23 09:33
20 Dec 2023
Resolved in 0 hours and 15 minutes
resolved
We are delighted to announce that the call center outage affecting our customers has been successfully resolved, and all affected services are now fully restored. Our technical team managed to address the root cause of the issue and implement the necessary fixes to ensure a smooth and stable experience for all our users. The issue was caused by an unexpected security patch on our providerĀ“s end. We apologize for any inconvenience this outage may have caused.
2023-12-20 12:10 UTC
investigating
We are currently experiencing an unexpected call center outage affecting our Western Europe data center(s). This outage has resulted in limited access to call center services. Our technical team is actively working to identify the root cause of the issue and restore full functionality ASAP. We understand the inconvenience this may cause and assure you that we are taking all necessary steps to resolve this incident promptly. We will continue to provide updates on our status page and will notify you once the services are fully restored. We appreciate your patience and understanding during this time.
2023-12-20 11:55
30 Nov 2023
Resolved in 3 hours and 0 minutes
resolved
We are delighted to announce that the connectivity degradation affecting our customers has been successfully resolved, and all affected services are now fully restored. Our technical team in cooperation with our provider Linode managed to address the root cause of the issue and implement the necessary fixes to ensure a smooth and stable experience for all our users. We apologize for any inconvenience this degradation may have caused.
2023-11-30 18:00 UTC
investigating
We are currently experiencing an unexpected connectivity degradation affecting our US - Texas data center(s). This degradation has resulted in limited access to the following services: Admin. It looks like only users with ISP Comcast are facing the connectivity issues. Our technical team is actively working to identify the root cause of the issue and restore full functionality ASAP. We understand the inconvenience this may cause and assure you that we are taking all necessary steps to resolve this incident promptly. We will continue to provide updates on our status page and will notify you once the services are fully restored. We appreciate your patience and understanding during this time.
2023-11-30 15:00
28 Nov 2023
Resolved in 0 hours and 42 minutes
resolved
We received confirmation from our server admins that they have been able to correct the issues affecting connectivity. Our team will keep monitoring the status
2023-11-28 13:30 UTC
investigating
We are currently experiencing an unexpected connectivity outage affecting our Singapore data center(s). This outage has resulted in limited access to the following services: Admin, Calls, Tickets and Emails. Our technical team is actively working to identify the root cause of the issue and restore full functionality ASAP. We understand the inconvenience this may cause and assure you that we are taking all necessary steps to resolve this incident promptly. We will continue to provide updates on our status page and will notify you once the services are fully restored. We appreciate your patience and understanding during this time.
2023-11-28 12:48
24 Nov 2023
Resolved in 0 hours and 20 minutes
resolved
We are delighted to announce that the call center outage affecting our customers has been successfully resolved, and all affected services are now fully restored. Our technical team managed to address the root cause of the issue and implement the necessary fixes to ensure a smooth and stable experience for all our users. We apologize for any inconvenience this outage may have caused.
2023-11-24 09:15 UTC
investigating
We are currently experiencing an unexpected call center degradation affecting our Western Europe data center(s). This degradation has resulted in limited access to call center services. Our technical team is actively working to identify the root cause of the issue and restore full functionality ASAP. We understand the inconvenience this may cause and assure you that we are taking all necessary steps to resolve this incident promptly. We will continue to provide updates on our status page and will notify you once the services are fully restored. We appreciate your patience and understanding during this time.
2023-11-24 08:55
15 Nov 2023
Resolved in 7 hours and 10 minutes
resolved
The situation with performance & slowness issues is currently stabilized and customers should observe an improvement and faster loading in the panel already. The issue that caused the problems although needs to be fixed by our developers directly within our application, as after deeper investigation it turned out that the issue is not on the server side. For now, no further critical degradation should be experienced, our infrastructure administrators will continue monitoring the status of our machines and will resize our machines after peak hours to prevent further issues in the future until the issue is fully fixed on all sides. Please accept our sincere apologies for the caused inconvenience and thank you for your patience and understanding.
2023-11-15 15:15 UTC
update
Our administrators have identified the cause of the overloads and our developers continue mitigating the issue. Our administrators will add more computing power to our machines as needed to ensure as best performance as possible.
2023-11-15 12:00 UTC
investigating
We are currently experiencing an unexpected degradation affecting multiple data centers. This degradation has resulted in the overall slowness of the LiveAgent panel. Our infrastructure administrators are actively working to identify the root cause of the issue and restore full functionality as soon as possible. We understand the inconvenience this may cause and assure you that we are taking all necessary steps to resolve this incident promptly. We will continue to provide updates on our status page and will notify you once the issues are fully fixed. We appreciate your patience and understanding during this time.
2023-11-15 08:05
14 Nov 2023
Resolved in 0 hours and 30 minutes
resolved
We are delighted to announce that the connectivity outage affecting our customers has been successfully resolved, and all affected services are now fully restored. Our technical team managed to address the root cause of the issue and implement the necessary fixes to ensure a smooth and stable experience for all our users. We apologize for any inconvenience this outage may have caused.
2023-11-14 13:30 UTC
investigating
We are experiencing connectivity issues in our DE data center, multiple affected customers are not able to access or load their LiveAgent panels. Our administrators are already working on the issue. We are sorry for the temporary inconvenience, we will keep this post updated.
2023-11-14 13:00
07 Nov 2023
Resolved in 0 hours and 20 minutes
resolved
The issues affecting the overall LiveAgent performance have been successfully resolved, and all affected services are now fully restored. Our team managed to address the root cause of the issue and implement the necessary fixes to ensure a smooth and stable experience for all our users. We apologize for any caused inconvenience.
2023-11-07 10:00 UTC
investigating
We are currently experiencing an unexpected service degradation affecting multiple data centers. This degradation has resulted in issues with multiple services and performance/overall slowness. Our administrators are actively working to identify the root cause of the issue and restore full functionality ASAP. We understand the inconvenience this may cause and assure you that we are taking all necessary steps to resolve this incident promptly. We will continue to provide updates on our status page and will notify you once the services are fully restored. We appreciate your patience and understanding during this time.
2023-11-07 09:40
03 Nov 2023
Resolved in 3 hours and 8 minutes
resolved
The call center issues affecting the incoming calls have been successfully resolved, and all affected services are now fully restored. Our team managed to address the root cause of the issue and implement the necessary fixes to ensure a smooth and stable experience for all our users. We apologize for any caused inconvenience.
2023-11-03 11:01 UTC
investigating
We are currently experiencing an unexpected call center issue affecting our German data center. This problem has resulted in the inability to pick up incoming calls. Our team is actively working to identify the root cause of the issue and restore full functionality as soon as possible. We will continue to provide updates on our status page and will notify you once the services are fully restored. We appreciate your patience and understanding during this time.
2023-11-03 07:53
24 Oct 2023
Resolved in 1 hours and 0 minutes
resolved
We are delighted to announce that the call center outage affecting our customers has been successfully resolved, and all affected services are now fully restored. Our technical team managed to address the root cause of the issue and implement the necessary fixes to ensure a smooth and stable experience for all our users. We apologize for any inconvenience this outage may have caused.
2023-10-24 11:30 UTC
investigating
We are currently experiencing an unexpected call center outage affecting our United Kingdom, German and Western Europe data center(s). This outage has resulted in limited access to call center services. Our technical team is actively working to identify the root cause of the issue and restore full functionality ASAP. We understand the inconvenience this may cause and assure you that we are taking all necessary steps to resolve this incident promptly. We will continue to provide updates on our status page and will notify you once the services are fully restored. We appreciate your patience and understanding during this time.
2023-10-24 10:30
28 Aug 2023
Resolved in 0 hours and 50 minutes
resolved
Issues are under control and the load dropped back to nominal values. Our team will keep monitoring our servers and continue investigating the root cause.
2023-08-28 10:55 UTC
investigating
We are experiencing a huge load spike in our EU data center, multiple affected customers might experience overall panel slowness or not be able to load their LiveAgent panels. Our infrastructure administrators are already investigating the issue. We are sorry for the temporary inconvenience, we will keep this post updated.
2023-08-28 10:05
10 Jul 2023
Resolved in 8 hours and 55 minutes
resolved
Fiber issues located in the area of Eastern Germany (Emstek-Bramsche) were restored and we also performed emergency works to get additional capacity. Due to that, services should be working fine, without any packet loss or extra latency.
2023-07-10 17:00 UTC
update
We switched traffic from Cogent to back up provider. This workaround resolved the issue with the connectivity of our customers. Please note this is a temporary fix and we are waiting for a final resolution from the Cogent side. We will keep you updated.
2023-07-10 10:15 UTC
update
The issue is caused by multiple international fiber outages in Europe. More details can be found on https://ecogent.cogentco.com/network-status
2023-07-10 08:45 UTC
investigating
We are currently experiencing an unexpected connectivity degradation affecting our Western Europe data center(s). This degradation has resulted in limited access to the following services: Admin, Calls, Tickets and Emails. Our technical team is actively working to identify the root cause of the issue and restore full functionality ASAP. We understand the inconvenience this may cause and assure you that we are taking all necessary steps to resolve this incident promptly. We will continue to provide updates on our status page and will notify you once the services are fully restored. We appreciate your patience and understanding during this time.
2023-07-10 08:05
02 Jul 2023
Resolved in 2 hours and 0 minutes
resolved
We received confirmation from our provider Linode that they have been able to correct the issues affecting connectivity. Our team will keep monitoring the status
2023-07-02 13:00 UTC
investigating
We are currently experiencing an unexpected connectivity outage affecting our US - New Jersey data center(s). This outage has resulted in limited access to the following services: Admin, Calls, Tickets and Emails. Our technical team is actively working to identify the root cause of the issue and restore full functionality ASAP. We understand the inconvenience this may cause and assure you that we are taking all necessary steps to resolve this incident promptly. We will continue to provide updates on our status page and will notify you once the services are fully restored. We appreciate your patience and understanding during this time.
2023-07-02 11:00
29 Jun 2023
Resolved in 0 hours and 25 minutes
resolved
We are delighted to announce that the connectivity outage affecting our customers has been successfully resolved, and all affected services are now fully restored. Our technical team managed to address the root cause of the issue and implement the necessary fixes to ensure a smooth and stable experience for all our users. We apologize for any inconvenience this outage may have caused.
2023-06-29 15:10 UTC
investigating
We are currently experiencing an unexpected connectivity outage affecting our US - New Jersey data center(s). This outage has resulted in limited access to the following services: Admin, Calls, Tickets and Emails. Our technical team is actively working to identify the root cause of the issue and restore full functionality ASAP. We understand the inconvenience this may cause and assure you that we are taking all necessary steps to resolve this incident promptly. We will continue to provide updates on our status page and will notify you once the services are fully restored. We appreciate your patience and understanding during this time.
2023-06-29 14:45
23 Jun 2023
Resolved in 6 hours and 30 minutes
resolved
The issues were resolved and no more problems were reported. We will keep monitoring the issue.
2023-06-23 13:00 UTC
update
According to our information there are problems on the side of Deutsche Telekom (DTAG). DTAG is already working on a solution.
2023-06-23 11:42 UTC
update
There seems to be a problematic hop in the connection to our servers, customers that are not able to load or log in to their LiveAgent panels shall try to change their internet connection or use mobile data or VPN. Our administrators and data center provider are communicating with the problematic node provider to help to resolve the issues.
2023-06-23 07:00 UTC
investigating
We are experiencing connectivity issues in our EU data center, multiple affected customers are not able to access or load their LiveAgent panels. Our administrators are already working on the issue. We are sorry for the temporary inconvenience, we will keep this post updated.
2023-06-23 06:30
09 Jun 2023
Resolved in 1 hours and 4 minutes
resolved
Issues were stabilized and accounts should be working back again. We will keep monitoring the status of our data center.
2023-06-09 8:32 UTC
investigating
We are experiencing unusually high load in our DE data center that might lead to general slowness or service unavailable error, multiple affected customers might not able to access or load their LiveAgent panels. Our infrastructure administrators are already working on the solution. We are sorry for the temporary inconvenience, we will keep this post updated.
2023-06-09 07:28
31 May 2023
Resolved in 3 hours and 4 minutes
resolved
We have identified the issue and implemented a fix for it. We will now monitor the situation to ensure connectivity remains stable.
2023-05-31 21:47 UTC
investigating
We are currently experiencing an unexpected service degradation affecting our German data center(s). This degradation has resulted in limited access to the following services: Admin, Calls, Tickets and Emails. Our technical team is actively working to identify the root cause of the issue and restore full functionality ASAP. We understand the inconvenience this may cause and assure you that we are taking all necessary steps to resolve this incident promptly. We will continue to provide updates on our status page and will notify you once the services are fully restored. We appreciate your patience and understanding during this time. More info here: https://status.linode.com/incidents/233v9587px5d
2023-05-31 18:43
31 May 2023
Resolved in 4 hours and 20 minutes
resolved
We are delighted to announce that the connectivity degradation affecting our customers has been successfully resolved, and all affected services are now fully restored.
2023-05-31 18:30 UTC
update
More info here: https://status.linode.com/incidents/233v9587px5d
2023-05-31 15:10 UTC
investigating
We are currently experiencing an unexpected service degradation affecting our German data center(s). This degradation has resulted in limited access to the following services: Admin, Calls, Tickets and Emails. Our technical team is actively working to identify the root cause of the issue and restore full functionality ASAP. We understand the inconvenience this may cause and assure you that we are taking all necessary steps to resolve this incident promptly. We will continue to provide updates on our status page and will notify you once the services are fully restored. We appreciate your patience and understanding during this time.
2023-05-31 14:10
18 Apr 2023
Resolved in 0 hours and 5 minutes
resolved
Connectivity issues were stabilized and accounts should be working back again. The issue was caused by an unexpected problem during a regular maintenance operation. We will keep monitoring the status of our data center.
2023-04-18 11:05 UTC
investigating
We are experiencing connectivity issues in our EU data center, multiple affected customers are not able to access or load their LiveAgent panels. Our administrators are already working on the issue. We are sorry for the temporary inconvenience, we will keep this post updated.
2023-04-18 11:00
21 Mar 2023
Resolved in 0 hours and 40 minutes
resolved
All call-center services are restarted.
2023-03-21 08:40 UTC
update
Our admin team is restarting call-center services on the affected server.
2023-03-21 08:20 UTC
investigating
Multiple customers, mainly from our German datacenter(s) are facing callcenter outage. Our admins are investigating the issue as they can see higher utilization on our servers.
2023-03-21 08:00
19 Mar 2023
Resolved in 2 hours and 10 minutes
resolved
The connection to agent panel has been re-established.
2023-03-19 17:16 UTC
update
UK cluster is down due to an infrastructure issues in Linode. Linode has problems only using some specific route, therefore, only certain providers are unable to access LiveAgent panel.
2023-03-19 16:10 UTC
investigating
Multiple customers, mainly from our United Kingdom datacenter(s) are facing connectivity outage, especially on the following services: Admin, Calls, Tickets and Emails. Our admins are investigating the issue as they can see higher utilization on our servers.
2023-03-19 15:06
23 Feb 2023
Resolved in 0 hours and 50 minutes
resolved
Our team have found problematic parent servers and disabled traffic to servers on them. The issue was caused by a Hypervisor limit which was exhausted during DDoS attack, which caused some unpredictable behavior on network layer. Our hardware provider enabled monitoring that allows us to know when a similar problem will be happening sooner in the future. Everything should work back again as usual. We will keep monitoring the status of our servers.
2023-02-23 08:39 UTC
investigating
Customers with LiveAgent accounts in the EU data center might experience overall slowness of their panel due to potential issues with our infrastructure. Our administrators are already investigating the issue, we will keep this post updated.
2023-02-23 07:49
10 Feb 2023
Resolved in 72 hours and 0 minutes
resolved
New tickets are being parsed correctly. Issue was caused by DB failover problem. We continue in deeper analysis of the rootcause to implement preventive actions as well as fix for affected tickets.
2023-02-13 14:00 UTC
investigating
Multiple customers from two affected DB servers in our US - Texas and Frankfurt - Germany datacenter(s) are facing issues with new emails not being parsed and shown as empty. Our admins are investigating the issue.
2023-02-10 14:00
17 Jan 2023
Problem on DNS servers affecting all customers
outage
US Texas US Newark SG UK DE SK
Resolved in 0 hours and 56 minutes
resolved
Issue with the DNS servers was resolved. Root cause seems to be a DDOS attack on our DNS servers. We are monitoring the situation.
2023-01-17 02:16 UTC
investigating
The LiveAgent panel for all our customers, as well as our main website, is unavailable due to a problem with the DNS server. Our admins are investigating the issue and trying to resolve it asap.
2023-01-17 01:20
19 Dec 2022
Problem on DNS servers affecting all customers
outage
US Texas US Newark SG UK DE SK
Resolved in 0 hours and 18 minutes
resolved
Issue with the DNS servers was resolved. Root cause seems to be a DDOS attack on our DNS servers. We are monitoring the situation.
2022-12-19 07:28 UTC
investigating
The LiveAgent panel for all our customers, as well as our main website, is unavailable due to a problem with the DNS server. Our admins are investigating the issue and trying to resolve it asap.
2022-12-19 07:10
13 Dec 2022
Resolved in 0 hours and 44 minutes
resolved
The issue should be under control, we will keep monitoring it.
2022-12-13 12:17 UTC
investigating
Multiple customers, mainly from our German(DE) datacenter are fasing slowness issues, specially on the tickets. Our admins are investigating the issue as they can see higher utilization on our servers.
2022-12-13 11:33
13 Dec 2022
Resolved in 4 hours and 45 minutes
resolved
A fix has been implemented by Linode team and the issue was resolved. https://status.linode.com/incidents/n7yt1l21qtyz
2022-12-13 05:17 UTC
investigating
Customers from our US - Texas datacenter(s) are facing connectivity problems due to ongoing issue at our provider Linode. The issues are expected until Linode fix the problem on their side. https://status.linode.com/incidents/n7yt1l21qtyz
2022-12-13 00:32
23 Nov 2022
Resolved in 2 hours and 30 minutes
resolved
Right now all agent panels should work, but our admins will keep to monitor the situation.
2022-11-23 10:00 UTC
investigating
Customers from our US - Texas datacenter(s) are facing connectivity degradation due to ongoing Linode maintenance. We expect customers could be facing timeouts and connection errors, until Linode finishes maintenance.
2022-11-23 07:30
22 Nov 2022
We will be performing an emergency service-affecting network maintenance in our US-Central (Dallas) data center from 06:00 (UTC) until 10:00 (UTC) on Wednesday, November 23rd. During this service-affecting maintenance, customers may see an increased chance of increased latency or packet loss.
22 Nov 2022
Resolved in 8 hours and 30 minutes
resolved
Linode engineers have completed emergency maintenance in Dallas and connectivity is currently stable. They will be performing additional maintenance to fully resolve this issue. A timeline for this maintenance will be communicated in a separate post by Linode, for more info, see: https://status.linode.com/incidents/52wvbqwq5d08
2022-11-22 14:00 UTC
update
Linode Engineers will be performing emergency maintenance within the routing environment to address the connection issues observed in the Dallas Data Center. During this time some customers may observe additional networking traffic issues.
2022-11-22 11:00 UTC
investigating
Multiple customers, mainly from our US - Texas datacenter(s) are facing connectivity degradation, especially on the following services: Admin and Calls. Our admins are investigating the issue as they can see higher utilization on our servers. Based on the info from our hosting provider: We have identified connectivity issues affecting our Dallas data center. Our team is working as quickly as possible to have connectivity restored. We will provide additional updates as the situation develops.
2022-11-22 05:30
06 Nov 2022
LiveAgent connectivity issue
outage
US Texas US Newark
Resolved in 2 hours and 9 minutes
resolved
We received confirmation from our provider Linode that they have been able to correct the issues affecting connectivity in our Dallas data center.
2022-11-06 16:09 UTC
investigating
The US datacenter of our server provider Linode is experiencing connectivity issues. The issue is under investigation. Most up to date info can be found on the Linode's status page here: https://status.linode.com/incidents/5z76dxrlhnwt
2022-11-06 14:00
04 Nov 2022
Resolved in 43 hours and 0 minutes
resolved
Patch with the fix have been deployed and customers should no longer experience slowness issues.
2022-11-05 23:00 UTC
update
Our admins in cooperation with our development team have identified the rootcause in our latest release and are preparing a patch with the fix.
2022-11-05 13:00 UTC
investigating
Multiple customers, mainly from our SG datacenter, but also some bigger customers from our EUR datacenters are facing slowness issues, specially on the chats. In case there are multiple chats running at the same time, it's taking more time than usual for chat pick up and also customerā€™s texts are not showing real time. Our admins are investigating issue as they can see higher utilization on our servers that is most likely behing this issues, they are trying to identify the rootcause.
2022-11-04 04:00
03 Nov 2022
Resolved in 6 hours and 0 minutes
resolved
We received confirmation from our provider Linode that thay have been able to correct the issues affecting connectivity in the UK (London) data center
2022-11-03 16:36 UTC
update
Linode team have identified the issue affecting connectivity in their London data center. They are working quickly to implement a fix, and will provide an update as soon as the solution is in place.
2022-11-03 12:36 UTC
investigating
Due to issues in our UK Linode datacenter (see: https://status.linode.com/incidents/sk329t1y1mx6), agents from UK (and some EUR customers) are facing connectvity problems and lower quality during incoming and outgoing calls. Our admins are in contact with our provider Linode to get the solution asap.
2022-11-03 10:36
12 Oct 2022
Resolved in 0 hours and 30 minutes
resolved
The outage of telephony services was caused by problems with traffic switching. The root cause is being investigated.
2022-10-12 09:30 UTC
investigating
Unexpected outage affecting callcenter functionality, customers reporting red call buttons
2022-10-12 09:00
05 Oct 2022
Temporary login issues
degradation
US Texas US Newark UK DE SG SK
Resolved in 17 hours and 15 minutes
resolved
Issue have have been resolved by a mass (minor) update to patched version 5.32.4.23
2022-10-05 23:00 GTM
update
Issue rootcause identified and patch is being applied (as a minor mass update) to affected accounts.
2022-10-05 09:15 GTM
investigating
Some customers are experiencing trouble logging in. Our team is already applying a workaround and preparing a patch to resolve the issue entirely.
2022-10-05 05:45
20 Sep 2022
Resolved in 4 hours and 50 minutes
resolved
Load on server is currently under control and customers should not observer any slowness right now.
2022-09-20 13:00 UTC
update
Returning issues were spotted, our administrators are insvestigating the problem.
2022-09-20 10:45 UTC
update
Load was restored to nominal values and all LiveAgent accounts in the data center should work correctly again.
2022-09-20 8:45 UTC
investigating
We are experiencing problems with overloading WS-EU data center. Accounts in this data center might have issues with loading LiveAgent panel. Our administrators are already investigating and solving the issue.
2022-09-20 08:10
14 Sep 2022
Resolved in 2 hours and 30 minutes
resolved
Problem with connection issues in SG datacenter has been resolved by emergency network maintenance performed by our provider Linode https://status.linode.com/incidents/cxlhq50xd6bk
2022-09-14 20:30 UTC
investigating
Unexpected network problems in Linode SG data center. Customers are experience connection issues
2022-09-14 18:00
26 Aug 2022
Resolved in 3 hours and 55 minutes
resolved
Problem with network issues in Linode UK datacenter has been fixed and service is availabe without degradation again. Issue was caused by network overload.
2022-08-26 04:30
investigating
Unexpected network problems in Linode UK data center. Customers may experience connection timeouts and errors for their accounts
2022-08-26 00:35
02 Aug 2022
Resolved in 1 hours and 18 minutes
resolved
Problem with network issues in Linode UK datacenter has been fixed and service is availabe without degradation again. Issue was caused by network overload.
2022-08-03 00:54
investigating
Unexpected network problems in Linode UK data center. Customers may experience connection timeouts and errors for their accounts
2022-08-02 23:36
01 Aug 2022
Resolved in 0 hours and 58 minutes
resolved
Problem with network issues in Linode UK datacenter has been fixed and service is availabe without degradation again. Issue was caused by network overload.
2022-08-02 00:38
investigating
Unexpected network problems in Linode UK data center. Customers may experience connection timeouts and errors for their accounts
2022-08-01 23:40
27 May 2022
Resolved in 0 hours and 34 minutes
resolved
Problem with error 500 should be fixed and service is availabe again. Issue was caused by incorrectly switched traffic during upgrade in our EUR Ws datacenter.
2022-05-27 11:48
investigating
Unexpected outage affecting account on our EUR-WS datacenter, customers getting error 500
2022-05-27 11:14
02 Feb 2022
Resolved in 0 hours and 47 minutes
resolved
Should be under control right now for our EU customers aswell, we are monitoring it.
2022-02-02 22:55 GMT+1
update
Should be under control right now for our US customers, we are monitoring it - working on the EU/German datacenter now.
2022-02-02 22:34 GMT+1
investigating
Outage on our EU and US based accounts and all our websites.
2022-02-02 22:08
01 Feb 2022
Resolved in 7 hours and 30 minutes
resolved
Overload has been recently resolved and everything should be working correctly already.
2022-02-01 16:25 GMT +1
update
We've noticed some additional overload of our WS-EU data center, mitigations have been placed.
2022-02-01 15:15 GMT +1
update
Overload has been recently resolved and everything should be working correctly already. We will keep monitoring the data center.
2022-02-01 9:55 GMT +1
investigating
We are experiencing overload issues in our WS-EU data center, our adminstrators have investigated it already and working on a proper solution.
2022-02-01 08:55
21 Jan 2022
Resolved in 0 hours and 10 minutes
resolved
One of the DB nodes was unresponsive and couldn't connect. There shouldn't be anything preventing accounts from proper work now.
2022-01-21 18:50
investigating
Call-Center outage on DE based accounts
2022-01-21 18:40
18 Jan 2022
LiveAgent service outage
outage
US Texas
Resolved in 0 hours and 10 minutes
resolved
One of LB-DB nodes was unresponsive and couldn't connect to all DBs, it was for ~5 minutes when we spotted it and disabled traffic, there shouldn't be anything preventing accounts from proper work now.
2022-01-18 16:40
investigating
Outage on ustx based accounts
2022-01-18 16:30
11 Jan 2022
30 Nov 2021
Resolved in 0 hours and 5 minutes
resolved
The issue should be under control, we will keep monitoring it.
2021-11-30 21:05
investigating
Outage on wseu based accounts
2021-11-30 21:00
18 Oct 2021
Resolved in 1 hours and 3 minutes
resolved
The issue should be under control, we will keep monitoring it.
2021-10-18 10:28 UTC+2
investigating
We have noticed slowness problem in DE datacenter. Our administrators are investigating the issue already.
2021-10-18 09:25
01 Oct 2021
Resolved in 0 hours and 15 minutes
resolved
Should be under control right now, we are monitoring it.
2021-10-01 10:35 UTC
investigating
We noticed slowness problem in DE datacenter. We don't know the root cause for now. Hopefully will post an update soon.
2021-10-01 10:20
23 Sep 2021
22 Sep 2021
Resolved in 4 hours and 45 minutes
resolved
The data center performance in US-NJ cluster is stabilized at the moment, no new incidents detected.
2021-09-22 21:30 CEST
update
Linode just confirmed issues on their side, waiting for further details.
2021-9-22 18:26 PM GTM+2
investigating
We are experiencing issues in one of our data centers on our provider's side, customers might be receiving error 'Failed to subscribe/unsubscribe channels - request timed out. Empty response received from server' and not be able to work freely in their panels. Our team is monitoring the issue.
2021-09-22 16:45
22 Sep 2021
Resolved in 1 hours and 0 minutes
20 Sep 2021
Network issues on TX datacenter
degradation
US Texas
Resolved in 0 hours and 51 minutes
resolved
Situation with US-TX was just taken under control by Linode. Our internal monitoring looks good as well
2021-9-20 19:26 PM GTM+2
investigating
Network problems affecting accounts on TX datacenter
2021-09-20 18:35
14 Sep 2021
Resolved in 4 hours and 0 minutes
08 Sep 2021
Resolved in 0 hours and 30 minutes
resolved
Our admin team resolved the issue.
2021-09-08 12:00
investigating
We are investigating an performance degradation in our DE datacenter.
2021-09-08 11:30
03 Sep 2021
Issues with sending emails at LiveAgent accounts
degradation
US Texas US Newark SG DE UK SK
Resolved in 2 hours and 0 minutes
resolved
Issue was affecting very small number of customers running already on newest 5.25 version (version 5.25 is not yet officially released and so far used only by very few customers). In case of bigger attachment (20+ MB) added to an email, email queue get stuck in the outbox and new emails from the affected email address were not being send until the stucked outbox was manually resolved by a hoftix. there will be an urgent bugfix released for 5.25 within the next days, before we would update any additional customers to this version.
2021-09-03 20:15 GTM+2
investigating
Some of our customers (early adopters using already version 5.25) may experience issues with sending emails at their accounts
2021-09-03 18:15
27 Aug 2021
Resolved in 0 hours and 21 minutes
26 Aug 2021
Resolved in 12 hours and 42 minutes
14 Aug 2021
Expired session issues DE
degradation
DE
Resolved in 4 hours and 47 minutes
resolved
Situation stabilized
2021-08-14 12:32 GTM+2
update
Issues find to be stable. Our team is constantly monitoring it.
2021-08-15 8:00 GTM+2
investigating
Some customers in DE datacenter are experinencing expired session issues. Our team is investigating it.
2021-08-14 07:45
13 Aug 2021
Resolved in 0 hours and 20 minutes
resolved
Our admin team resolved the issue.
2021-08-13 15:20 GTM+2
investigating
We are investigating an outage in our DE datacenter
2021-08-13 15:00
13 Aug 2021
Resolved in 1 hours and 30 minutes
resolved
Our admin team resolved the issue.
2021-08-13 13:50 GTM+2
investigating
We are investigating an outage in our DE datacenter.
2021-08-13 12:20
08 Aug 2021
Resolved in 0 hours and 58 minutes
resolved
We have fixed the issue and all accounts on DE datacenter should work correctly now
2021-08-08 11:23 AM GTM+2
investigating
Network problems affecting accounts on DE datacenter
2021-08-08 10:25
04 Aug 2021
Resolved in 4 hours and 15 minutes
resolved
Our support service is available for our customers.
2021-08-04 7:15 PM GTM+2
investigating
Our support service is unavailable.
2021-08-04 15:00
06 Jul 2021
Call center outage
outage
US Texas US Newark SG UK DE SK
Resolved in 2 hours and 25 minutes
resolved
Incoming and outgoing calls are working again.
2021-07-06 18:00
investigating
Agents can't make incoming and outgoing calls. Our admins are investigating the issue.
2021-07-06 15:35
01 Jul 2021
Resolved in 1 hours and 0 minutes
resolved
Our support service is available for our customers.
2021-07-01 20:00 GTM+2
investigating
Our support service is unavailable.
2021-07-01 19:00
25 Jun 2021
Friday June 25 at 23:59 GMT+2
17 Jun 2021
Resolved in 1 hours and 0 minutes
resolved
DNS issues were resolved. Data remains unaffected.
2021-06-17 11:50
investigating
We are investigating DNS issues caused by an attack on our DNS servers.
2021-06-17 10:50
12 Jun 2021
Resolved in 2 hours and 0 minutes
resolved
The scheduled maintenance has been completed.
2021-06-12 22:00 GMT+2
investigating
Our provider Linode is performing an emergency network maintenance in the EU data center from 18:00 UTC until 20:00 UTC. They do not expect any extended downtime during this maintenance, however there may be a period of brief packet loss or latency. For more details, check https://status.linode.com/
2021-06-12 20:00
03 Jun 2021
Overall network issues
degradation
DE UK
Resolved in 2 hours and 0 minutes
resolved
Our hosting provider (Linode) has fixed the connectivity issues which ocurred. For details check: https://status.linode.com/incidents/dkfclfrnfsj9 and https://status.linode.com/incidents/sbmtb8kljmgn
2021-06-03 12:30
investigating
Unexpected network issues in Linode DE and UK datacenters. For more details, see https://status.linode.com/
2021-06-03 10:30
02 Jun 2021
Network problems affecting accounts on DE and US datacenters
outage
US Texas US Newark SG UK DE SK
Resolved in 2 hours and 40 minutes
resolved
It was a flooding attack on our DNS server - a remote attacker was flooding our server with queries in order to leave no capacity for legitimate user queries.
2021-06-02 16:40 UTC
update
We are facing issues with the DNS affecting all our Datacenters. Our admins are intensively working on a solution
2021-06-02 15:00
investigating
We are investigating recent network issues. We will share more details soon
2021-06-02 14:00
26 May 2021
Resolved in 1 hours and 19 minutes
resolved
Our hosting provider (Linode) has fixed the connectivity issues which ocurred. It was caused by unexpected issues during a planned maintenance that was not supose to have affect on the customers. For details check: https://status.linode.com/incidents/byqmt6nss9l0
2021-05-26 02:37
investigating
We are investigating network issues. Looks like it's caused by Linode scheduled maintenance causing unexpected issues, check https://status.linode.com/
2021-05-26 01:18
20 May 2021
Resolved in 3 hours and 43 minutes
resolved
The issues have been resolved, all services work normally again.
2021-05-20 19:43(GMT+2)
investigating
We are experiencing issues with Elasticsearch. Multiple DE customers are not able to use the Search function or are getting 'Data error. Please try again later.'
2021-05-20 16:00
18 May 2021
Resolved in 0 hours and 20 minutes
resolved
The traffic has been switched, all services work normally again.
2021-05-18 16:40
investigating
We are experiencing overload issues. Multiple WS-EU accounts are affected.
2021-05-18 16:20
12 Apr 2021
Resolved in 3 hours and 10 minutes
resolved
The maintenance is over, all services work normally again.
2021-04-13 01:40
investigating
We are investigating performance issues. Multiple TX accounts are affected.
2021-04-12 22:30
24 Mar 2021
Resolved in 3 hours and 30 minutes
resolved
We rate limit each IP address to 300 concurrent connections and we'll probably deploy that permanently on all our LBs in order to prevent from the same situation in the future. We've also banned a whole range belonging to a Polish ISP. We consider this issue as resolved.
2021-03-24 16:00
update
We managed to get the situation under control around 14:00, but we're still dealing with some accounts. There's a couple of IP addresses that are evading our rate limiting, so the investigation continues.
2021-03-24 14:20
update
Issues are caused by the DDoS attack on LBs in Linode DE.
2021-03-24 12:40
investigating
We are investigating an outage in our DE datacenter.
2021-03-24 12:30
23 Mar 2021
Resolved in 149 hours and 30 minutes
resolved
Our hosting provider has just switched the traffic to another ISP. We have received confirmation from several affected customers that it fixed the issue.
2021-03-29 12:00
update
We have update in the ticket from our hosting provider, that they definetly see some problems and they are trying to resolve it with our network providers. We unfortunately do not know, when this will be resolved, so we still advise to temporarly use other ISP.
2021-03-24 16:00
update
Our network provider confirmed night change, but we still waiting for confirmation from ISP as issue unfortunately still persists. This really looks like a problem on the part of the ISP. We advice customers to possibly open a ticket with the ISP providing the MTR/tracert outputs: https://support.liveagent.com/795802-How-to-debug-networking-issues-when-LiveAgent-is-very-slow-or-not-loading-Cloud-accounts. Potential workaround: Use another ISP or if you can't use another uplink, tunnel the traffic through another ISP e.g. by Cloudflare WARP+ (not a plug) or other proxy/VPN services.
2021-03-24 08:00
update
Our network provider will reroute traffic from problematic provider. This change will be performed tonight. We expect that problems should not occur after. We will update this status once we have confirmation, that this change is completed.
2021-03-23 14:00
investigating
We are investigating connection issues. Multiple DE accounts are affected. So far seems as an issue related to their ISP (Telekom). When connecting via different ISP, all works fine
2021-03-23 06:30
19 Mar 2021
Resolved in 1 hours and 35 minutes
resolved
The number of active connections has been falling steadily due to the deployed mitigation and I we're back to normal.
2021-03-19 12:55
update
Issues are caused by the DDoS attack on LBs in Linode DE.
2021-03-19 12:20
investigating
We are investigating an outage in our DE datacenter.
2021-03-19 11:20
19 Mar 2021
Performance issues on TX-DC
degradation
US Texas
Resolved in 1 hours and 11 minutes
resolved
The maintenance is over, all services work normally again
2021-03-19 8:58
update
Scheduled Network Maintenance - US-Central (Dallas)
2021-03-19 7:53
investigating
Performace of one of US datacenters is degraded.
2021-03-19 07:47
13 Feb 2021
Resolved in 7 hours and 30 minutes
resolved
There should not be any further performance issues due to the recent DOS attacks, it was already eliminated.
2021-02-13 15:00
update
The overloaded DNS server has been under a DOS attack. AttackersĀ“ IP addresses are constantly banned. We are still monitoring the issue. DNS server is calming down.
2021-02-13 12:00
investigating
Performance issues observed on WS-EU. One of the DNS servers is overloaded. Customers may notice that their panel is unreachable for several minutes.
2021-02-13 07:30
09 Feb 2021
Resolved in 0 hours and 45 minutes
resolved
Performance issues on WS-EU server were resolved. The cause of the issue was identified (problematic task) and will be analyzed and fixed (optimized) to prevented similar issues in future.
2021-02-09 14:15
update
Performance issues observed on WS-EU (started arround 13:30 UTC). We redirected traffic to a less loaded server, the overloaded one is cooling down.
2021-02-09 14:00
04 Feb 2021
Resolved in 1 hours and 0 minutes
resolved
In the last half an hour, there was a window of ~15 minutes, when LA accounts in WS-EU might had been unable to receive emails due to problems with TLS configuration.
2021-02-04 13:00
update
unexpected maintenance
2021-02-04 12:00
25 Jan 2021
Resolved in 1 hours and 50 minutes
resolved
At this time Linode has been able to correct the issues affecting connectivity in the Frankfurt data center. We are monitoring this to ensure that it remains stable
2021-01-25 20:40
update
LinodeĀ“s team has identified the issue affecting connectivity in the Frankfurt data center. They are working quickly to implement a fix! We will provide an update as soon as the solution is in place
2021-01-25 19:35
investigating
Unexpected network outage in Linode DE datacenter
2021-01-25 18:50
22 Jan 2021
Resolved in 1 hours and 6 minutes
resolved
Issues fixed. Calls and emails are working correctly.
2021-01-22 10:36
update
Issue caused by problematic traffic switching, when faulty server permit to release traffic to not-faulty server. Emails fixed, calls are still affected
2021-01-22 09:50
22 Jan 2021
Connection issues
outage
DE
Resolved in 0 hours and 22 minutes
resolved
All servers and DB connectivity working.
2021-01-22 01:02
update
Unexpected maintenance outage in Linode DE datacenter
2021-01-22 00:40
20 Jan 2021
Call Outage
outage
UK
Resolved in 2 hours and 0 minutes
resolved
UK call center functionality restored,
2021-01-20 17:40
investigating
Developers are investigating call issues. All UK call center accounts affected.
2021-01-20 15:40
19 Jan 2021
Resolved in 9 hours and 10 minutes
resolved
There was an unexpected call center service outage affecting several accounts (only those which were migrated at some point in the past, e.g. from DC in UK to other DC in EU). Problem is fixed.
2021-01-19 19:40
investigating
Agents get error > Call failed. Reason: Not found. Our admins are investigating the issue
2021-01-19 10:30
21 Dec 2020
UsTx-DatabaseIssue
outage
US Texas
Resolved in 0 hours and 48 minutes
resolved
Issue is now resolved
2020-12-21 18:48
investigating
Some US customers are experiencing Unable to connect to database error
2020-12-21 18:00
21 Dec 2020
Resolved in 1 hours and 12 minutes
resolved
At this time we have been able to correct the issues affecting connectivity in our Singapore data center. We will be monitoring this to ensure that it remains stable
2020-12-21 19:01
update
Confirmed issues in Singarpore data center: for more details see Linode incident link below
2020-12-21 18:41
investigating
Connectivity issues affecting accounts based in our Singapore data center
2020-12-21 17:49
16 Dec 2020
Resolved in 1 hours and 43 minutes
resolved
The issues have been fixed. Our monitoring doesn't report any other problems
2020-12-16 14:14
update
Confirmed issues in Singarpore data center: for more details see Linode incident link below
2020-12-16 12:38
investigating
Connectivity issues affecting accounts based in our Singapore data center
2020-12-16 12:31
30 Oct 2020
We will be performing scheduled maintenance on our instance of LiveAgent. There will be no downtime from the customer point of view, however, our support team will not be available on Saturday the 7th of November from 6 AM to 1 PM UTC.
11 Sep 2020
Connectivity issues US
outage
US Texas US Newark
Resolved in 0 hours and 38 minutes
resolved
All servers and DB connectivity working
2020-09-11 07:09
update
Scheduled maintenance in Linode
2020-09-11 06:36 (update status requires also date)
investigating
Investigating issue
2020-09-11 06:31
06 Sep 2020
Resolved in 1 hours and 0 minutes
resolved
Issues in Singarpore data center has been fixed
2020-09-06 04:35
investigating
Connectivity issues affecting Linodes in our Singapore data center
2020-09-06 03:35
28 Aug 2020
Overload in telephony
degradation
DE
Resolved in 2 hours and 27 minutes
resolved
Problem is fixed.
2020-08-28 19:22
investigating
Detected overload in telephony. Customers can spot problems with recieving calls.
2020-08-28 16:55
20 Aug 2020
Resolved in 1 hours and 55 minutes
resolved
The performance of backgroud operations has been restored.
2020-08-20 14:55 UTC
update
Customers can see some slowness on counts for some background operations (filters, sending emails, ...).
2020-08-20 13:20 UTC
investigating
We noticed problem on one of our server for background operations.
2020-08-20 13:00
22 Jul 2020
Resolved in 0 hours and 14 minutes
resolved
Connection was restored.
2020-07-22 12:53
investigating
Customers on UK datacenter are affected by connection outage
2020-07-22 12:39
08 May 2020
Resolved in 1 hours and 24 minutes
resolved
Issues are resolved and no longer occuring.
2020-05-08 21:19
update
Connectivity issue occurred second time. Some of our US based customers may be experiencing connectivity problems. Our server administration team is working on it.
2020-05-08 20:48
update
Issue seems to be resolved.
2020-05-08 20:30
investigating
Some of our US based customers may be experiencing connectivity problems. Our server administration team is working on it.
2020-05-08 19:55
29 Apr 2020
Resolved in 0 hours and 8 minutes
resolved
Issue has been resolved.
2020-04-29 07:58(GMT+0)
investigating
Our server team is working on it.
2020-04-29 07:50
05 Mar 2020
The attack on the crucial part of LiveAgent's infrastructure
outage
US Texas US Newark UK DE SG SK
Resolved in 15 hours and 20 minutes
resolved
all remaining Data Centers had been restored.
05-03-2020 17:00
update
Most of our Data Centers had been restored.
05-03-2020 16:00
update
US-TX Data Center had been restored.
05-03-2020 10:41
update
Issue had been identified and work on resolution started.
05-03-2020 05:36
investigating
Technical problems reported and investigation started.
2020-03-05 01:40
30 Nov 2019
Connection issues to our servers
degradation
US Texas US Newark UK DE SG SK
Resolved in 0 hours and 0 minutes
resolved
The problem was fixed.
2019-11-30 14:00
investigating
Some of our customers may have experienced issues with connection to our servers due to a bug in our maintenance scripts.
2019-11-30 14:00
08 Oct 2019
Connection issues to our servers due to temporal DNS problems
degradation
US Texas US Newark UK DE SG SK
Resolved in 0 hours and 0 minutes
resolved
The problem was fixed.
2019-10-08 15:00
investigating
Some of our customers may experienced issues with the connection to our servers due to temporal DNS problems.
2019-10-08 15:00
17 Sep 2019
We will be performing scheduled server maintenance in our EU data center. Customers located in Europe might experience degraded performance with loading tickets or filters during these server restarts. We do not expect any downtime.
19 Jul 2019
Issues with receiving emails at LiveAgent accounts
outage
US Texas US Newark SG DE UK SK
Resolved in 2 hours and 20 minutes
resolved
Emails are being fetched
2019-07-19 14:35
investigating
Some of our customers may experience issues with receiving emails at their accounts
2019-07-19 12:15
08 Jun 2019
Connection issues to our servers
degradation
US Texas US Newark
Resolved in 1 hours and 0 minutes
resolved
The problem was fixed.
2019-06-08 23:00(GMT+2)
investigating
Some of our US customers may experience issues with receiving emails at their account and some performance issues in general. Our server team is investigating the issue.
2019-06-08 22:00
06 Jun 2019
Facebook service outage
outage
US Texas US Newark SG DE UK SK
Resolved in 1 hours and 25 minutes
resolved
FB data are being fetched
2019-06-06 12:35
investigating
Outage on Facebook side was affecting fetching data from Facebook to LiveAgent
2019-06-06 11:10