Incidents | Certchain Ltd Incidents reported on status page for Certchain Ltd https://status.certchain.net/ https://d1lppblt9t2x15.cloudfront.net/logos/c3cf4b9ecf82a1f3f132410d196081f7.jpeg Incidents | Certchain Ltd https://status.certchain.net/ en Certchain CMS recovered https://status.certchain.net/ Sat, 11 Jul 2026 22:01:29 +0000 https://status.certchain.net/#6b9b0940d808ae8a5f2950aff503b04e5ac679360902eef86f996dfa4498d8a1 Certchain CMS recovered Certchain CMS went down https://status.certchain.net/ Sat, 11 Jul 2026 21:59:10 +0000 https://status.certchain.net/#6b9b0940d808ae8a5f2950aff503b04e5ac679360902eef86f996dfa4498d8a1 Certchain CMS went down Captivate Chat recovered https://status.certchain.net/ Wed, 24 Jun 2026 09:36:37 +0000 https://status.certchain.net/#9d9996dc1b89a345b537e7eea6915d26863e0b4bd0d05c4c4050045fa279fcda Captivate Chat recovered Captivate Chat went down https://status.certchain.net/ Wed, 24 Jun 2026 09:15:33 +0000 https://status.certchain.net/#9d9996dc1b89a345b537e7eea6915d26863e0b4bd0d05c4c4050045fa279fcda Captivate Chat went down Backend recovered https://status.certchain.net/ Sat, 13 Jun 2026 05:19:30 +0000 https://status.certchain.net/#23060fdb528ef5464fc840dd61a390a6667029251f529e83470a6403733820ba Backend recovered Backend went down https://status.certchain.net/ Sat, 13 Jun 2026 05:15:51 +0000 https://status.certchain.net/#23060fdb528ef5464fc840dd61a390a6667029251f529e83470a6403733820ba Backend went down Production Platform Services Outage https://status.certchain.net/incident/872754 Thu, 16 Apr 2026 02:49:00 -0000 https://status.certchain.net/incident/872754#bd1bb398c85fa59a3373fe397334b9c7416397e99aa5e91a6c9d28307340605f Update 3: Resolved (2026-04-16, 02:20 UTC) All production services have been fully restored. Both worker nodes have been replaced and all application pods are running normally. **Root cause:** Two worker nodes in our production Kubernetes cluster became unresponsive due to CPU resource exhaustion on undersized instances. The failure cascaded across both nodes within minutes, taking all services offline. **Actions taken:** - Replaced both affected nodes with fresh instances - Applied safeguards to prevent concurrent background job pile-up - Planning further capacity improvements to prevent recurrence We will continue monitoring the environment closely over the next 24 hours. --- Update 2: Identified (2026-04-16, 02:00 UTC) We have identified the root cause as infrastructure resource exhaustion on our Kubernetes worker nodes. We are replacing the affected nodes to restore service. New nodes are joining the cluster now. --- Update 1: Investigating (2026-04-16, 01:50 UTC) We are investigating reports of our production platform services being unreachable. Our Kubernetes cluster nodes are showing as unhealthy. All services including CertChain Platform API, CertChain Payments API, and CITB Parser API are affected. We are actively working to restore service and will provide updates as we progress. --- Affected Services - Backend - Payment - Passport API Impact Duration 2026-04-16, 00:02 UTC - 02:20 UTC (~2 hours 18 minutes) Scheduled Maintenance: EKS Cluster Upgrades (March 15, 2026) https://status.certchain.net/incident/837639 Sun, 15 Mar 2026 06:00:12 -0000 https://status.certchain.net/incident/837639#65d488c21473ed5ad67481dcbef01bd7de797394571aac271a4d8764109a782b Maintenance completed Scheduled Maintenance: EKS Cluster Upgrades (March 15, 2026) https://status.certchain.net/incident/837639 Sun, 15 Mar 2026 00:00:12 -0000 https://status.certchain.net/incident/837639#73456857d2b192dff43e88399da3f3ab8a257426f34c833162c476b5cd93839e Please be advised that the Operations team has scheduled a planned maintenance (dev/staging/production) window on March 15, 2026, from 00:00 to 06:00 GMT (London Time). ###### Scope of Work: Upgrade of EKS control plane to version 1.35. Update of core services and underlying node images to Amazon Linux 3. ###### Impact: While the total window is six hours, we anticipate a service disruption of approximately 2–3 hours as components are cycled. We recommend planning for downtime during this period. Captivate Chat Outage https://status.certchain.net/incident/769964 Tue, 18 Nov 2025 11:25:00 -0000 https://status.certchain.net/incident/769964#9f57a13e4a4a80e4e89be6015109256d71c6576b979c213a4e9ce21a3fa14e13 We are experiencing issues related to an ongoing Captivate Chat outage and are actively monitoring the situation. We will continue to provide updates as more information becomes available. For details, please refer to Captivate Chat status page: https://status.captivatechat.com/incident/769023 We apologize for any inconvenience this may have caused and appreciate your patience. Certchain CMS SSL Timeout https://status.certchain.net/incident/760028 Fri, 07 Nov 2025 16:48:00 -0000 https://status.certchain.net/incident/760028#cf9f2472107a3942856ff0e293bfed8ebb27096f64a810f3871b79b48e2e19c0 Incident Summary: On November 7 at 3:41 PM UTC, the internal SSL certificate renewal process encountered a timeout during an automated Certbot update. This caused the process to restart without retrying. Impact: As a result, Front Door was temporarily unable to access the affected domain until the certificate update was completed. Resolution: The issue was identified and resolved by November 7 at 4:35 PM UTC. The SSL renewal process has been restored, and additional safeguards have been implemented to ensure automatic retries in case of future timeouts. Certchain CMS Outage Notice https://status.certchain.net/incident/753854 Wed, 29 Oct 2025 16:03:00 -0000 https://status.certchain.net/incident/753854#b323b5df603b53c04ee7abddf95a9e9494fc643dd0987219323519d1539d4e03 Service Outage Notice: Certchain CMS Certchain CMS is currently unavailable due to an ongoing Azure platform outage impacting multiple services. Our team is actively monitoring the situation and will provide updates as they become available. Thank you for your patience and understanding. Update - 19:23 (UK Time) We are observing signs of recovery. Azure Front Door appears to be operational again, but we will continue to closely monitor the restoration of full service. Update - 16:12 (UK Time) Microsoft has identified that the Azure Front Door (AFD) service experienced a significant loss of capacity in the Europe and Africa regions, resulting in impact to several Microsoft 365 and dependent services. For more details, see the Microsoft Service Health update: https://admin.cloud.microsoft/?#/servicehealth/:/alerts/MO1168665/