Duration: 1 hour

Affected Components: [DE] Rainbow Core Services, [DE] Rainbow Media Relays, [DE] Rainbow Conferencing

Apr 15, 19:00:01 GMT+0
Identified - Maintenance is now in progress.

Apr 15, 19:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time. New load balancers will be added will be added with following IP Addresses: \- 141.95.121.152 .[openrainbow.com](http://openrainbow.com) \- 141.95.121.153 [rdd.openrainbow.com](http://rdd.openrainbow.com) \- 141.95.121.157 .[openrainbow.com](http://openrainbow.com) \- 141.95.121.158 [rdd.openrainbow.com](http://rdd.openrainbow.com) Please ensure they are trusted on your firewall. Current load balancers remain reachable: haproxy-external-lim3-prod-1 \- 54.37.95.41 .[openrainbow.com](http://openrainbow.com) \- 51.38.111.143 [agent.openrainbow.com](http://agent.openrainbow.com) \- 54.37.194.109 [rdd.openrainbow.com](http://rdd.openrainbow.com)haproxy-external-lim3-prod-2: \- 51.195.21.11 .[openrainbow.com](http://openrainbow.com) \- 51.195.55.209 [rdd.openrainbow.com](http://rdd.openrainbow.com).

Apr 15, 20:00:00 GMT+0
Completed - Maintenance has completed successfully.

Duration: 1 hour

Affected Components: [APAC] Rainbow Media Relays, [APAC] Rainbow Core Services, [APAC] Rainbow Conferencing, [APAC] Rainbow Hub Voice Services

Apr 15, 14:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time. A new load balancer will be added with following IP Addresses: \- 15.235.188.232 .[openrainbow.com](http://openrainbow.com) \- 15.235.188.233 [agent.openrainbow.com](http://agent.openrainbow.com) \- 15.235.188.234 [rdd.openrainbow.com](http://rdd.openrainbow.com) \- 2402:1f00:8008:8f00::1 .[openrainbow.com](http://openrainbow.com) \- 2402:1f00:8008:8f00::2 [agent.openrainbow.com](http://agent.openrainbow.com) \- 2402:1f00:8008:8f00::3 [rdd.openrainbow.com](http://rdd.openrainbow.com) Please ensure they are trusted on your firewall. Current load balancers remain reachable: haproxy-external-sgp1-prod-1 (Note: **decommissioning planned by end of may**): \- 139.99.122.102 .[openrainbow.com](http://openrainbow.com) \- 139.99.4.245 [agent.openrainbow.com](http://agent.openrainbow.com) \- 139.99.2.105 [rdd.openrainbow.com](http://rdd.openrainbow.com) \- 2402:1f00:8001:266::1 .[openrainbow.com](http://openrainbow.com) \- 2402:1f00:8001:266::2 [agent.openrainbow.com](http://agent.openrainbow.com) \- 2402:1f00:8001:266::3 [rdd.openrainbow.com](http://rdd.openrainbow.com) haproxy-external-sgp1-prod-2: \- 15.235.144.86 .[openrainbow.com](http://openrainbow.com) \- 139.99.4.244 [agent.openrainbow.com](http://agent.openrainbow.com) \- 139.99.80.249 [rdd.openrainbow.com](http://rdd.openrainbow.com) \- 2402:1f00:8001:1356::1 .[openrainbow.com](http://openrainbow.com) \- 2402:1f00:8001:1356::2 [agent.openrainbow.com](http://agent.openrainbow.com) \- 2402:1f00:8001:1356::3 [rdd.openrainbow.com](http://rdd.openrainbow.com).

Apr 15, 14:00:01 GMT+0
Identified - Maintenance is now in progress.

Apr 15, 15:00:00 GMT+0
Completed - Maintenance has completed successfully.

Duration: 1 hour

Affected Components: [ANZ] Rainbow Hub Voice Services, [ANZ] Rainbow Media Relays, [ANZ] Rainbow Conferencing, [ANZ] Rainbow Core Services

Apr 15, 12:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time. A new load balancer will be added with following IP Addresses: \- 51.161.144.88 .openrainbow.com \- 51.161.144.89 [rdd.openrainbow.com](http://rdd.openrainbow.com) Please ensure they are trusted on your firewall. Current load balancers remain reachable: haproxy-external-syd-prod-1 (Note: **decommissioning planned by end of may**): \- 139.99.148.135 .openrainbow.com \- 139.99.161.35 [agent.openrainbow.com](http://agent.openrainbow.com) \- 139.99.177.193 [rdd.openrainbow.com](http://rdd.openrainbow.com) haproxy-external-syd2-prod-1: \- 139.99.212.212 \*.openrainbow.com \- 139.99.212.213 [agent.openrainbow.com](http://agent.openrainbow.com) \- 139.99.212.214 rdd.openrainbow.com.

Apr 15, 12:00:01 GMT+0
Identified - Maintenance is now in progress.

Apr 15, 13:00:00 GMT+0
Completed - Maintenance has completed successfully.

Duration: 2 hours

Affected Components: [WW] Rainbow Hybrid PBX Telephony, [WW] Rainbow Administration & Subscriptions, , Global (WW) →

Apr 9, 19:00:00 GMT+0
Identified - As part of the preparation for a future infrastructure upgrade, our hosting provider **OVH** will apply a **network configuration update** on link aggregation components. This operation will be performed **interface by interface** to avoid any full service interruption. During the maintenance scheduled for **April 9, 2026, between 21:00 and 23:00 (CEST)**, the following **temporary impacts on Rainbow services** may be observed: * A **brief interruption of connections** * **Temporary slowdowns** on some services, including possible **audio and video quality degradation** in case of limited bandwidth * **Telephony services may be unavailable for several minutes** If telephony services are impacted, affected users will be informed via the message **“Telephone services currently unavailable”**, visible in their telephony settings. No long‑lasting disruption is expected, and services should return to normal once the operation is completed..

Apr 9, 19:00:01 GMT+0
Identified - Maintenance is now in progress.

Apr 9, 21:00:00 GMT+0
Completed - Maintenance has completed successfully.

Apr 9, 19:00:00 GMT+0
Identified - OVH, our underlying IaaS provider, will conduct an exceptional infrastructure maintenance on **April 9, 2026 at 21:00 CEST**. This operation targets core platform components and may result in **temporary service degradation or brief interruptions** across our systems. The potential impact is **global (WW)**. We have implemented preventive safeguards to **minimize any operational impact** during the maintenance window. Our team will supervise the event end‑to‑end and respond immediately to any anomaly. Thank you for your understanding..

Duration: 2 hours and 57 minutes

Affected Components: [CALA] Rainbow Hub Voices Services

Apr 6, 11:59:00 GMT+0
Investigating - We are currently investigating this incident..

Apr 6, 13:47:39 GMT+0
Identified - We are continuing to work on a fix for this incident..

Apr 6, 14:25:32 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Apr 6, 14:56:27 GMT+0
Resolved - This incident has been resolved..

Affected Components: [MEA] Rainbow Conferencing, [MEA] Rainbow Media Relays

Apr 1, 05:30:00 GMT+0
Identified - Following an incident affecting the **AWS data center in Bahrain** on April 1st (see AWS Health Dashboard: <https://health.aws.amazon.com/health/status>), media traffic was temporarily redirected to **APAC and European regions** to ensure service continuity. As a result, some users may experience a **temporary decrease in media quality** during this period. A full recovery is planned **within one week.**.

Apr 9, 07:13:47 GMT+0
Identified - Update – Infrastructure Recovery Plan Due to the ongoing unavailability of our primary infrastructure in the **AWS Bahrain region** datacenter, and constraints related to the current regional situation, we are unable to restore service from this data center in the short term. As a result, we have initiated the deployment of a **new production instance in an alternative data center outside the Middle East region** to restore long-term service stability. **Current status and next steps:** * The new environment is being identified, then built and validated. * This process is expected to take **approximately one month**. * In the meantime, media traffic will continue to be routed through other regions to maintain service availability, which may result in **temporary impacts on media quality or latency** for some users. We will continue to share progress updates and will communicate once the new instance is ready and traffic migration is completed. Thank you for your patience and understanding..

Duration: 2 days, 4 hours and 32 minutes

Affected Components: [WW] Rainbow Hybrid PBX Telephony, , [APAC] Rainbow Media Relays, [EMEA] Rainbow Core Services, [APAC] Rainbow Core Services, [ANZ] Rainbow Hub Voice Services, [CALA] Rainbow Conferencing, [ANZ] Rainbow Media Relays, [CALA] Rainbow Core Services, [WW] Rainbow Administration & Subscriptions, , [DE] Rainbow Core Services, [NA] Rainbow Hub Voices Services, [NA] Rainbow Conferencing, [CALA] Rainbow Hub Voices Services, [NA] Rainbow Media Relays, [DE] Rainbow Media Relays, [CALA] Rainbow Media Relays, [EMEA] Rainbow Media Relays, , , [DE] Rainbow Conferencing, [APAC] Rainbow Conferencing, [EMEA] Rainbow Conferencing, [EMEA] Rainbow Hub Voice Services, [ANZ] Rainbow Conferencing, [APAC] Rainbow Hub Voice Services, [ANZ] Rainbow Core Services, [NA] Rainbow Core Services, North America (NA) → Caribbean & Latin America (CALA) → Australia-New Zealand (ANZ) → Asia-Pacific (APAC) →

Mar 31, 06:28:19 GMT+0
Investigating - We are currently investigating this incident..

Mar 31, 06:55:34 GMT+0
Identified - We’re facing a major incident caused by unexpected database latency. Our engineers are investigating and working to restore normal performance. We sincerely apologize for the inconvenience and will keep you updated..

Mar 31, 07:25:24 GMT+0
Identified - Our teams are actively working on restoring the service. Services are partially recovered, although we continue to observe latency. We will share further updates as progress is made..

Mar 31, 07:59:03 GMT+0
Identified - We are continuing to make progress in restoring the service, although elevated load is currently slowing the process. Our teams remain fully mobilized, and we will provide further updates as the situation evolves..

Mar 31, 08:32:59 GMT+0
Identified - We are still experiencing degraded performance, but we are seeing ongoing progress as our teams actively manage elevated traffic levels as part of the mitigation efforts. We currently estimate full recovery within the next several hours and are working to shorten this timeframe as improvements continue..

Mar 31, 08:37:39 GMT+0
Identified - As part of the ongoing incident resolution, a full system restart will be performed. This will cause active sessions to be disconnected. This action is necessary to restore the service and stabilize the platform. Our teams will be closely monitoring the situation throughout this operation, and we expect this step to accelerate the return to normal service..

Mar 31, 08:58:38 GMT+0
Identified - The system restart is still ongoing and is expected to take approximately one hour. We will provide another update as soon as the process is completed..

Mar 31, 09:32:03 GMT+0
Identified - The system restart is still in progress. We will provide another update as soon as the operation is completed..

Mar 31, 10:01:38 GMT+0
Identified - We are still completing the restart process, and some services may take a bit more time to fully stabilize. Our teams remain actively engaged, and we will provide a further update as soon as the next milestone is reached..

Mar 31, 10:26:20 GMT+0
Identified - We are performing additional actions on our infrastructure, but the service has not yet returned to normal. Our teams are continuing to work through the situation, and we will share further details as soon as new progress is made..

Mar 31, 11:00:59 GMT+0
Identified - Despite no significant change for users at this time, our teams continue to work steadily on the resolution. Based on current progress, we expect full recovery before the end of the day. We will continue to keep you informed and share more details as soon as we make further progress..

Mar 31, 11:34:07 GMT+0
Identified - Our teams continue to work actively on restoring the service. While the situation remains complex and no definitive recovery path has been confirmed yet, all necessary actions are being taken to move forward..

Mar 31, 12:07:10 GMT+0
Identified - To stabilise the service, a portion of user traffic has been temporarily reduced while our teams work on redistributing the load across our systems. This may prevent access to the platform for some users. We are actively working to restore normal access as quickly as possible..

Mar 31, 12:28:21 GMT+0
Identified - Services are starting to be partially restored, although not all users may be able to access them yet. Our teams continue to work on completing the recovery..

Mar 31, 12:54:31 GMT+0
Identified - Most of our services are coming back online, and availability continues to improve, even though some users may still experience limited access. Our teams remain fully committed and are making steady progress toward full recovery..

Mar 31, 13:27:03 GMT+0
Identified - Telephony services are starting to recover, and PBX systems are reconnecting. Some users may still experience slow response times, but overall availability continues to improve. Our teams remain fully engaged and are closely monitoring the situation to support the ongoing recovery..

Mar 31, 13:56:36 GMT+0
Identified - We continue to observe some instability on our infrastructure, but our teams have identified the contributing network issues and are actively working with our provider to address them. As part of our stabilisation efforts, several servers are being redirected to an alternate site to ensure a more reliable environment. These actions are already helping to improve the situation, and we remain fully mobilized to restore full service as quickly as possible. Further updates will follow as progress continues..

Mar 31, 14:31:20 GMT+0
Monitoring - Services have been restored, and the vast majority of data is now available to users. Our teams are monitoring the platform closely to ensure full stability..

Mar 31, 14:55:50 GMT+0
Monitoring - Services have been restored, and we continue to monitor the platform closely to ensure everything remains stable. If you experience any issue with Rainbow, a simple log out and log back in should help..

Mar 31, 15:31:12 GMT+0
Monitoring - Monitoring activities are still ongoing, and current indicators remain positive. Our IaaS provider has also made progress on resolving the underlying network issues. We will continue to observe the platform closely and provide further updates if necessary..

Apr 2, 11:00:01 GMT+0
Resolved - This incident has been resolved..

Mar 31, 15:58:57 GMT+0
Resolved - The Rainbow service remains operational. OVH is still experiencing network issues in the Roubaix datacenter, which temporarily reduces our high‑availability capacity. Despite this, the platform is functioning normally, and we are maintaining reinforced monitoring to ensure service continuity. Our teams are closely following the situation with our provider and will take any additional measures needed. Thank you for your understanding while we worked through this incident..

Apr 2, 11:00:00 GMT+0
Postmortem - **Post‑mortem Update** – Apr 02, 13:00 AM CEST Following the application of OVH’s fix yesterday at approximately 22:00 CEST, all data centers are now fully operational. All services have returned to normal and continue to be closely monitored. \=== Apr 01, 2026 10:07 AM **Incident Report: Root Cause Analysis – Rainbow Data Center** **1\. Executive Summary** Our Rainbow Data Center provider experienced significant service degradation impacting our Rainbow services in our different regions due to a network routing anomaly at our primary hosting provider. Incident was caused by the instability of IP Routing between the different Data Center virtual router resulted in an active/passive switch flapping scenario that ultimately isolated database nodes and interrupted client connections. All services have now been restored by routing traffic to an alternate data center, and we are currently in strict monitoring mode. **2\. Timeline of Events** * **31/03, 08:00:** Flapping issue escalated on OVH Data Center, leading to a split-brain condition on our database infrastructure. Service disruption became widespread. * **31/03, 08:00 – 10:00:** The team assessed all available options to recover service without resorting to a full platform restart, which was considered a last resort given the risk of a broader outage. Despite these efforts, the underlying network instability could not be resolved through targeted intervention alone. * **31/03, 11:00 - 11:30:** The engineering team attempted a first restoration. This was unsuccessful as the network continued to flap between DCs. * **31/03, 12:00:** A second restart was initiated, attempting to distribute the load across different data centers. * **31/03, 13:00:** Our teams executed a major restoration by isolating faulty datacenter network elements. * **31/03, 13:30-16:30:** Rainbow services were recovered and users were getting progressively access to their services in the different regions * **Current Status:** All IP addresses from Roubaix were successfully switched to the Gravelines data center, and services have been restored. We are now in a dedicated monitoring phase and working with OVH Team to ensure DC Roubaix stability. **3\. Root Cause Description** The service disruption was triggered by a malfunction in the network at our data center, which is operated by our infrastructure provider, OVH. We observed repeated VRRP flapping, preventing incoming traffic from reliably reaching the active destination server. This persistent routing instability ultimately disrupted database synchronization, resulting in a split-brain scenario in which database nodes operated independently without maintaining consensus. As the VRRP protocol is managed externally by the hosting provider, direct intervention at the switch level was not possible on our end, requiring the implementation of an architectural bypass to restore service. **4\. Corrective Actions and Next Steps** We are accelerating the expansion Rainbow Service with new IaaS provider to avoid full dependency on OVH Cloud network solution – A detailed timeline will be shared before end of next week **Invitation: Partner Webinar on Rainbow Solution Stability** To ensure full transparency and ongoing collaboration, we will invite our partner community to a dedicated technical webinar next week. Invitation to follow before end of this week..

Duration: 50 minutes

Affected Components: [WW] Rainbow Hybrid PBX Telephony, [WW] Rainbow Administration & Subscriptions, , [EMEA] Rainbow Hub Voice Services, Global (WW) →

Mar 16, 21:00:22 GMT+0
Identified - We are continuing to work on a fix for this incident..

Mar 16, 21:50:22 GMT+0
Resolved - This incident has been resolved..

Duration: 40 minutes

Affected Components: [WW] Rainbow Hybrid PBX Telephony, [EMEA] Rainbow Hub Voice Services, [WW] Rainbow Administration & Subscriptions, [DE] Rainbow Core Services, [EMEA] Rainbow Core Services, , , Global (WW) → Germany (DE) →

Feb 16, 09:11:00 GMT+0
Identified - We experienced some slowness on the European platform between 10:10 and 10:30 CET, which resulted in degraded service access in certain areas and on some features. This was due to partial congestion caused by an update rollout from our IaaS provider. Service is back to normal. We keep monitoring closely.

Feb 16, 09:51:15 GMT+0
Resolved - This incident has been resolved..

Duration: 1 hour and 25 minutes

Feb 9, 07:30:00 GMT+0
Investigating - We are currently investigating this incident..

Feb 9, 07:45:00 GMT+0
Identified - We are continuing to work on a fix for this incident..

Feb 9, 07:55:00 GMT+0
Resolved - This incident has been resolved..

Duration: 5 hours and 46 minutes

Affected Components: [DE] Rainbow Core Services, [CALA] Rainbow Core Services, [EMEA] Rainbow Core Services, [APAC] Rainbow Core Services, [ANZ] Rainbow Core Services, [NA] Rainbow Core Services

Feb 4, 13:50:49 GMT+0
Monitoring - **Service is partially restored.** All Rainbow Core features are available except call logs..

Feb 4, 14:33:41 GMT+0
Resolved - Services are restored, RCA will be shared soon..

Feb 4, 08:47:35 GMT+0
Investigating - We are currently investigating this incident..

Feb 4, 09:05:51 GMT+0
Identified - We are continuing to work on a fix for this incident..

Feb 4, 09:34:39 GMT+0
Identified - We are continuing to work on a fix for this incident..

Feb 4, 09:49:51 GMT+0
Identified - We identified peak traffic problem, currently rebalancing the traffic.

Feb 4, 11:32:09 GMT+0
Identified - The root cause has been identified, and recovery actions are currently in progress.Service restoration in underway, and systems are being progressively brought back online.

Feb 4, 12:08:29 GMT+0
Monitoring - Core services have been restored and are now under enhanced monitoring.Service restoration is being progressively completed across all user accounts. Our teams remain fully engaged to ensure complete recovery and platform stability..

Feb 4, 13:08:43 GMT+0
Monitoring - **Service restoration continues across remaining affected accounts.** Our teams are actively finalizing recovery for the remaining accounts and continue monitoring platform stability closely..

Duration: 7 hours and 43 minutes

Affected Components: [EMEA] Rainbow Hub Voice Services

Feb 4, 15:54:50 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Feb 4, 16:12:33 GMT+0
Resolved - This incident has been resolved..

Feb 4, 08:29:11 GMT+0
Investigating - We are currently investigating this incident. A few amount of user cannot make external calls.

Feb 4, 10:20:27 GMT+0
Identified - We are continuing to work on a fix for this incident..

Duration: 32 minutes

Jan 29, 12:58:52 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Jan 29, 13:21:05 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Jan 29, 13:24:44 GMT+0
Monitoring - Some customers still impacted, fix is ongoing.

Jan 29, 13:31:07 GMT+0
Resolved - This incident has been resolved..

Duration: 20 minutes

Affected Components: [WW] Rainbow Hybrid PBX Telephony

Jan 22, 21:20:00 GMT+0
Investigating - We are currently investigating this incident..

Jan 22, 21:40:00 GMT+0
Resolved - This incident has been resolved..

Jan 22, 22:09:48 GMT+0
Resolved - This incident has been resolved..

Duration: 8 minutes

Affected Components: [DE] Rainbow Core Services, [DE] Rainbow Conferencing, , Germany (DE) →

Jan 20, 20:44:00 GMT+0
Investigating - Several network loss on DC provider, causing some users reconnections.

Jan 20, 20:52:00 GMT+0
Resolved - This incident has been resolved. No more reconnection issues observed.

Duration: 9 hours and 3 minutes

Affected Components: [EMEA] Rainbow Hub Voice Services

Dec 24, 16:28:14 GMT+0
Postmortem - On December 24, 2025, between 05:30 and 14:00 CET, some Rainbow Hub companies experienced inbound and outbound call issues. The incident was caused by a temporary network disruption, which led to an inconsistent NAT port handling on an intermediate component of the Rainbow Hub infrastructure. This affected several trunks, while the majority of services remained operational. Corrective actions were applied, and the issue was fully resolved after a configuration update on the affected intermediate server. All services have since been fully restored, and no other Rainbow services were impacted..

Dec 24, 05:00:00 GMT+0
Investigating - We are currently investigating this incident..

Dec 24, 07:46:11 GMT+0
Resolved - This incident has been resolved..

Dec 24, 08:18:12 GMT+0
Investigating - We are currently investigating this incident..

Dec 24, 08:44:23 GMT+0
Investigating - We are continuing to work on a fix for this incident.

Dec 24, 09:28:26 GMT+0
Identified - Several fixes have been applied, we monitor the system.

Dec 24, 09:47:51 GMT+0
Monitoring - We are currently monitoring the result.

Dec 24, 10:50:32 GMT+0
Monitoring - Remaining cases are identified, we work on fixes.

Dec 24, 14:02:35 GMT+0
Resolved - This incident has been resolved. We'll provide RCA soon.

Duration: 2 hours and 18 minutes

Affected Components: [APAC] Rainbow Media Relays

Dec 15, 08:00:01 GMT+0
Identified - Maintenance is now in progress.

Dec 15, 10:18:19 GMT+0
Completed - Maintenance has completed successfully..

Dec 15, 08:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time. During maintenance operation, server turn-sgp1-prod-1 (Media relay) will be down, following IP addresses will be unreachable: \- 139.99.120.111 \- 2402:1f00:8001:6f::1 During maintenance, call will be established on closest Media relays servers (please ensure they are trusted in end customer firewall): \- BHR: 15.184.158.216 / 157.175.244.247 \- TOK: 169.56.36.231 / 2401:c900:1001:287::2.

Duration: 3 hours and 32 minutes

Affected Components: [EMEA] Rainbow Hub Voice Services

Nov 25, 18:50:00 GMT+0
Identified - We are continuing to work on a fix for this incident..

Nov 25, 19:13:00 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Nov 25, 15:43:00 GMT+0
Investigating - We are currently investigating this incident..

Nov 25, 19:15:00 GMT+0
Resolved - This incident has been resolved..

Duration: 7 minutes

Affected Components: [EMEA] Rainbow Core Services

Nov 16, 04:36:26 GMT+0
Identified - Some users may encounter difficulties receiving notification on their mobile device when idle, leading to incoming calls not present for instance. We are working on a fix. In a meantime, to not loose any incoming call, you may use or other desktop or web applications on a PC..

Nov 16, 04:43:52 GMT+0
Resolved - This incident has been resolved..

Affected Components: [APAC] Rainbow Media Relays, [APAC] Rainbow Conferencing, [APAC] Rainbow Core Services

Nov 13, 08:50:00 GMT+0
Resolved - This incident has been resolved..

Nov 13, 09:10:00 GMT+0
Resolved - This incident has been resolved..

Duration: 1 hour

Affected Components: [WW] Rainbow Hybrid PBX Telephony

Oct 27, 08:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time. Step1: 9:00 am (France time), Rainbow team will drain following load balancers: haproxy-external-gra3-prod-3 (178.32.125.32, 178.32.125.56, 178.32.125.46 will be removed from DNS answer) haproxy-external-rbx8-prod-3 (178.32.126.147, 178.32.126.16, 178.32.126.196 will be removed from DNS answer) Step2: 10:00 am (France time), a gentle reconnection (based on PBX country) of OXE cloud-agent during non-working hours will be performed. At this stage, if connections are established on above load balancer, a reconnection will happen (3xx answer returned by load balancer) and PBXs connected upon to load balancer will initiate a new connection which establish on available load balancers. Step3: Rainbow team will monitor the remaining connections on haproxy-external-gra3-prod-3 and haproxy-external-rbx8-prod-3\. Once all connections are closed to null, Rainbow team will proceed for OS migration. A dedicated maintenance will be published in Rainbow status page..

Oct 27, 08:00:01 GMT+0
Identified - Maintenance is now in progress.

Oct 27, 09:00:00 GMT+0
Completed - Maintenance has completed successfully.

Duration: 2 hours

Affected Components: [WW] Rainbow Hybrid PBX Telephony

Oct 20, 05:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time. Step1: 7:00 am (France time), Rainbow team will proceed for maintenance on following load balancers. No impact for customers, they are drained and removed from DNS pool: haproxy-external-gra3-prod-2 178.32.125.107, 178.32.125.135, 178.32.125.149 haproxy-external-rbx8-prod-2 178.32.125.161, 178.32.125.168, 178.32.125.241 Step2: 9:00 pm (France time), load balancers back in service in DNS pool Caution: next maintenance will occur by October 27th at 9:00 am (France time), following load balancers will be drained and removed from DNS pool: haproxy-external-gra3-prod-3 178.32.125.32, 178.32.125.56, 178.32.125.46 haproxy-external-rbx8-prod-3 178.32.126.147, 178.32.126.16, 178.32.126.196 Key points: \- Ensure all load balancers' IP addresses are trusted in customers' firewall \- Ensure customers use FQDN [agent.openrainbow.com](http://agent.openrainbow.com) instead of IP Addresses \> Note: you may also use Rainbow Pilot: <https://pilot.openrainbow.com/networkRequirements> to obtain the Network requirements..

Oct 20, 05:00:01 GMT+0
Identified - Maintenance is now in progress.

Oct 20, 07:00:00 GMT+0
Completed - Maintenance has completed successfully.

Duration: 22 minutes

Affected Components: [WW] Rainbow Hybrid PBX Telephony

Oct 15, 22:42:00 GMT+0
Investigating - We are currently investigating this incident..

Oct 15, 22:48:41 GMT+0
Identified - We are continuing to work on a fix for this incident..

Oct 15, 23:03:41 GMT+0
Resolved - This incident has been resolved..

Duration: 2 hours

Affected Components: [WW] Rainbow Hybrid PBX Telephony

Oct 15, 19:00:00 GMT+0
Identified - Step1: 9:00 pm (France time), Rainbow team will add 2 new load balancers in France, please ensure they are trusted in customer's firewall: \- 178.32.126.211, 178.32.126.97 (\*.[openrainbow.com](http://openrainbow.com)) \- 178.32.126.251, 178.32.127.14 ([agent.openrainbow.com](http://agent.openrainbow.com)) \- 178.32.126.70, 178.32.127.143 ([rdd.openrainbow.com](http://rdd.openrainbow.com)) \> Note: you may also use Rainbow Pilot: <https://pilot.openrainbow.com/networkRequirements> to obtain the Network requirements. Step2: 9:30 pm (France time), following load balancers will be drained: haproxy-external-gra3-prod-2 (178.32.125.107, 178.32.125.135, 178.32.125.149 will be removed from DNS answer) haproxy-external-rbx8-prod-2 (178.32.125.161, 178.32.125.168, 178.32.125.241 will be removed from DNS answer) Step3: 10:00 pm (France time), a gentle reconnection (based on PBX country) of OXE cloud-agent during non-working hours will be performed At this stage, if connections are established on above load balancer, a reconnection will happen (3xx answer returned by load balancer) and PBXs connected upon to load balancer will initiate a new connection which establish on available load balancers. Step4: Rainbow team will monitor the remaining connections on haproxy-external-gra3-prod-2 and haproxy-external-rbx8-prod-2\. Once all connections are closed to null, Rainbow team will proceed for OS migration. A dedicated maintenance will be published in Rainbow status page. Key points: \- Ensure all load balancers' IP addresses are trusted in customer's firewall \- Ensure customers use FQDN instead of IP Addresses \- Reconnection timers must be defined properly to ensure seamless connection.

Oct 15, 19:00:01 GMT+0
Identified - Maintenance is now in progress.

Oct 15, 21:00:00 GMT+0
Completed - Maintenance has completed successfully.

Duration: 2 hours

Affected Components: [CALA] Rainbow Core Services

Oct 14, 09:00:00 GMT+0
Completed - Maintenance is now in progress.

Oct 14, 07:00:00 GMT+0
Identified - We are planning for a maintenance during that time. During maintenance operation, servers haproxy-external-sao-prod-1 / haproxy-external-sao-prod-2 (load balancers) will be down, following IP addresses will be unreachable: * 169.57.174.106 (\*.[openrainbow.com](http://openrainbow.com)) * 169.57.207.27 (\*.[openrainbow.com](http://openrainbow.com)).

Oct 14, 07:00:01 GMT+0
Identified - Maintenance is now in progress.

Duration: 1 hour

Affected Components: [NA] Rainbow Core Services

Oct 8, 10:00:00 GMT+0
Completed - Maintenance is now in progress.

Oct 8, 09:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time. During maintenance operation, server haproxy-external-bhs-prod-1 (load balancer) will be down, following IP addresses will be unreachable: * 54.39.227.90 (\*.[openrainbow.com](http://openrainbow.com)).

Oct 8, 09:00:01 GMT+0
Identified - Maintenance is now in progress.

Duration: 1 hour

Affected Components: [NA] Rainbow Core Services

Oct 8, 08:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time. During maintenance operation, server haproxy-external-vin1-prod-3 (load balancer) will be down, following IP addresses will be unreachable: * 135.148.197.15 (\*.[openrainbow.com](http://openrainbow.com)) * 135.148.197.18 ([agent.openrainbow.com](http://agent.openrainbow.com)) * 135.148.197.19 ([rdd.openrainbow.com](http://rdd.openrainbow.com)).

Oct 8, 08:00:01 GMT+0
Identified - Maintenance is now in progress.

Oct 8, 09:00:00 GMT+0
Completed - Maintenance is now in progress.

Duration: 1 hour

Affected Components: [NA] Rainbow Core Services

Oct 8, 08:00:00 GMT+0
Completed - Maintenance is now in progress.

Oct 8, 07:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time. During maintenance operation, server haproxy-external-vin1-prod-2 (load balancer) will be down, following IP addresses will be unreachable: * 135.148.197.14 (\*.[openrainbow.com](http://openrainbow.com)) * 135.148.197.16 ([agent.openrainbow.com](http://agent.openrainbow.com)) * 135.148.197.17 ([rdd.openrainbow.com](http://rdd.openrainbow.com)).

Oct 8, 07:00:01 GMT+0
Identified - Maintenance is now in progress.

Duration: 1 hour

Affected Components: [APAC] Rainbow Core Services

Oct 7, 13:00:01 GMT+0
Identified - Maintenance is now in progress.

Oct 7, 13:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time. During maintenance operation, server haproxy-external-syd2-prod-1 (load balancer) will be down, following IP addresses will be unreachable: * 15.235.144.86 (\*.[openrainbow.com](http://openrainbow.com)) * 139.99.4.244 ([agent.openrainbow.com](http://agent.openrainbow.com)) * 139.99.80.249 ([rdd.openrainbow.com](http://rdd.openrainbow.com)) * 2402:1f00:8001:1356::1 (\*.[openrainbow.com](http://openrainbow.com)) * 2402:1f00:8001:1356::2 ([agent.openrainbow.com](http://agent.openrainbow.com)) * 2402:1f00:8001:1356::3 ([rdd.openrainbow.com](http://rdd.openrainbow.com)).

Oct 7, 14:00:00 GMT+0
Completed - Maintenance is now in progress.

Duration: 1 hour

Affected Components: [APAC] Rainbow Core Services

Oct 7, 12:00:01 GMT+0
Identified - Maintenance is now in progress.

Oct 7, 13:00:00 GMT+0
Completed - Maintenance is now in progress.

Oct 7, 12:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time. During maintenance operation, server haproxy-external-sgp1-prod-1 (load balancer) will be down, following IP addresses will be unreachable: * 139.99.122.102 (\*.[openrainbow.com](http://openrainbow.com)) * 139.99.4.245 ([agent.openrainbow.com](http://agent.openrainbow.com)) * 139.99.2.105 ([rdd.openrainbow.com](http://rdd.openrainbow.com)) * 2402:1f00:8001:266::1 (\*.[openrainbow.com](http://openrainbow.com)) * 2402:1f00:8001:266::2 ([agent.openrainbow.com](http://agent.openrainbow.com)) * 2402:1f00:8001:266::3 ([rdd.openrainbow.com](http://rdd.openrainbow.com)).

Duration: 1 hour

Affected Components: [ANZ] Rainbow Core Services

Oct 6, 13:00:01 GMT+0
Identified - Maintenance is now in progress.

Oct 6, 13:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time. During maintenance operation, server haproxy-external-syd2-prod-1 (load balancer) will be down, following IP addresses will be unreachable: * 139.99.212.212 (\*.[openrainbow.com](http://openrainbow.com)) * 139.99.212.213 ([agent.openrainbow.com](http://agent.openrainbow.com)) * 139.99.212.214 ([rdd.openrainbow.com](http://rdd.openrainbow.com)).

Oct 6, 14:00:00 GMT+0
Completed - Maintenance is now in progress.

Duration: 1 hour

Affected Components: [ANZ] Rainbow Core Services

Oct 6, 12:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time. During maintenance operation, server haproxy-external-syd-prod-1 (load balancer) will be down, following IP addresses will be unreachable: * 139.99.148.135 (\*.[openrainbow.com](http://openrainbow.com)) * 139.99.161.35 ([agent.openrainbow.com](http://agent.openrainbow.com)) * 139.99.177.193 ([rdd.openrainbow.com](http://rdd.openrainbow.com)).

Oct 6, 12:00:01 GMT+0
Identified - Maintenance is now in progress.

Oct 6, 13:00:00 GMT+0
Completed - Maintenance is now in progress.

Duration: 57 minutes

Affected Components: [EMEA] Rainbow Hub Voice Services

Oct 1, 11:46:00 GMT+0
Investigating - We are currently investigating this incident..

Oct 1, 12:00:00 GMT+0
Identified - We are continuing to work on a fix for this incident..

Oct 1, 12:35:00 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Oct 1, 12:43:00 GMT+0
Resolved - This incident has been resolved..

Duration: 10 minutes

Affected Components: , , [EMEA] Rainbow Core Services, [WW] Rainbow Hybrid PBX Telephony, Europe & Middle East (EMEA) → Global (WW) →

Oct 1, 11:45:00 GMT+0
Investigating - We are currently investigating this incident..

Oct 1, 11:55:00 GMT+0
Resolved - This incident has been resolved..

Duration: 2 hours and 25 minutes

Affected Components: , [EMEA] Rainbow Core Services, [WW] Rainbow Hybrid PBX Telephony, [EMEA] Rainbow Hub Voice Services, Global (WW) →

Oct 1, 05:05:00 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Oct 1, 05:05:00 GMT+0
Identified - We are continuing to work on a fix for this incident..

Oct 1, 07:30:00 GMT+0
Resolved - This incident has been resolved..

Duration: 1 hour and 17 minutes

Affected Components: [EMEA] Rainbow Core Services, [WW] Rainbow Hybrid PBX Telephony

Sep 24, 16:28:44 GMT+0
Monitoring - Systems are back to service, we continue to monitoring..

Sep 24, 16:53:51 GMT+0
Resolved - This incident has been resolved..

Sep 24, 15:37:15 GMT+0
Investigating - We are currently investigating this incident..

Sep 24, 16:04:44 GMT+0
Identified - We are continuing to work on a fix for this incident and keep you informed..

Sep 24, 16:11:31 GMT+0
Identified - Impacted services are back to service, proceeded to reconnection.

Duration: 35 minutes

Affected Components: [EMEA] Rainbow Hub Voice Services

Sep 24, 16:05:00 GMT+0
Resolved - This incident has been resolved..

Sep 24, 15:40:00 GMT+0
Identified - We are continuing to work on a fix for this incident..

Sep 24, 15:30:00 GMT+0
Investigating - We are currently investigating this incident..

Duration: 2 hours and 14 minutes

Sep 16, 19:43:30 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Sep 16, 19:15:00 GMT+0
Investigating - We are currently investigating this incident..

Sep 16, 21:29:05 GMT+0
Resolved - This incident has been resolved..

Duration: 6 hours

Affected Components: [APAC] Rainbow Core Services

Sep 16, 10:00:01 GMT+0
Identified - Maintenance is now in progress.

Sep 16, 10:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time. During move operation, server haproxy-external-sgp1-prod-2 (load balancer) will be down, following IP addresses will be unreachable: * 15.235.144.86 (\*.openrainbow.com) * 139.99.4.244 (agent.openrainbow.com) * 139.99.80.249 (rbd.openrainbow.com).

Sep 16, 16:00:00 GMT+0
Completed - Maintenance has completed successfully.

Duration: 8 minutes

Affected Components: , [CALA] Rainbow Hub Voices Services, [APAC] Rainbow Hub Voice Services, [EMEA] Rainbow Hub Voice Services, [NA] Rainbow Hub Voices Services, Global (WW) →

Sep 12, 15:19:02 GMT+0
Monitoring - Myriad phones are unregistered. We are continuing to work on a fix for this incident. .

Sep 12, 15:25:03 GMT+0
Resolved - This incident has been resolved. Root Cause Analysis: DNS misconfiguration impacted the SIP phones registration.

Sep 12, 15:17:29 GMT+0
Investigating - We are currently investigating this incident..

Duration: 4 hours and 4 minutes

Affected Components: [NA] Rainbow Hub Voices Services

Aug 27, 22:25:43 GMT+0
Identified - We are continuing to work on a fix for this incident..

Aug 27, 22:26:03 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Aug 27, 19:59:08 GMT+0
Investigating - We are currently investigating this incident..

Aug 28, 00:03:08 GMT+0
Resolved - This incident has been resolved..

Duration: 7 hours and 26 minutes

Affected Components: , [DE] Rainbow Conferencing, [DE] Rainbow Core Services, [DE] Rainbow Media Relays, Germany (DE) →

Aug 20, 12:44:07 GMT+0
Monitoring - We keep close monitoring with our IaaS provider.

Aug 20, 16:21:25 GMT+0
Resolved - IAAS provider issue is now resolved and traffic has been switched back to DE DC. This incident has been resolved..

Aug 20, 08:55:00 GMT+0
Resolved - DNS switchover has been put in place until provider issue is resolved .

Aug 20, 09:10:00 GMT+0
Resolved - This incident has been resolved..

Duration: 1 hour and 44 minutes

Affected Components: [WW] Rainbow Hybrid PBX Telephony

Mar 23, 20:01:44 GMT+0
Identified - Maintenance is now in progress..

Mar 23, 20:00:44 GMT+0
Identified - In order to perform necessary component maintenances, we need to restart some services used for PBX connection. PBX may disconnect once or twice in the coming hours with possible loss of telephony features during a few minutes..

Mar 23, 21:45:40 GMT+0
Completed - Maintenance is now complete..

Duration: 10 minutes

Affected Components: [WW] Rainbow Hybrid PBX Telephony

Mar 16, 20:03:31 GMT+0
Identified - In order to perform necessary component maintenances, we need to restart some services used for PBX connection. PBX may disconnect once or twice in the coming hours with possible loss of telephony features during a few minutes..

Mar 16, 20:29:36 GMT+0
Identified - Maintenance is now in progress..

Mar 16, 20:40:00 GMT+0
Completed - The maintenance is now finished..

Duration: 48 minutes

Affected Components: [WW] Rainbow Hybrid PBX Telephony

Feb 2, 21:45:00 GMT+0
Completed - The operation has been performed.

Feb 2, 20:56:59 GMT+0
Identified - In order to perform necessary component maintenances, we need to restart some services used for PBX connection. PBX may disconnect once or twice in the coming hours with possible loss of telephony features during a few minutes..

Duration: 2 hours

Affected Components: [DE] Rainbow Core Services

Nov 7, 22:00:00 GMT+0
Completed - Maintenance has completed successfully.

Nov 7, 20:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time. This maintenance concerns infrastructure updates to address security vulnerabilities.

Nov 7, 20:00:01 GMT+0
Identified - Maintenance is now in progress.

Duration: 2 hours

Affected Components: [DE] Rainbow Core Services

Nov 5, 20:00:01 GMT+0
Identified - Maintenance is now in progress.

Nov 5, 20:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time. This maintenance concerns infrastructure updates to address security vulnerabilities.

Nov 5, 22:00:00 GMT+0
Completed - Maintenance has completed successfully.

Duration: 7 hours

Affected Components: [EMEA] Rainbow Conferencing, [EMEA] Rainbow Media Relays, [EMEA] Rainbow Hub Voice Services, [WW] Rainbow Hybrid PBX Telephony, [EMEA] Rainbow Core Services

Jul 28, 12:00:00 GMT+0
Identified - We are performing some backend maintenances in order to improve rainbow stability. Some users in EMEA datacenter may experience some disconnections. Also, it is possible to have a loss of telephony services during a few minutes..

Jul 28, 19:00:00 GMT+0
Completed - Maintenance has completed successfully..

Duration: 5 hours and 47 minutes

Affected Components: [EMEA] Rainbow Hub Voice Services

Jun 30, 12:44:45 GMT+0
Completed - All migration tasks have been performed successfully.

Jun 30, 07:00:00 GMT+0
Identified - On **Sunday 2024-06-30**, we will perform some upgrade activity to improve **Rainbow HUB Services** on **EMEA** and **DE** Region. **Note:** The window is longer than usual because we are taking advantage of this operation to carry out several updates in a row. But rest assured, the real impact of this operation for users is identical to others of this type: * Cloud telephony services may be disturbed for the duration of the period and calls will be disconnected for approximately 10 minutes over the same period. * The administration of cloud telephony services may ALSO be disturbed during the operation..

Jun 30, 06:57:27 GMT+0
Identified - Operation will start in a few minutes.

Duration: 14 hours and 50 minutes

Affected Components: [EMEA] Rainbow Hub Voice Services

Jun 29, 12:18:57 GMT+0
Identified - <https://support.openrainbow.com/hc/fr/articles/19786325080978-Upgrade-on-Saturday-June-29-2024>.

Jun 29, 07:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time..

Jun 29, 07:00:01 GMT+0
Identified - Maintenance is now in progress.

Jun 29, 21:49:52 GMT+0
Completed - Maintenance has completed successfully..