Network Updates
Outage & Maintance History
Subject: Intermittent disruptions to peering
Category: Network Issue
Start time: October 16, 8:43am
End Time: October 16, 8:51am
Cybera experienced intermittent disruptions to peering starting around 8:43am today. This unexpected impact arose due to issues CANARIE encountered while conducting scheduled maintenance. The issue was resolved at 8:51am.
Subject: Network outage in Calgary and Edmonton
Category: Network Issue
Start time: September 10, 7:00am
End Time: September 10, 8:15am
Cybera experienced a network outage today on our Calgary router starting around 7:00 am today. This outage affected our Calgary connectivity and had intermittent impacts on our Edmonton connectivity. The issue was resolved at 8:15am.
Subject: Network outage in Edmonton
Category: Network Issue
Start time: October 3, 9:50am
End Time: October 3, 11:35am
Cybera experienced a network outage today on our Edmonton router starting around 9:50 am today. The issue was resolved at 11:35am.
Subject: Peering Outage
Category: Network Issue
Start time: July 7 10:00am
End time: July 7 12:00pm
CANARIE experienced a routing issue at approximately 10:00am on July 7th that affected Cybera's Peering service. The issue was resolved at 12:00pm.
Subject: Network outage in Red Deer
Category: Network Issue
Start time: August 20 3:00pm
Shaw has restored connectivity to our Red Deer point of presence.
Subject: Network outage in Red Deer
Category: Network Issue
Start time: August 19 4:00pm
On August 19th at 4:00pm, we received alerts that our circuits with Shaw had gone down. We have confirmed with Shaw that this is a fibre cut which is affecting a large number of people and businesses in the Southern Alberta area.
Our connectivity to our Red Deer point of presence (PoP) is currently down. We will provide updates as we learn more.
Subject: Outage between Lethbridge and Calgary
Category: Network Issue
Start time: June 27 11:50 AM
Shaw has resolved the issue and our connectivity to Lethbridge is back online.
Please reach out to us at noc@cybera.ca or call 403-536-0880 if you are still experiencing connectivity issues.
Subject: Outage between Lethbridge and Calgary
Category: Network Issue
Start time: June 27 10:40 AM
Shaw has identified faulty hardware and is en route to repair it. We do not have an ETA at this time.
Please reach out to us at noc@cybera.ca or call 403-536-0880 if you have any questions.
Subject: Outage between Lethbridge and Calgary
Category: Network Issue
Start time: June 27 8:29 AM
Shaw has identified faulty hardware and are en route to repair it. We do not have an ETA at this time.
We're currently experiencing an outage with both our primary and backup connections between Cybera's Lethbridge and Calgary sites. Technicians are being dispatched to investigate and resolve the cause.
Please reach out to us at noc@cybera.ca or call 403-536-0880 if you have any questions.
Subject: Emergency Shutdown in Calgary
Category: Network Issue
Start time: February 26, 2022 9:30pm Local Time
The power to our Calgary router has been restored and all Cybera services are currently working as expected through the Calgary router.
We apologize for the inconvenience and thank you so much for your patience.
Please reach out to us at noc@cybera.ca if you are still experiencing an issue.
Subject: Emergency Shutdown in Calgary
Category: Network Issue
Start time: February 26, 2022 1:25pm Local Time
Please be advised that our Calgary router will be shut down due to an issue at the datacentre. We apologize for the inconvenience and will keep you updated as we learn more information.
Please reach out to us at noc@cybera.ca if you have any questions.
Subject: Intermittent Network Connectivity Issue
Category: Network Issue
Start time: December 7, 2020 11:25am Local Time
We have identified the issue to be a faulty switch configuration in Calgary. This issue has now been resolved.
Please reach out to us at noc@cybera.ca if you are still experiencing an issue.
Subject: Intermittent Network Connectivity Issue
Category: Network Issue
Start time: December 7, 2020 11:11am Local Time
Cybera is currently experiencing intermittent network connectivity issues in both Calgary and Edmonton. We are actively researching the problem and will update this space when we know more information.
Please reach out to us at noc@cybera.ca if you have any questions.
Subject: Connectivity issue in Edmonton via Hurricane Electric – Resolved
Category: Network Failure
Start time: May 5, 2020 6:26pm Local Time
After monitoring for several hours, our upstream provider connection (Hurricane Electric) in Edmonton is looking stable now. We have confirmed with the provider that the issue has been resolved on their end. Hurricane Electric has now confirmed that the issue was a software defect, which caused routes to not be learned/reannounced properly. They have stated: "We were able to clear the broken state and have a case opened with our vendor to get a bug fix." Cybera has now re-routed internet traffic back to Edmonton from Calgary for our Edmonton members.
Please reach out to us at noc@cybera.ca if you are still experiencing an issue after the maintenance window.
NOTE: This activity will not impact Calgary Members.
Subject: Connectivity issue in Edmonton via Hurricane Electric – Update
Category: Network Failure
Start time: May 5, 2020 2:42pm Local Time
Hurricane Electric has confirmed that there was an issue with their equipment that is affecting the network. As a result, Cybera has redirected member transit from Edmonton to Calgary. We will continue monitoring and if all looks good, we will revert the redirection later today.
Subject: Connectivity issue in Edmonton via Hurricane Electric
Category: Network Failure
Start time: May 5, 2020 1:23pm Local Time
At the moment, we are having an upstream provider issue with Hurricane Electric in Edmonton. Members in the Calgary region are not impacted by this issue. We are investigating and will update members shortly.
Subject: Latency issue in Edmonton Region Client Connected via Supernet
Category: Latency Issues
The service in the Edmonton region has been restored by AXIA. The root cause of the issue was AXIA making a capacity change to their link. Their technical team has now reverted that change, and will run further analysis. Please contact noc@cybera.ca or 403-536-0880 if you have any questions.
Subject: Edmonton SuperNet Disruption
Category: Latency Issues
We are experiencing latency issues in the Edmonton region for members connected via SuperNet. We are working with the SuperNet team to resolve this issue as quickly as possible. We will keep you informed about our progress. If you have any immediate questions, you can reach us at noc@cybera.ca or 403-536-0880.
Subject: Cybera Edmonton Maintenance
Category: Maintenance
Planned Start Time: May 17, 2019 21:00 MDT
Planned End Time: May 18, 2019 00:00 MDT
Cybera will be performing maintenance on its Edmonton router. Members should expect a few short duration outages (15 minutes) during the maintenance window.
Please contact the Cybera Network Operations Center at noc@cybera.ca or 403-536-0880 when network problems are experienced outside of a maintenance window.
Category: Maintenance
Planned Start Time: May 1, 2019 19:00 MDT
Planned End Time: May 1, 2019 21:00 MDT
Anticipated Outage Duration: This maintenance work will result in three to four, 15 minutes or less outages during the time frame indicated above.
As a follow up to today’s outage, we require an emergency maintenance window later tonight that will result in a few short duration outages as we resolve a related outstanding configuration issue.
Early Findings: The outage today was caused by a Routing Engine failure on our Edmonton router and a related software issue that compounded the outage duration. We are working on a full post mortem for this incident and will share our findings at a later time.
Please contact the Cybera Network Operations Center at noc@cybera.ca or 403-536-0880 when network problems are experienced outside of a maintenance window.
Subject: Unscheduled Network Outage
Category: Network Outage Update
Please note that Cybera experienced a network outage today starting at 11:42. We are still investigating the scope and root cause of this outage. We are now investigating a hardware issue with our Edmonton Router and are working with the equipment vendor.
All IBG members as well as the VFS members who had redundancy configured have been redirected to Calgary. We are still investigating and will send periodic updates throughout the day.
Please contact the Cybera Network Operations Center at noc@cybera.ca or 403-536-0880 when network problems are experienced outside of a maintenance window.
On Friday March 8, Cybera experienced an outage that impacted several of our members.
On Friday at 4:50 pm we began maintenance work on the DWDM in Edmonton to reset a backup power supply. This work was successfully completed by 5:00 pm. Shortly after at 5:10 pm, we started receiving alerts notifying us that the DWDM was down. The main and backup power supplies failed, impacting members in Edmonton without regional redundancy. Peering, IBG (Internet Buying Group), VFS (Virtual Firewall Service), and shared hardware firewall services became unavailable to them. This outage continued until we were able to find and install a working power supply at 7:45 pm.
Once the DWDM came back online, the Peering and IBG services were restored for all members. Unfortunately, the DWDM outage triggered another failure. This impacted the affected firewalls, and spread to include the previously working VFS firewalls across both regions. After several hours of debugging, we determined there was a Layer 2 spanning tree loop issue. By 2:00 am on Saturday, the issue was resolved for many of our members.
We did not realize that, at that time, the Calgary region was experiencing similar issues. Later Saturday morning, some of our VFS members in Calgary let us know they were having issues (thank-you!). A review of the symptoms showed the same problems that Edmonton had experienced, and we were able to similarly resolve the issue by 10:00 am Saturday morning.
Two schools, one in Edmonton and one in Calgary, continued to have firewall issues. Our team worked with them throughout the day to debug, and were able to resolve their issues by late afternoon.
We are compiling a list of lessons learned which we will be reviewing next week. Once we’ve determined our next steps and how we will improve our procedures going forward, we will share that information with our members.
Subject: Edmonton DWDM Issue and Subsequent Outage – Resolved (3/8/2019)
Category: Network Failure
Start Time: March 8, 2019 5:06pm Local Time
End Time: March 8, 2019 7:45pm Local Time
Service via Edmonton DWDM is restored. It was found out that the DWDM power supply failed and replacement is done.
Subject: Edmonton DWDM Issue and Subsequent Outage (3/8/2019)
Category: Network Failure
Start Time: March 8, 2019 5:06pm Local Time
End Time: No ETA
We are experiencing issue with our DWDM equipment in Edmonton and some customer connections which don't have redundancy via Calgary are affected. We will send status update as we get more information.
Category: Network Service Disruption on the Calgary SuperNet
Start Time: Nov 1, 2018, 08:23 MDT
End Time: Nov 1, 2018, 09:40 MDT
Duration: 77 minutes
This was a wide spread outage and service interruption to multiple services in the Calgary and aggregating communities. AXIA dispatched a tech to the site, and the connection was then restored. Cybera is currently monitoring for service stability.
Please contact the Cybera Network Operations Center at noc@cybera.ca or 403-536-0880 if you have any questions.
Subject: Cybera Maintenance
Category: Scheduled Hardware Upgrade for Google Cache Server (No Down-Time Expected)
Start Time: Dec 16, 2017 9:00 MDT
End Time: Dec 17, 2017 16:00 MDT
Duration: 31 hours
During the time frame indicated above, Cybera will be performing hardware upgrade for Google Cache Server in Cybera. Google Services should not be affected as it is going to re-route to another nearby Google Cache Server but due to the nature of the work, a threat notice is being sent.
Note: We are planning a longer outage because Google is going to update content on the Cache server during the time which may
take a long period time.
Please contact the Cybera Network Operations Center at noc@cybera.ca or 403-536-0880 when network problems are experienced outside of a maintenance window.
Category: Scheduled Maintenance (No Down Time Expected)
Start Time: July 20, 2017, 21:00 MDT
End Time: July 20, 2017, 23:59 MDT
Duration: 179 Minutes
During the time frame indicated above, Cybera will be performing the software update on its Calgary core router. Cybera services should not be affected, but due to the nature of the work, a threat notice is being sent.
Please contact the Cybera Network Operations Center at noc@cybera.ca or 403-536-0880 when network problems are experienced outside of a maintenance window.
Category: Scheduled Software Upgrade (No Down-Time Expected)
Start Time: June 15, 2017, 21:00 MDT
End Time: June 15, 2017, 00:01 MDT
Duration: 180 Minutes
During the time frame indicated above, Cybera will be performing software upgrade on its Edmonton core router. Cybera services should not be affected, but due to the nature of the work, a threat notice is being sent.
Please contact the Cybera Network Operations Center at noc@cybera.ca or 403-536-0880 when network problems are experienced outside of a maintenance window.
Category: Scheduled AXIA Maintenance
Start Time: April 26, 2017, 00:01 MDT
End Time: April 26, 2017, 06:00 MDT
Duration: 60 Minutes
During the time frame indicated above, AXIA will be performing maintenance on their network in Calgary. The outage duration should be less than the total duration of the reserved maintenance window and could include several small durations outages while maintenance is being done.
Cybera will not be performing any maintenance during that time and will be monitoring its connection to AXIA.
Please contact the Cybera Network Operations Center at noc@cybera.ca or 403-536-0880 when network problems are experienced outside of a maintenance window.
Category: Google Services
Start Time: March 17, 2017 8:00 am Local Time
End Time: March 17, 2017 4:00 pm Local Time
Anticipated Outage Duration: No Outage
During the time frame indicated above, Cybera will be adding a redundant connection to Google Services at YYCIX (Calgary) Internet Exchange. During the above outage window we do not expect any outage for Google Services, but if you experience any problem related to Google, please contact us via phone or email provided here.
Please contact the Cybera Network Operations Centre at noc@cybera.ca or (403) 536-0880.
Category: Calgary Supernet Maintenance
Start Time: March 11, 2017 18:00 Local Time
End Time: March 11, 2017 8:30 Local Time
Anticipated Outage Duration: 10 minutes
During the time frame indicated above, Shaw will be performing maintenance on the Cybera to Supernet connection in Calgary. The outage duration should be less than the total duration of the reserved maintenance window and could include several small durations outages while maintenance is being done. Members connected via Edmonton PoP will not be affected.
Please contact the Cybera Network Operations Center at noc@cybera.ca or 403-536-0880 when network problems are experienced outside of a maintenance window.
Category: Edmonton Router Maintenance
Start Time: March 8, 2017 21:30 Local Time
End Time: March 8, 2017 21:45 Local Time
Anticipated Outage Duration: 15 minutes or less
During the time frame indicated above, Cybera will be performing maintenance on one of its virtual core router in Edmonton. The outage duration should be less than the total duration of the reserved maintenance window and could include several small durations outages while maintenance is being done.
Contact: Please contact the Cybera Network Operations Center at noc@cybera.ca or 403-536-0880 when network problems are experienced outside of a maintenance window. All outages, scheduled or not are posted here.
Category: Calgary Supernet Maintenance
Start Time: February 8, 2017 00:01 Local Time
End Time: February 8, 2017 06:00 Local Time
Anticipated Outage Duration: 5 minutes
AXIA Change Ticket # CA0001322541
During the time frame indicated above, Axia/Supernet will be performing maintenance at the Calgary PoP. The outage duration should be less than the total duration of the reserved maintenance window and could include several small durations outages while maintenance is being done.
Please contact the Cybera Network Operations Center at noc@cybera.ca or 403-536-0880 when network problems are experienced outside of a maintenance window.