Outage caused by weird bug (Resolved)
  • Priority - Critical
  • Affecting Server - server17.yyz02.internal.gotekky.com
  • At 09:34 (UTC-4) Virtuozzo reported failed connections to the slave (server17.yyz02.internal.gotekky.com).

    Multiple down on the node, we applied updates before rebooting. The server is back to normal now.

     

    We're still investigating the cause, we will provide more updates here as they become available.

     

     

    Thank you,

  • Date - 14/10/2021 09:34 - 14/10/2021 10:11
  • Last Updated - 26/11/2021 16:04
Panne causé par un bug bizarre (Resolved)
  • Priority - Critical
  • Affecting Server - server17.yyz02.internal.gotekky.com
  • À 09h34 (UTC-4) Virtuozzo a signalé des échecs de connexion au serveur (server17.yyz02.internal.gotekky.com). Plusieurs services en pannes sur le serveur, nous avons appliqué les mises à jour avant de redémarrer. Le serveur est revenu à normal maintenant. Nous enquêtons toujours sur la cause, nous fournirons plus de détails dès qu'elles seront disponibles. Merci,

     

  • Date - 14/10/2021 09:34 - 14/10/2021 10:11
  • Last Updated - 26/11/2021 16:04
Scheduled network maintenance / Maintenance planifiée du réseau (Resolved)
  • Priority - Critical
  • Affecting Other - Toronto Network / Réseau de Toronto
  • *La version française suivra.

     

    Dear Customer,

     

    As a valued customer, Gotekky is committed to keeping you informed about any changes in the status of your service with us. This email is to alert you regarding maintenance we will be performing on our network:

     

    Start time: 12:01 AM (local time) 07/11/2021

    End time: 06:00 AM (local time) 07/11/2021

    Expected Outage/Downtime: 45-60 minutes

     

    The purpose of this work is to apply and activate software module upgrades on code running on our switches and routers per the manufacturer's recommendations.

     

    During this maintenance window, you may experience up to two brief interruptions in service while we complete the maintenance activities. However, due to the complexity of the work, your downtime may be longer. Customers may also see some re-convergence during the maintenance window. Customers may experience latency and packet loss intermittently throughout the window.

     

    Over the days following this initial upgrade, we will be upgrading code on redundant upstream routers. We encourage all our customers to please check our network status page https://portal.gotekky.com/serverstatus.php

     

    Our network operations engineers closely monitor the work and will do everything possible to minimize any inconvenience to you. If you have any problems with your connection after this time, or if you have any questions regarding the maintenance at any point, please contact [email protected].

     

    We appreciate your patience during this work and welcome any feedback.

     

     

    Thank you for being a Gotekky customer.

     

     

    Sincerely,

     

     

    Gotekky Support

    [email protected]

    =========================================================

    Cher client,

     

    En tant que client estimé, Gotekky s'engage à vous tenir informé de tout changement dans l'état de votre service avec nous. Cet e-mail est destiné à vous alerter sur la maintenance que nous allons effectuer sur notre réseau :

     

    Heure de début : 00h01 (heure locale) 11/07/2021

     

    Heure de fin : 06h00 (heure locale) 11/07/2021

     

    Panne/temps d'arrêt attendus : 45 à 60 minutes

     

    Le but de ce travail est d'appliquer et d'activer les mises à niveau des modules logiciels sur le code exécuté sur nos commutateurs et routeurs selon les recommandations du fabricant. Au cours de cette fenêtre de maintenance, vous pouvez rencontrer jusqu'à deux brèves interruptions de service pendant que nous terminons les activités de maintenance. Cependant, en raison de la complexité du travail, votre temps d'arrêt peut être plus long. Les clients peuvent également constater une certaine reconvergence pendant la fenêtre de maintenance.

     

    Les clients peuvent subir une latence et une perte de paquets par intermittence tout au long de la fenêtre. Au cours des jours suivant cette mise à niveau initiale, nous mettrons à niveau le code sur les routeurs en amont redondants. Nous encourageons tous nos clients à consulter notre page d'état du réseau https://portal.gotekky.com/serverstatus.php?language=French

     

    Nos ingénieurs d'exploitation réseau surveillent de près le travail et feront tout leur possible pour minimiser tout inconvénient pour vous. Si vous rencontrez des problèmes avec votre connexion après cette période, ou si vous avez des questions concernant la maintenance à tout moment, veuillez contacter [email protected].

     

    Nous vous remercions de votre patience pendant ce travail et apprécions vos commentaires.

     

     

    Merci d'être un client Gotekky.

     

     

    Cordialement,

     

    Soutien Gotekky

    [email protected]

  • Date - 11/07/2021 00:00 - 18/08/2021 16:28
  • Last Updated - 11/07/2021 00:54
Power issue this morning / Problème d'alimentation électrique ce matin (Resolved)
  • Priority - Critical
  • Affecting Other - Toronto Network yyz01
  • This morning at 10:02am (UTC-4) our Toronto data center lost main power for a second, causing our primary router/switch/uplink to go offline. The rerouting normally takes 1-2 minutes but a configuration error on the primary router prevented our secondary router from taking over. The network outage lasted 15 minutes. The config error was made during a routine maintenance last weekend.

    For customers on our web hosting/reseller plans, the redundant power supplies were mistakenly connected to the same feed. The servers went down and additional bootup steps were needed for an additional 14 minutes of downtime.

    The majority of our VPS hosting customers were back online in 21 minutes, unfortunately our newest AMD server (server19.yyz01.internal.gotekky.com) went offline due to a lack of redundant power supply and the activation of a fail-safe surge protection mode. We had to dispatch a tech to the DC to fix the issue. Server19 came back at 11:39am (UTC-4).

    Some dedicated hosting customers experienced issues due to the power loss. If you're still having issues, please open a ticket by emailing [email protected].

    Corrective Action:

    We have corrected the primary router's configuration error, our shared/reseller servers are now connected to a redundant power feed.

     

    If you have any questions or concerns please email [email protected]

    Thank you,

    Gotekky Support

    [email protected]

    ================================================

     

    Ce matin, à 10 h 02 (UTC-4), notre centre de données de Toronto a perdu l'alimentation électrique principale pendant une seconde, ce qui a mis notre routeur / commutateur / fournisseur principal hors ligne. Le réacheminement prend normalement 1 à 2 minutes, mais une erreur de configuration sur le routeur principal a empêché notre routeur secondaire de prendre le relais. La panne du réseau a duré 15 minutes. L'erreur de configuration a été commise lors d'une maintenance de routine le week-end dernier.

    Pour les clients sur nos plans d'hébergement Web / revendeur, les blocs d'alimentation redondants ont été connectés par erreur au même flux. Les serveurs sont tombés en panne et des étapes de démarrage supplémentaires ont été nécessaires pour 14 minutes supplémentaires d'indisponibilité.

    La majorité de nos clients d'hébergement VPS étaient de retour en ligne en 21 minutes, malheureusement notre nouveau serveur AMD (server19.yyz01.internal.gotekky.com) s'est déconnecté en raison d'un manque d'alimentation redondante et de l'activation d'une protection contre les surtensions. Nous avons dû envoyer un technicien au DC pour résoudre le problème. Server19 est revenu à 11h39 (UTC-4).

    Certains clients d'hébergement dédié ont rencontré des problèmes en raison de la panne de courant. Si vous rencontrez toujours des problèmes, veuillez ouvrir un ticket en envoyant un e-mail à [email protected].

    Action corrective:

    Nous avons corrigé l'erreur de configuration du routeur principal, nos serveurs partagés / revendeurs sont maintenant connectés à une alimentation électrique redondante.

     

    Si vous avez des questions ou des préoccupations, veuillez envoyer un e-mail à [email protected]

    Merci,

    Soutien Gotekky

    [email protected]

  • Date - 06/07/2020 10:02 - 11/07/2021 00:53
  • Last Updated - 06/07/2020 16:32
Emergency maintenance Urgente (Resolved)
  • Priority - Critical
  • Affecting Other - Toronto Network, Réseau de Toronto
  • As a valued customer, Gotekky is committed to keeping you informed about any changes in the status of your service with us. This notice is to alert you regarding maintenance that will be performed by one of our upstream carriers:

     

    Start time: 12:01 AM (local time UTC-4) 21/06/2020

    End time: 02:00 AM (local time UTC-4) 21/06/2020

    Service impact: Only intermittent packet loss

     

    Our engineers will be swapping switches and routers in order to accomodate new 10GIG fiber interfaces. Gotekky will be adding more capacity to its network in the weeks to come.

     

    Our network operations engineers closely monitor the work and will do everything possible to minimize any inconvenience to you. If you have any problems with your connection after this time, or if you have any questions regarding the maintenance at any point, please contact [email protected].

     

    We appreciate your patience during this work and welcome any feedback.

     

     

    Thank you for being a Gotekky customer.

     

     

    Sincerely,

     

    Gotekky Support

    [email protected]

     

    ========================================================================

    Gotekky s'engage à vous tenir informé de tout changement sur le statut de vos services avec nous. Cet avis vise à vous alerter concernant la maintenance qui sera effectuée par l'un de nos fournisseurs en amont:

     

    Heure de début: 00h01 (heure locale) 21/06/2020

    Heure de fin: 02h00 (heure locale) 21/06/2020

    Impact sur le service: Perte de paquets intermittente

     

    Nos ingénieurs échangeront des commutateurs et des routeurs afin d'accueillir de nouvelles interfaces fibre 10GIG. Gotekky ajoutera de la capacité à son réseau dans les semaines à venir.

     

    Nos ingénieurs d'exploitation réseau surveillent de près les travaux et feront tout leur possible pour minimiser les inconvénients pour vous. Si vous avez des problèmes avec votre connexion après cette heure, ou si vous avez des questions concernant la maintenance à tout moment, veuillez contacter [email protected].

     

    Nous apprécions votre patience pendant ce travail et nous apprécions vos commentaires.

     

     

    Merci d'être un client Gotekky.

     

     

    Cordialement,

     

    Soutien Gotekky

    [email protected]

     

     

  • Date - 21/06/2020 00:01 - 11/07/2021 00:46
  • Last Updated - 20/06/2020 15:18
Emergency maintenance Urgente (Resolved)
  • Priority - Critical
  • Affecting Other - Toronto Network yyz01
  • Start time: 12:01 AM (local time) 21/01/2020
    End time: 06:00 AM (local time) 21/01/2020
    Expected Outage/Downtime: Up to 5 minutes

    One of our upstream carriers Aptum Technologies will be performing emergency maintenance on their switching equipment. Our network engineers will be shutting down our Aptum link and allowing data to route via our other providers while they are performing the maintenance.

    Our network operations engineers closely monitor the work and will do everything possible to minimize any inconvenience to you. If you have any problems with your connection after this time, or if you have any questions regarding the maintenance at any point, please contact [email protected].

    We appreciate your patience during this work and welcome any feedback.


    Thank you for being a Gotekky customer.


    Sincerely,

    ========================================================================


    Cher client,

    Gotekky s'engage à vous tenir informé de tout changement sur le statut de vos services avec nous. Cet avis vise à vous alerter concernant la maintenance qui sera effectuée par l'un de nos fournisseurs en amont:

    Heure de départ: 00h01 (heure locale) 21/01/2020
    Heure de fin: 06h00 (heure locale) 21/01/2020
    Panne / temps d'arrêt prévu: jusqu'à 5 minutes

    L'un de nos fournisseur de connectivité, Aptum Technologies, effectuera une maintenance d'urgence de son équipement de commutation. Nos ingénieurs réseau fermeront notre lien Aptum et autoriseront le routage des données via nos autres fournisseurs pendant ce temps.

    Nos ingénieurs d'exploitation réseau surveillent de près les travaux et feront tout leur possible pour minimiser les inconvénients pour vous. Si vous avez des problèmes avec votre connexion après cette heure, ou si vous avez des questions concernant la maintenance à tout moment, veuillez contacter [email protected].

    Nous apprécions votre patience pendant ce travail et nous apprécions vos commentaires.


    Merci d'être un client Gotekky.


    Cordialement,

  • Date - 21/01/2020 00:01 - 21/01/2020 06:00
  • Last Updated - 21/01/2020 10:19
Network maintenance / Maintenance réseau (Resolved)
  • Priority - Critical
  • Affecting Other - Toronto network / Réseau de Toronto
  • Dear Customer,

    As a valued customer, Gotekky is committed to keeping you informed about any changes in the status of your service with us. This notice is to alert you regarding maintenance that will be performed on our network.

    Start time: 12:01 AM (UTC-5) 23/02/2019
    End time: 04:00 AM (UTC-5) 23/02/2019
    Expected Outage/Downtime: < 15 minutes

    We will be moving one of our core distribution switches to a new power circuit.

    Our network operations engineers closely monitor the work and will do everything possible to minimize any inconvenience to you. If you have any problems with your connection after this time, or if you have any questions regarding the maintenance at any point, please contact [email protected].

    We appreciate your patience during this work and welcome any feedback.


    Thank you for being a Gotekky customer.


    Sincerely,

    ============================

    Cher client,

     

    Gotekky s'engage à vous tenir informé de tout changement dans le statut de votre service chez nous. Cet avis vous avertit que de la maintenance sera effectuée sur notre réseau.

     

     

    Début: 00:01 AM (UTC-5) 23/02/2019

    Fin: 04:00 AM (UTC-5) 23/02/2019

    Panne / arrêt prévu: < 15 minutes

     

     

    Nous allons déplacer un de nos commutateurs de distribution vers un nouveau circuit électrique. 

     

     

    Nous ferons tout notre possible pour minimiser les inconvénients. Si vous rencontrez des problèmes de connexion après cette fenêtre ou si vous avez des questions concernant la maintenance, veuillez contacter notre soutien technique à l'adresse courriel [email protected].

     

     

    Nous vous remercions de votre patience pendant ce travail et vos commentaires seront les bienvenus.

     

     

     

    Merci d'être un client Gotekky.

     

     

    Cordialement,

  • Date - 23/02/2019 12:01 - 20/01/2020 22:15
  • Last Updated - 21/02/2019 12:37
Server15 maintenance (Resolved)
  • Priority - Critical
  • Affecting System - Server15
  • Update: The maintenance was completed successfully at 1:02am (UTC-5).

    Mise-à-jour: La maintenance a été complétée avec succès à 1:02am (UTC-5).

    Dear Customer,

    As a valued customer, Gotekky is committed to keeping you informed about any changes in the status of your service with us. This notice is to alert you regarding maintenance that will be performed on one of our VPS nodes:

    Start time: 12:01 AM (local time) 23/12/2018
    End time: 03:00 AM (local time) 23/12/2018
    Expected Outage/Downtime: 30 mins to 1 hour.

    We will be making changes to the way the network cards are set up on server15 to improve redundancy. We will be bonding the network ports to ensure that the server is not relying on a single network switch for connectivity.

    We will do everything possible to minimize any inconvenience to you. If you have any problems with your connection after this time, or if you have any questions regarding the maintenance at any point, please contact [email protected].

    We appreciate your patience during this work and welcome any feedback.


    Thank you for being a Gotekky customer.


    Sincerely,

    ============================

    Cher client,

     

    Gotekky s'engage à vous tenir informé de tout changement dans le statut de votre service chez nous. Cet avis vous avertit que de la maintenance sera effectuée sur l’un de nos serveurs qui héberge votre machine virtuelle:

     

     

    Début: 00:01 (heure locale) 23/12/2018

    Fin: 03:00 (heure locale) 23/12/2018

    Panne / arrêt prévu: 30 minutes à 1 heure.

     

     

    Nous allons modifier la manière dont les cartes réseau sont configurées sur server15 pour améliorer la redondance. Nous allons relier les ports réseau pour nous assurer que le serveur ne dépende pas d’un seul commutateur réseau pour la connectivité.

     

     

    Nous ferons tout notre possible pour minimiser les inconvénients. Si vous rencontrez des problèmes de connexion après cette fenêtre ou si vous avez des questions concernant la maintenance, veuillez contacter notre soutien technique à l'adresse courriel [email protected].

     

     

    Nous vous remercions de votre patience pendant ce travail et vos commentaires seront les bienvenus.

     

     

     

    Merci d'être un client Gotekky.

     

     

    Cordialement,

  • Date - 23/12/2018 00:01 - 23/12/2018 03:00
  • Last Updated - 21/02/2019 12:22
Network maintenance (Resolved)
  • Priority - Low
  • Affecting Other - Toronto Network
  •  
    Dear Customer,

    As a valued customer, Gotekky is committed to keeping you informed about any changes in the status of your service with us. This notice is to alert you regarding maintenance that will be performed by one of our upstream carriers:

    Start time: 12:01 AM (local time) 12/01/2019
    End time: 04:00 AM (local time) 12/01/2019
    Expected Outage/Downtime: None

    One of our upstream carriers Cogeco Data Services will be performing power related maintenance. During this maintenance, they will be replacing existing connectors to a breaker panel. 

    Our network operations engineers closely monitor the work and will do everything possible to minimize any inconvenience to you. If you have any problems with your connection after this time, or if you have any questions regarding the maintenance at any point, please contact [email protected].

    We appreciate your patience during this work and welcome any feedback.


    Thank you for being a Gotekky customer.


    Sincerely,

  • Date - 12/01/2019 00:01 - 12/01/2019 04:00
  • Last Updated - 21/02/2019 12:22
Toronto network outage (Resolved)
  • Priority - Critical
  • Affecting Other - Toronto network
  • 25/05/2018 02:02: Part of our network is down, we're investigating the cause. More updates to come.

    25/05/2018 02:17: Network back up

    25/05/2018 02:23: Network went down again

    25/05/2018 02:39: We had to shut down Edge router #1 connected to Cogent Communications, the network is now riding exclusively on Cogeco Data Services while we investigate the cause. More updates to come.

  • Date - 25/05/2018 02:02 - 25/05/2018 02:42
  • Last Updated - 19/12/2018 09:12
Kernel Panic on server11 (SSD), Panique du no (Resolved)
  • Priority - Critical
  • Affecting Server - manager.gotekky.com

  • 23/02/2018 @ 09:55: Our server11 node serving SSD based containers crashed at around 9:55AM.
    23/02/2018 @ 09:57: Remote console is showing a Kernel Panic, we're power cycling the server.
    23/02/2018 @ 10:05: All containers on server11 have now recovered.

    The server had 495 days of uptime when it crashed. We will be performing a maintenance on server11 this weekend.


    23/02/2018 @ 09:55: Un des serveurs physiques qui heberge les instances SSD server11 a crashé vers 9:55AM.
    23/02/2018 @ 09:57: Notre console à distance montre une panique du noyau linux.
    23/02/2018 @ 10:05: Les instances sur serveur11 sont maintenant de retour.

    Le serveur avait 495 jours de service ininterrompu lorsqu'il a crashé. Nous performerons de la maintenance sur le serveur11 ce weekend.

  • Date - 23/02/2018 09:55 - 23/02/2018 10:05
  • Last Updated - 28/03/2018 12:43
Emergency Network Maintenance - service impac (Resolved)
  • Priority - Critical
  • Affecting Other - Toronto Network
  • Maintenance type: Network (service impacting)

    Date: 09/02/2017 between 00:01 am and 06:00 am

    Duration: Up to 2 hours

     

    Following a second outage in the past week (this time 1 hour starting around 00:23 on the 8th) we have decided to replace the routers. We will work as quickly as possible to minimize the outage, however if things don't go according to plan the outage could extend to 2 hours. We we will also station technicians within 1KM of the data center for at least the next 5 days.

    If you have any questions or concerns please let us know at [email protected] 

    Thank you,

     

    Gotekky Support

    [email protected]

  • Date - 09/02/2017 00:21 - 30/12/2017 19:50
  • Last Updated - 09/02/2017 16:47
Network outage (Resolved)
  • Priority - Critical
  • Affecting Other - Toronto Network
  • Network is currently down, more updates to come.

    An engineer is on his way to the datacenter to reboot the routers, ETA 30-45 mins.

    08/02/2017 01:28: The network is back.

  • Date - 08/02/2017 00:33 - 08/02/2017 01:28
  • Last Updated - 09/02/2017 16:42
Emergency network maintenance (service impact (Resolved)
  • Priority - Critical
  • Affecting Other - Toronto network
  • Maintenance type: Network (service impacting)

    Date: 03/02/2017 between 00:01 am and 06:00 am

    Duration: 15 minutes

    Our network went down unexpectedly last evening due to a BGP hiccup, connectivity was restored after 14 minutes. We are still investigating the cause, in the meantime we will be performing emergency network maintenance on the routers overnight on February 3rd 2017, the changes will affect BGP routing for 5-15 mins, the total expected downtime is expected to last no more than 15 minutes. if you have any questions or concerns please let us know at [email protected] 

    Thank you,


    Update: 03/02/2017 @ 01:18 AM: The maintenance has started.
     
    Update: 03/02/2017 @ 01:32 AM: The maintenance is now complete.

    Gotekky Support

    [email protected]

     

  • Date - 03/02/2017 00:01 - 03/02/2017 06:00
  • Last Updated - 03/02/2017 07:34
Toronto network downtime (Resolved)
  • Priority - Critical
  • Affecting Server - cPanel Manage2
  • 01/02/2017 23:03: Our toronto network is down we're investigating the cause. We will update you when we have more information.


    01/02/2017 23:17: The network is back up, we're still investigating the cause.

  • Date - 01/02/2017 22:03 - 01/02/2017 23:17
  • Last Updated - 02/02/2017 23:08
Planned Network Maintenance (Resolved)
  • Priority - Critical
  • Affecting Other - Toronto Network
  • Dear Customer,

    As a valued customer, Gotekky is committed to keeping you informed about any changes in the status of your service with us. This email is to alert you regarding maintenance we will be performing on our network:

    Start time: 12:00 AM (local time) 01/20/2017
    End time: 06:00 AM (local time) 01/20/2017
    Expected Outage/Downtime: 45-60 minutes

    The purpose of this work is to apply and activate software module upgrades on code running on the edge routers per the manufacturer's recommendations.

    During this maintenance window, you may experience up to two brief interruptions in service while we complete the maintenance activities. However, due to the complexity of the work, your downtime may be longer. Customers may also see some re-convergence during the maintenance window. Customers may experience latency and packet loss intermittently throughout the window.

    Over the days following this initial upgrade, we will be upgrading code on redundant upstream routers. We encourage all our customers to please check our network status page https://portal.gotekky.com/serverstatus.php

    Our network operations engineers closely monitor the work and will do everything possible to minimize any inconvenience to you. If you have any problems with your connection after this time, or if you have any questions regarding the maintenance at any point, please contact [email protected].

    We appreciate your patience during this work and welcome any feedback.


    Thank you for being a Gotekky customer.


    Sincerely,

  • Date - 20/01/2017 00:00 - 20/01/2017 06:00
  • Last Updated - 20/01/2017 12:12
Toronto - IP spoofing targeting FTP port. (Resolved)
  • Priority - Low
  • Affecting Other - Toronto Network

  • An attacker has been using all FTP services on our network to launch a Syn Attack against a remote target. They are using IP spoofing to direct traffic to the target, we've had to disable PORT 21 temporarily. We encourage users to use SFTP instead. 

    01/11/2016 @ 12:22 PM : Port 21 is back.

  • Date - 01/11/2016 08:00
  • Last Updated - 01/11/2016 17:22
IMPORTANT: Server management panel migration (Resolved)
  • Priority - Critical
  • Affecting Other - Toronto Network
  • Dear customers,

    Starting this evening we will begin migrating all VPS and dedicated server clients to a new server management panel called Virtualizor. Please note that this has nothing to do with end-user control panels like cPanel, Virtualizor will manage the layer between the physical server and VPS/containers.

    The new panel will provide the following features: Server power on/off/restart, statistics, OS reload, control panel installer (cPanel, DirectAdmin, Plesk, CentOS Web Panel...), enabling TUN/TAP devices, serial console+SSH, backups. All options will be accessible centrally via our client portal.

    Our dedicated server clients will gain access to Cloud status, allowing them to create, modify, delete individual containers on their physical servers. Virtualizor is white-label friendly and allows you to setup your own logos for a reseller-friendly environment. WHMCS modules are available to give your clients access to managing their own VPS/Containers.

    The migration will take place on Saturday June 18th, Sunday June 19th, Monday June 20th, Tuesday June 21st 2016 between 11PM - 6AM (UTC-4). The servers will be down for a maximum of 2 hours, our target is 1h with dedicated servers taking considerably less time.

    If you have any questions or concerns please feel free to let us know, we can be reached via live chat, the client portal or by email to [email protected]


    Best Regards,

    Gotekky Support
    [email protected]

  • Date - 18/06/2016 23:00 - 08/10/2016 09:24
  • Last Updated - 19/06/2016 12:37
MAINTENANCE - SERVICE IMPACTING - Toronto Net (Resolved)
  • Priority - Critical
  • Affecting Other - Toronto Network
  • Start Date & Time: Sunday March 27, 2016 01:00 ET

    End Date & Time: Sunday March 27, 2016 01:45 ET

    Duration: 45 minutes

    Type: SERVICE IMPACTING

    Services Affected: Toronto Network

     

    Be advised that Gotekky will be performing EMERGENCY SERVICE IMPACTING maintenance on our Toronto network on Sunday March 27, 2016 at 01:00 ET until 01:45 ET.

     

    Over the course of this maintenance you may experience packet loss and/or latency for up to 5 minutes as changes to connections are made.

     

    If you require immediate assistance during the maintenance window, or if you have any other questions or concerns, please contact our Service Desk at 1.888.915.4400 or email [email protected]



    27/03/2016 @ 1:53 : The maintenance is stretching out over 45 mins. Sorry for the inconvenience.

    27/03/2016 @ 1:58 : The maintenance is now complete, thank you for your patience.

     

    Gotekky

    1.888.915.4400

    [email protected]

  • Date - 27/03/2016 01:00 - 27/03/2016 01:45
  • Last Updated - 27/03/2016 02:00
MAINTENANCE - SERVICE IMPACTING - Toronto Net (Resolved)
  • Priority - Critical
  • Affecting Other - Toronto Network
  • Start Date & Time: Sunday March 20, 2016 00:01 ET

    End Date & Time:   Sunday March 20, 2016 03:00 ET

    Duration:  2 hours and 59 minutes

    Type: SERVICE IMPACTING

    Services Affected: Toronto Network

     

    Dear Customer

     

    Be advised that Gotekky will be performing SERVICE IMPACTING maintenance on our Toronto Switches on Sunday March 20, 2016 at 00:01 ET until 03:00 ET.

     

    Over the course of this maintenance you may experience packet loss and/or latency for up to 30 minutes as devices are connected to the replacement switches.

     

    If you require immediate assistance during the maintenance window, or if you have any other questions or concerns, please contact our Service Desk at 1.888.915.4400 or email [email protected]

     

    Status
    20/03/2016 @ 01:07 : We will be starting in a few minutes.
    20/03/2016 @ 01:13 : The maintenance is now starting.


    Gotekky

    1.888.915.4400

    [email protected]

  • Date - 20/03/2016 00:01 - 20/03/2016 03:00
  • Last Updated - 20/03/2016 10:48
Cogent routing issues - Toronto Network (Resolved)
  • Priority - Critical
  • Affecting Other - Toronto Network

  • 17/03/2016 @ 22:09 : Some clients have reported issues connecting to their IPs, upon investigating we noticed some unusual routing activity on the Cogent network. We have attempted to shutdown the link but it took the entire network offline, we are working with both providers (Cogent and Nexicom) to find the cause. Downtime was 19 minutes, we will provide more updates when available.

    17/03/2016 @ 22:34 : We stand corrected the entire network was not affected, we were missing routes from our other provider Nexicom (about 130 000), taking Cogent offline caused more issues than it solved. We've notified Nexicom. Cogent seems to be back to normal now.

    18/03/2016 @ 15:36 : Full routes to Nexicom were restored earlier today. We've learned that Nexicom installed a new router in January, some configuration mistakes on their end prevented our router from getting all of the updated community strings.


    Gotekky Support
    [email protected]

  • Date - 17/03/2016 21:48 - 17/03/2016 22:08
  • Last Updated - 18/03/2016 15:47
Network outage. (Resolved)
  • Priority - Critical
  • Affecting Other - Network
  •  

    We encountered an unforseen issue during a non service impacting maintenance window on our secondary router. The router's fail-over link interfered with our main router and required manual adjustments. The downtime for most customers/subnets was approximately 20 minutes from start to finish (02:07am to 02:17am UTC-5). We were notified that several subnets failed to be mapped following the fail-over issue today, several subnets were affected by the extended downtime (02:07am to 03:04am UTC-5).

    The issue today has uncovered a need to improve certain areas here they are:

    1) We will be making operational changes in the way we notify customers about planned network maintenance from now on, even what we think is non service impacting. We definitely see a need to improve communication following today's event.

    2) Our monitoring systems did not take into account each individual subnet, the extended downtime affecting several customers could have been prevented.


    In the weeks ahead we will be planning several major network upgrades for this year. Changes will include upgrading our core routers and switching to support GigE speeds on both front and back end in order to provide you with a faster and more robust network.

    We apologize for any inconvenience this outage may have caused, if you have any questions or concerns please direct them to [email protected] or call +1.514.316.1885 / +1.888.915.4400

  • Date - 21/02/2016 02:07 - 21/02/2016 03:04
  • Last Updated - 21/02/2016 09:33
Scheduled Network Maintenance - Scarborough - (Resolved)
  • Priority - Critical
  • Affecting Other - Network
  • Dear Customers,

    Please be advised that our vendor will be performing a scheduled network maintenance at the Scarborough 20 Pullman Facility, during the following window:

    Wednesday, May 9, 2012 from 00:01 ET to 04:00 ET (May 9, 04:01-08:00 GMT)

    This maintenance is necessary to migrate our network connectivity to a new gateway in order to conform with new network standards in POD C.

    Due to the nature of the change that is required, you will experience up to 5 minutes of downtime while the migration is being performed. You will NOT be required to make any modifications to your IP settings. The duration of this maintenance window will be 4 hours.

    If you have any questions or concerns please contact our Network Operations Centre at [email protected]

  • Date - 09/05/2012 00:01 - 21/06/2014 05:40
  • Last Updated - 30/04/2012 13:49
Emergency maintenance on vps1 and vps4. (Resolved)
  • Priority - High
  • Affecting System - VPS1 and VPS4
  •  

    An emergency maintenance window is planned on VPS1 and VPS4 at 19:00 (GMT-5), service interruption will last 5-10 minutes.

  • Date - 17/01/2010 00:00 - 17/01/2010 00:00
  • Last Updated - 30/04/2012 13:48