[CANCELED] Data Center Network Maintenance - April 8, 2025

The maintenance window has been canceled/rescheduled, we will post a new notice when a window is projected to be available.

Maintenance Windows:

  • Start: 2025-04-08 22:00 UTC / April 8 - 5:00 PM CDT
  • End: 2025-04-08 23:59 UTC / April 8 - 6:59 PM CDT

During the above Maintenance Window, our data center provider will be performing upgrades on the network. We expect brief interruptions to our services. The duration of the interruptions of up to 5-10 minutes may occur during the above window.

Effected Services

  • Managed Web Services
  • Managed Mail Services

If you have any questions or concerns, please feel free to contact us.

— Mad Scientist Technologies Infrastructure Team

Data Center Network Maintenance - March 25, 2025

Maintenance Windows:

  • Start: 2025-03-25 22:00 UTC / March 25 - 5:00 PM CDT
  • End: 2025-03-25 23:59 UTC / March 25 - 6:59 PM CDT

During the above Maintenance Window, our data center provider will be performing upgrades on the network. We expect brief interruptions to our services. The duration of the interruptions of up to 5-10 minutes may occur during the above window.

Effected Services

  • Managed Web Services
  • Managed Mail Services

If you have any questions or concerns, please feel free to contact us.

— Mad Scientist Technologies Infrastructure Team

Data Center Network Maintenance - March 20, 2025

Maintenance Windows:

  • Start: 2025-03-20 22:00 UTC / March 20 - 5:00 PM CDT
  • End: 2025-03-20 23:59 UTC / March 20 - 6:59 PM CDT

During the above Maintenance Window, our data center provider will be performing upgrades on the network. We expect brief interruptions to our services. The duration of the interruptions of up to 5-10 minutes may occur during the above window.

Effected Services

  • Managed Web Services
  • Managed Mail Services

If you have any questions or concerns, please feel free to contact us.

— Mad Scientist Technologies Infrastructure Team

Managed Mail Service Outage

Resolved 2025-Feb-16 at 7:30PM

Starting about 2:50PM we are experiencing an outage of our managed mail services. We are currently investigating and will update this post by 3:20PM CST Today.

All Times are in US Central Standard Time

Updates

  • 15:23 (3:23PM): Network Connectivity is currently lost to the server, we are still investigating the problem. Next update will be posted at 3:35PM.
  • 15:33 (3:33PM): Network Connectivity has been restored, however the service is down because it unable to access the authentication server for user accounts. Will update again by 3:50PM.
  • 15:49 (3:49PM): We are investigating issue with our Private Connectivity between the mail server the authentication server. We are rolling out a possible fix now. Next Update will be at 4:15PM at the latest.
  • 16:14 (4:14PM): We are attempting to recovery our private network between the servers. We will also be taking our managed web services for a brief time. Next update will be at 4:40PM.
  • 17:00 (5:00PM): We have implemented a temporary fix, while we investigating the root cause of the failure to our private network at our data center. Additional Updates will be posted here.
  • Final Update/Root Cause: As of 17:30 (5:30PM)

Root Cause

On February 16 starting at 14:43PM CST our monitoring systems detected our managed mail server offline. Upon investigation we found the server had lost connectivity to Public (Internet) and Private Networks. During the investigation we found that there may be an undetected outage with our data center provider. We were able to get the server’s Internet Connection back. However, the server’s private network would not come back online. We changed the authentication system to use the public connection over an encrypted link to temporary allow the mail system to come back online. Upon investigating and testing the connection to the private network, network come back online. We reverted the change to the Authentication System back over to the private network.

We will continue to monitor the situation and update if things change.


We apologize for this outage, if you have any questions or concerns, please feel free to contact us.

Mad Scientist Technologies Team

Data Center - Network Maintenance on November 26

Maintenance Window:

  • Start: 2024-11-26 22:00 UTC / November 26 - 4:00 PM CST
  • End: 2024-11-27 02:00 UTC / July 29 - 8:00 PM CST

During the above Maintenance Window our Data Center Provider will be performing maintenance on the network equipment in our primary data center location.

We expect a minimum downtime or outage during this window. However, there may be an delays connecting to our infrastructure during the above window.

If you have any questions or concerns, please feel free to contact us.

— Mad Scientist Technologies Infrastructure Team

Status Site Outage

On November 8, 2024 start about 5:28AM CST our Status Site (https://status.madscitech.net) went offline due to an expired HTTPS certificate. We have found that the outage was caused by our strict HTTPS Issuing Policy we had configured for our domain. We have made changes to the records that control this process and should not happen in the future.

We aplogize for this outage, if you have any questions or concerns, please feel free to contact us.

Mad Scientist Technologies Team

Data Center Provider Firewall Maintenance

Maintenance Window:

  • Start: 2024-07-29 10:00 UTC / July 29 - 5:00 AM CDT
  • End: 2024-07-29 12:00 UTC / July 29 - 7:00 AM CDT

During the above Maintenance Window our Data Center Provider will be performing maintenance on the management network firewall in our primary data center location.

There is no expected downtime or outage during this window. However, there may be an delay in processing infrastructure changes up to 15 minutes during the above window.

If you have any questions or concerns, please feel free to contact us.

— Mad Scientist Technologies Infrastructure Team

Data Center Network Upgrades - June 17/18, 2024

Maintenance Windows:

Phase One

  • Start: 2024-06-17 22:00 UTC / June 17 - 5:00 PM CDT
  • End: 2024-06-18 02:00 UTC / June 17 - 9:00 PM CDT

Phase Two

  • Start: 2024-06-18 22:00 UTC / June 18 - 5:00 PM CDT
  • End: 2024-06-19 02:00 UTC / June 18 - 9:00 PM CDT

During the above Maintenance Window, our data center provider will be performing upgrades with core networking equipment. We expect brief interruptions to our services during the above window.

There may be brief interruptions to authentication with managed mail services during the above maintenance windows.

Effected Services

  • Managed Web Services
  • Managed Mail Services

If you have any questions or concerns, please feel free to contact us.

— Mad Scientist Technologies Infrastructure Team

Data Center Network Maintenance - 2024-05-29

Maintenance Windows:

  • Start: 2024-05-29 10:00 UTC / May 29 - 5:00 AM CDT
  • End: 2024-05-29 14:00 UTC / May 29 - 9:00 AM CDT

During the above Maintenance Window, our data center provider will be performing upgrades on core switches. We expect brief interruptions to our services while traffic is re-routed. The duration of the interruptions may occur for 5-15 seconds during the above window.

If you have any questions or concerns, please feel free to contact us.

— Mad Scientist Technologies Infrastructure Team

Data Center Maintenance Window for 2024-04-16

Maintenance Window:

  • Start: 2024-04-16 11:00 UTC / April 16 - 6:00 AM CDT
  • End: 2024-04-16 13:00 UTC / April 16 - 8:00 AM CDT

During the above Maintenance Window our Data Center Provider will be performing core network improvements in our primary data center locations.

There is no expected downtime or outage during this window. However, there may be an increase latency or a minor disruption in network traffic for 2-3 minutes.

If you have any questions or concerns, please feel free to contact us.

— Mad Scientist Technologies Infrastructure Team