Archive for December, 2009

GT20-1 issues

posted by Robert
Dec 28

Since the Christmas eve event where all servers, pdu, switches, etc briefly lost power in Dallas, the GT20-1 server has not been behaving well. Virtbiz in Dallas worked hard to get the server back up and going, but it’s simply not reliable. Any change to CMOS settings and it doesn’t want to boot… So we don’t want to put it back into production. They’re going to ship the server back to us, and we’re going to migrate off of that chassis to one of the spares we have here. We’ll likely do an signifigant upgrade to the hardware at the same time.

For what it’s worth… Our decision of virtualizing all customer facing servers and backing them up and copying the backups to other servers worked. We’re looking at refining that backup procedure to decrease the downtime in the future. We apologize for the downtime and will be contacting affected customers shortly.

Robert

Robert Porter is the founder and managing member of Lagniappe Internet LLC. Robert holds multiple certifications incluging Oracle Certified Professional-Java 6 SE (OCP-J6), MCSE, A+, Net+, Project+, Security+, and multiple CIW certifications. He has been in the hosting industry for more than a decade and is founded Lagniappe Internet L.L.C. as a privately owned, completely debt free, hosting company based out of New Orleans. Robert's background includes 25+ years in programming, databases, networking and systems administration.


Dallas nodes … power

posted by Robert
Dec 24

All nodes, power distribution system, etc. lost power for a moment. They are restarting now, and should be available shortly.

Update: gt24-2, x335, x306 are back up, and all virtual servers on them are running.
Sent support page to the d.c. for gt20-1

Update 2: Virtbiz’s support and company websites are down. The gt20-1 node is taking a long time to come back up.

Update 3: I’ve paged a virtbiz support tech, but have not gotten any responses. Their support site is down. The This affects the DirectAdmin virtual server plus a couple others. We apologize for the downtime, and will post Virtbiz’s response when we get one.

Update 4: Since we can’t seem to get in touch with Virtbiz (we will be getting a LONG-TERM resolution to that problem!) in any way shape or form. We’re restoring last night’s backups from gt20-1 to alternate nodes. It will take apx 30 minutes to have the virtual servers done. We apologize, and will be contacting the affected customers in the coming days. One quick note: DirectAdmin customer weren’t affected by gt20-1 extended outage. That virtual server had been migrated to gt24-2 previously for load balancing.

Robert

Robert Porter is the founder and managing member of Lagniappe Internet LLC. Robert holds multiple certifications incluging Oracle Certified Professional-Java 6 SE (OCP-J6), MCSE, A+, Net+, Project+, Security+, and multiple CIW certifications. He has been in the hosting industry for more than a decade and is founded Lagniappe Internet L.L.C. as a privately owned, completely debt free, hosting company based out of New Orleans. Robert's background includes 25+ years in programming, databases, networking and systems administration.


GT24-2 node problem

posted by Robert
Dec 9

At apx. 9:55pm central time, GT24-2 had an issue and kernel panic’ed. The node is coming back up now, though it is taking some time for drive array checks, etc. All vps’es on it should be run again in the next 10 minutes but with reduced speed while the array consistency check completes. It should be back to normal within the next couple hours.

Robert

Robert Porter is the founder and managing member of Lagniappe Internet LLC. Robert holds multiple certifications incluging Oracle Certified Professional-Java 6 SE (OCP-J6), MCSE, A+, Net+, Project+, Security+, and multiple CIW certifications. He has been in the hosting industry for more than a decade and is founded Lagniappe Internet L.L.C. as a privately owned, completely debt free, hosting company based out of New Orleans. Robert's background includes 25+ years in programming, databases, networking and systems administration.