![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
sobriqueWell, this morning was interesting. Came in to find the print server wasn't working, after me plugging a new card into it last night.
It turns out that a SUN E450 has microswitches in the case, to detect if it's on properly. And it wasn't. Or at least, at some point between me firing it up to test, and re-racking it properly, it had come loose, and decided it wasn't going to power on.
The reason I'd taken it down was because it was next on the list to SAN attach. That's the task for today. It's not actually being a print server at the moment, because I restored the 'printer configuration' stuff to my workstation, and then stole it's IP address. So I can pretty much work at my leisure on that one. (Which is always nice).
I also took down a notes server to start migration. That worked, kind of, but due to a 'feature' with the copy program, failed to copy much data. (The feature is, when it can't access a file, it retries a million times, and has a long timeout between retries. As you might imagine, this does have a tendancy to bugger things up nicely.
Unfortunately, whilst overnight outage is ok, down all day is a bit of a problem, so I'll be doing that again tonight. Thankfully, this is something that can be done from home, so I'll most likely just bugger off early.
I've also found that (in reference to problems with servers, a few months back) some data _are_ corrupted. Which is ... unfortunate. The good news is that we _probably_ have the original data still, since it was probably a corruption from restoring the data.
The bad news is that it's taken them a month to notice, and how many others might be in this situation, and slowly rolling off the backups. I've set a restore of the appropriate stuff from the backup server going. 55Gb is just about possible to deal with at the moment. I'm going to restore it, and... I dunno, try and figure out _some_ way to compare the original and the backup, and see what's what.
Oh, and I've EMC in still doing more stuff with the NAS. Grovelling under floor tiles remains one of my least favourite things, but hey, at least it's in aircon.
Update: Oh, and there was another server that went splat for our ebusiness team, that I completely forgot. Ooops. Well, at least it was only a dev one :)
It turns out that a SUN E450 has microswitches in the case, to detect if it's on properly. And it wasn't. Or at least, at some point between me firing it up to test, and re-racking it properly, it had come loose, and decided it wasn't going to power on.
The reason I'd taken it down was because it was next on the list to SAN attach. That's the task for today. It's not actually being a print server at the moment, because I restored the 'printer configuration' stuff to my workstation, and then stole it's IP address. So I can pretty much work at my leisure on that one. (Which is always nice).
I also took down a notes server to start migration. That worked, kind of, but due to a 'feature' with the copy program, failed to copy much data. (The feature is, when it can't access a file, it retries a million times, and has a long timeout between retries. As you might imagine, this does have a tendancy to bugger things up nicely.
Unfortunately, whilst overnight outage is ok, down all day is a bit of a problem, so I'll be doing that again tonight. Thankfully, this is something that can be done from home, so I'll most likely just bugger off early.
I've also found that (in reference to problems with servers, a few months back) some data _are_ corrupted. Which is ... unfortunate. The good news is that we _probably_ have the original data still, since it was probably a corruption from restoring the data.
The bad news is that it's taken them a month to notice, and how many others might be in this situation, and slowly rolling off the backups. I've set a restore of the appropriate stuff from the backup server going. 55Gb is just about possible to deal with at the moment. I'm going to restore it, and... I dunno, try and figure out _some_ way to compare the original and the backup, and see what's what.
Oh, and I've EMC in still doing more stuff with the NAS. Grovelling under floor tiles remains one of my least favourite things, but hey, at least it's in aircon.
Update: Oh, and there was another server that went splat for our ebusiness team, that I completely forgot. Ooops. Well, at least it was only a dev one :)
