![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
Well, it's been a hellish week already.
Not _all_ bad, just ... hectic.
Monday has had directors butt kicking, because someone finally demolished their little sandcastle of 'everything's perfick in IT land'. How they managed to miss it entirely over the last 12 months remains a source of mystery. However, the 'by the way, this really critical system, that you're really getting worked up about. Has anyone ever mentioned that it's not been backed up. At All' was a start.
And then there was the "Yes, you _do_ Unix support for UK. One person. Oh, and he's in Iceland, so nothing doing 'till he gets back". The to-do list has gone from moderately long, to absolutely nuts. And it's getting longer. That said, prioritisation of the 'interesting stuff' means it's not _all_ bad.
And then there is not one, nor two, but 3 servers throwing hardware faults. 2 'disk failures' and one CPU glitch, triggering system panic. Both disk failures, of course, not being the graceful 'disk a has failed, you may want to fix that at some point', but the 'splat, boom!' kind.
One, because they guy who set it up didn't finish mirroring the root disk. (Set everything up for it, but didn't actually set up the mirroring). And the other because whilst they guy who did set it up mirrored the root disk, they didn't bother mirroring the swap volume.
The latter also decided it one submirror was 'gone' (because the disk popped) but the other was out of sync. And so was unusable. This has lead to a wailing, a gnashing of teeth, and some hardcore bodging to get workable. Not least of which because I've been talking a guy in knutsford through the necessary commands to at least get the blasted thing up and running.
However, the 'directorial kicking' has triggered some motion from various 'inactive' members of the necessary departments. My backup failure list dropped dramatically following a bit of 'network optimization'. (Yes, our network _is_ that stuffed). This is improving, and now my failure list is down to 'a few things that we might not be using any more'. Which at least, is a relief.
Oh, and then there was last night. I shall not say much, aside from the fact that it involved an ambulance ride to A&E. (No, I didn't injure myself, but I did tag along for the ride.). A&E was busy. This led to a slightly stressful evening, with a useful dose of 'bored waiting' mixed in.
Made it to the Gym at the weekend, for the first time in ... well a bit too long really. Only to find I've somehow managed to lose my shorts. However, my swimming gear remains intacts, so a bimble around the pool was on the cards.
So all in all, lookin' good for the weekend.
And it's only Tuesday.
Not _all_ bad, just ... hectic.
Monday has had directors butt kicking, because someone finally demolished their little sandcastle of 'everything's perfick in IT land'. How they managed to miss it entirely over the last 12 months remains a source of mystery. However, the 'by the way, this really critical system, that you're really getting worked up about. Has anyone ever mentioned that it's not been backed up. At All' was a start.
And then there was the "Yes, you _do_ Unix support for UK. One person. Oh, and he's in Iceland, so nothing doing 'till he gets back". The to-do list has gone from moderately long, to absolutely nuts. And it's getting longer. That said, prioritisation of the 'interesting stuff' means it's not _all_ bad.
And then there is not one, nor two, but 3 servers throwing hardware faults. 2 'disk failures' and one CPU glitch, triggering system panic. Both disk failures, of course, not being the graceful 'disk a has failed, you may want to fix that at some point', but the 'splat, boom!' kind.
One, because they guy who set it up didn't finish mirroring the root disk. (Set everything up for it, but didn't actually set up the mirroring). And the other because whilst they guy who did set it up mirrored the root disk, they didn't bother mirroring the swap volume.
The latter also decided it one submirror was 'gone' (because the disk popped) but the other was out of sync. And so was unusable. This has lead to a wailing, a gnashing of teeth, and some hardcore bodging to get workable. Not least of which because I've been talking a guy in knutsford through the necessary commands to at least get the blasted thing up and running.
However, the 'directorial kicking' has triggered some motion from various 'inactive' members of the necessary departments. My backup failure list dropped dramatically following a bit of 'network optimization'. (Yes, our network _is_ that stuffed). This is improving, and now my failure list is down to 'a few things that we might not be using any more'. Which at least, is a relief.
Oh, and then there was last night. I shall not say much, aside from the fact that it involved an ambulance ride to A&E. (No, I didn't injure myself, but I did tag along for the ride.). A&E was busy. This led to a slightly stressful evening, with a useful dose of 'bored waiting' mixed in.
Made it to the Gym at the weekend, for the first time in ... well a bit too long really. Only to find I've somehow managed to lose my shorts. However, my swimming gear remains intacts, so a bimble around the pool was on the cards.
So all in all, lookin' good for the weekend.
And it's only Tuesday.
