Debate, and discuss, just dont Bore me.
Published on June 20, 2006 By Dr Guy In Personal Computing

I have been working with company X to try to recover a NAS for the last week.  A little background might help to understand the circus I work in.

First, there is no backup for this NAS.  Both the owner (I am just support) and my Boss decided that was too expensive (for those who have read me, my boss is a pissant that likes to piss off people and if he is mad at you, will give you bad advice).  Second, ignoring my pleas to get this NAS on a UPS, the Owner hemmed and hawed and has not done so.  Third, this NAS is in a location with very dirty power.  The NAS has gone down several times in the past. (It is a testament to the Company X that it had gone down umpteen times and come back up, unscathed, umpteen minus 1).

So now you have the scenario.  Yes, it went down again, and this time would not come back.  No matter what we tried.  BSOD here, BSOD there, BSOD everywhere (including the recovery volume).  So I pulled it back to HQ and started working on it.  And I could not recover any data.  BSOD.  So I started the re-install.  But - Register dump (old timers, remember them?  What would you blame it on?).

But Tech from Company X first replaced one drive, then replaced half the internals.  Then replaced the other half - including......Dut-ta-da-da! - The CPU!  And Shazaam!  The register dumps went away.

But alas the data was not there.  before we had started on the path of reinstall, one volume was saying it was corrupted, and one volume said "unformatted".  Not good.  So we re-install on one drive (the new one) and when done, we put the other drives back in.  Alas, that one failed attempt at restoring it (before the CPU was replaced) had left all the drive info (and the raid info - did I mention it was a software RAID? - Stay away!) gone.  But through a program we were able to restore the partitioning information and Shazaam!  We got all the data off one of the volumes! Except one file (it was a form fortunately).

But the other one was still 'unformatted'.  So they tried some more.  And succeeded in basically wiping out all the previous work and leaving these drives as bare as a newborn's bottom.

So I say "if we restore the partitions exactly as they were before, and then dry a drive scan program to undelete the files, you think that would work?".  NOPE!

So after bidding them good bye as they had accomplished their task, I decided to give it a try.  So I Made a striped volume (instead of a RAID 5 one) out of the part of the drives that we had not been able to recover, did a quick format (the only thing that does is wipe out the root file information), and then ran the program.

Guess what!  It found every stinking file!  Took a couple of hours, but it found every one!  I was able to recover all 2 that were on that volume (the users did not even know what was there!), and then wiped it and recreated the Raid 5 volume.

So the Moral of the story is, when they tell you no, don't believe them.  Sometimes we know more than they do.  At least us old timers that have used Gibson before.

Sometimes the tech does not know every thing.  But I did learn a lot of secrets this time around!  And will let the tech know that I did what I suggested and it worked!

(But I knew it would after it was 10% done and found files from August 2004 - when the NAS was into service!).


Comments
on Jun 20, 2006
I always hated group troubleshooting. I much prefer to just be left alone to sort out the problems. The old adage "Two heads are better than one" was coined long before the need to troubleshoot electronic systems.
on Jun 20, 2006

I always hated group troubleshooting. I much prefer to just be left alone to sort out the problems. The old adage "Two heads are better than one" was coined long before the need to troubleshoot electronic systems.

Oh, I freely admit I learned a lot.  But this guy was kibitzing with a senior to him, and apparently that guy left after we did what we could to recover the volumes.  I remember Shadow's article about the thumb drive and figured if we had not scrubbed it (the guy said a Software Raid did scrub, but it mounts it too fast for that), that the data was still there.  I was right.

That is why I did not argue with him and just did it on my own.  A lot of time for basically nothing, but at least I can say we did not lose any critical data.

on Jun 20, 2006
Congrats on getting things back, excellent work.

Funny that I was recently in a heated discussion with some acquaintances over on another site and they kept telling me that one wipe was plenty to permanently lose data. That devolved into discussion about defining one wipe (I was pretty sure I must have been arguing with a liberal.... they're always trying to redefine things).

I started to take up the idiot challenge to send a drive to him, have him create and wipe, but I knew I couldn't count on him just deleting the file and formatting the disc... Way too easy to cheat and actually use a program designed to really wipe data. Also didn't like that it was all on my dime.


I've definitely seen several programs that will successfully recover files like you did, and people that think otherwise are putting themselves in serious danger if they let drives that aren't wiped get out of their hands.


Hopefully the powers that be for you will smarten up and start working with real backups and follow some of your recommendations. I've been fighting similar issues at work with people that would want to kill me if I let their data get wiped out even though I've given them grief about WHERE IS MY TAPE LIBRARY for doing backups on!??!
on Jun 21, 2006

I've definitely seen several programs that will successfully recover files like you did, and people that think otherwise are putting themselves in serious danger if they let drives that aren't wiped get out of their hands.

Even when Gibson (the best there is on the market) wont work, there is always On-Track.  We had a Server drive failure (it was netware) back in 88.  They were able to recover 95% of the data from a burned out (but not bombed out. ) drive!  So I dont tell users the data is gone, I just tell them how expensive it will be to recover it.

on Jun 22, 2006
No they don't always know BEST...nor do they know everything. Back in the infancy days of my computing, I took my machine in to get another hard drive installed....and even back then I knew this guy was wrong when he said that my Desktop Architect themes wouldn't work on a new drive/OS. Like any other data, they could have been backed up elsewhere and copied over, or better still, to have been 'ghosted' with my whole OS/programs/files and copied to the new drive. This techie argued black and blue that I'd have to rewrite the whole drive and reinstall all my programs and themes, etc...so in the end I just took the new drive with me, installed it myself and ghosted over everything without issue. Me thinks, however, his argument had more to do with collecting $70 in labour costs, for the least expended effort. Yep, you sure gotta watch 'em!
on Jun 22, 2006
Me thinks, however, his argument had more to do with collecting $70 in labour costs, for the least expended effort. Yep, you sure gotta watch 'em!
Methinks you are right! The sad part about your episode (mine just plain did not know, and was not trying to con me) is that he lost a customer over a few bucks.