RamSan 500 Pictures / Failure

We had two DRAM cache modules fail in our RamSan 500 recently.  The actual error was:

Uncorrected ECC event detected on boards 4,6

The DRAM cache fronts the Flash storage drives in the unit.  Basically, loosing these two boards took down the unit completely.  To get the unit back up, boards 4 and 6 needed to be removed.  RamSan actually had me remove 4 of the boards instead of just the two that were bad.  Guessing it has something to do with not being able to have slots not filled between active modules.  
Doing so took the DRAM cache from 64 gigs down to 32.  All data was lost on the FLASH RAID array, making us have to restore the Oracle database from backup.  After the cards were removed, a low level format of the RAID array was done, the unit was operational again.   Below are pictures from within the RamSan 500 for all the storage people out there.

Best part of this is we had racked two RamSan 630’s that were being configured as a mirrored pair.  The plan was to implement them in two weeks.  When the 500 failed, they were implemented that night.

~ by Kevin Goodman on March 7, 2011.

3 Responses to “RamSan 500 Pictures / Failure”

  1. Any idea on the root cause of failure? The data loss is concerning.

  2. Too bad there are no storage vendors that leverage flash drives in their arrays. Maybe one day

  3. Of course EMC has EFD support in their CX series arrays, but could come nowhere close to the 250,000 IOPS range of the RamSan devices (within reasonable price range). Now that the VNX series are out, we definitely will be investigating their offering more since bus speed has been improved.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s


Get every new post delivered to your Inbox.

Join 1,374 other followers

%d bloggers like this: