<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>The Storage Architect &#187; data integrity</title>
	<atom:link href="http://www.thestoragearchitect.com/tag/data-integrity/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.thestoragearchitect.com</link>
	<description>Storage and Virtualisation</description>
	<lastBuildDate>Mon, 06 Sep 2010 09:00:22 +0000</lastBuildDate>
	<generator>http://wordpress.org/?v=2.8.6</generator>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
			<item>
		<title>PSSST&#8230;.Green Storage</title>
		<link>http://www.thestoragearchitect.com/2007/09/24/pssstgreen-storage/</link>
		<comments>http://www.thestoragearchitect.com/2007/09/24/pssstgreen-storage/#comments</comments>
		<pubDate>Mon, 24 Sep 2007 20:00:00 +0000</pubDate>
		<dc:creator>Chris Evans</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[AMS]]></category>
		<category><![CDATA[data integrity]]></category>
		<category><![CDATA[green]]></category>
		<category><![CDATA[HDS]]></category>
		<category><![CDATA[performance]]></category>
		<category><![CDATA[WMS]]></category>

		<guid isPermaLink="false">http://thestoragearchitect.wordpress.com/2007/09/24/pssstgreen-storage/</guid>
		<description><![CDATA[
			
				
			
		
HDS announced today a few amendments to the AMS/WMS range.  The most interesting is the apparent ability to power down drives which are not in use a-la-Copan. 
According to the press release above, the drives can be powered down by the user as necessary, which presents some interesting questions.  Firstly, I guess this [...]]]></description>
			<content:encoded><![CDATA[<div class="tweetmeme_button" style="float: right; margin-left: 10px;">
			<a href="http://api.tweetmeme.com/share?url=http%3A%2F%2Fwww.thestoragearchitect.com%2F2007%2F09%2F24%2Fpssstgreen-storage%2F" onclick="pageTracker._trackPageview('/outgoing/api.tweetmeme.com/share?url=http_3A_2F_2Fwww.thestoragearchitect.com_2F2007_2F09_2F24_2Fpssstgreen-storage_2F&amp;referer=');"><br />
				<img src="http://api.tweetmeme.com/imagebutton.gif?url=http%3A%2F%2Fwww.thestoragearchitect.com%2F2007%2F09%2F24%2Fpssstgreen-storage%2F&amp;style=normal" height="61" width="50" /><br />
			</a>
		</div>
<p>HDS <a href="http://www.hds.com/corporate/press-analyst-center/press-releases/2007/gl070924a.html" onclick="pageTracker._trackPageview('/outgoing/www.hds.com/corporate/press-analyst-center/press-releases/2007/gl070924a.html?referer=');">announced</a> today a few amendments to the AMS/WMS range.  The most interesting is the apparent ability to power down drives which are not in use a-la-Copan. </p>
<p>According to the press release above, the drives can be powered down by the user as necessary, which presents some interesting questions.  Firstly, I guess this is going to be handled through a command device (which presumably is not powered down!) which will allow a specific RAID group to be chosen.  Imagine choosing to power down a RAID group someone else is using!  Presumably all RAID types can be supported with the power down mode.</p>
<p>One of the cardinal rules about hardware I learned years ago was never to power it off unless absolutely necessary; the power down/up sequence produces power fluctuations which can kill equipment.  I&#8217;m always nervous about powering down hard drives.  I&#8217;ve seen the Copan blurb on all the additional features they have in their product which ensures the minimum risk of drive loss.  I&#8217;d like to see what HDS are adding to AMS/WMS to ensure power down doesn&#8217;t cause data loss.</p>
<p>Finally, what happens on the host when an I/O request is issued for a powered down drive?  Is the I/O simply failed?  It would be good to see this explained as I would like to see how consistency is handled, especially in a RAID configuration.</p>
<p>However, any step forward which makes equipment run cooler is always good.</p>
<p>The announcement also indicated that 750GB SATA drives will be supported.  More capacity, less cooling&#8230;.
<div class="blogger-post-footer">
<p>_uacct = &#8220;UA-1104321-2&#8243;;<br />
urchinTracker();
</p></div>
<a class="google_buzz"  
href="http://www.google.com/reader/link?url=http://www.thestoragearchitect.com/2007/09/24/pssstgreen-storage/&title=PSSST&#8230;.Green+Storage&srcURL=http://www.thestoragearchitect.com" target="_blank" rel="nofollow" onclick="pageTracker._trackPageview('/outgoing/www.google.com/reader/link?url=http_//www.thestoragearchitect.com/2007/09/24/pssstgreen-storage/_title=PSSST_8230_.Green+Storage_srcURL=http_//www.thestoragearchitect.com&amp;referer=');"><img
src="http://www.thestoragearchitect.com/wp-content/plugins/google-buzz-button-for-wordpress/images/google-buzz.png" alt="Google Buzz" /></a>]]></content:encoded>
			<wfw:commentRss>http://www.thestoragearchitect.com/2007/09/24/pssstgreen-storage/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Virtualisation Update</title>
		<link>http://www.thestoragearchitect.com/2007/09/07/virtualisation-update/</link>
		<comments>http://www.thestoragearchitect.com/2007/09/07/virtualisation-update/#comments</comments>
		<pubDate>Fri, 07 Sep 2007 19:31:00 +0000</pubDate>
		<dc:creator>Chris Evans</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[consistency]]></category>
		<category><![CDATA[data integrity]]></category>
		<category><![CDATA[svc]]></category>
		<category><![CDATA[usp]]></category>
		<category><![CDATA[Virtualisation]]></category>

		<guid isPermaLink="false">http://thestoragearchitect.wordpress.com/2007/09/07/virtualisation-update/</guid>
		<description><![CDATA[
			
				
			
		
Thanks to everyone who commented on the previous post relating to using virtualisation for DR.  I&#8217;m looking forward to Barry&#8217;s more contemporaneous explanation of the way SVC works.
I guess I should have said I understand Invista is stateless &#8211; but I didn&#8217;t &#8211; so thank&#8217;s to &#8216;zilla for pointing it out. 
So here&#8217;s another [...]]]></description>
			<content:encoded><![CDATA[<div class="tweetmeme_button" style="float: right; margin-left: 10px;">
			<a href="http://api.tweetmeme.com/share?url=http%3A%2F%2Fwww.thestoragearchitect.com%2F2007%2F09%2F07%2Fvirtualisation-update%2F" onclick="pageTracker._trackPageview('/outgoing/api.tweetmeme.com/share?url=http_3A_2F_2Fwww.thestoragearchitect.com_2F2007_2F09_2F07_2Fvirtualisation-update_2F&amp;referer=');"><br />
				<img src="http://api.tweetmeme.com/imagebutton.gif?url=http%3A%2F%2Fwww.thestoragearchitect.com%2F2007%2F09%2F07%2Fvirtualisation-update%2F&amp;style=normal" height="61" width="50" /><br />
			</a>
		</div>
<p>Thanks to everyone who commented on the <a href="http://storagearchitect.blogspot.com/2007/09/using-virtualisation-for-dr.html" onclick="pageTracker._trackPageview('/outgoing/storagearchitect.blogspot.com/2007/09/using-virtualisation-for-dr.html?referer=');">previous post</a> relating to using virtualisation for DR.  I&#8217;m looking forward to Barry&#8217;s more contemporaneous explanation of the way SVC works.</p>
<p>I guess I should have said I understand Invista is stateless &#8211; but I didn&#8217;t &#8211; so thank&#8217;s to &#8216;zilla for pointing it out. </p>
<p>So here&#8217;s another issue.  If SVC and USP cache the data (which I knew they did) then what happens if the virtualisation appliance fails?  I&#8217;m not just thinking about a total failure but a partial failure or another issue which compromises the data in cache?</p>
<p>I was always worried that a problem with a USP virtualising solution was understanding what would happen if a failure occurred in the data path.  Where is the data?  What is the consistency position? A datacentre power down could be a good example.  What is the data status as the equipment is powered back up?
<div class="blogger-post-footer">
<p>_uacct = &#8220;UA-1104321-2&#8243;;<br />
urchinTracker();
</p></div>
<a class="google_buzz"  
href="http://www.google.com/reader/link?url=http://www.thestoragearchitect.com/2007/09/07/virtualisation-update/&title=Virtualisation+Update&srcURL=http://www.thestoragearchitect.com" target="_blank" rel="nofollow" onclick="pageTracker._trackPageview('/outgoing/www.google.com/reader/link?url=http_//www.thestoragearchitect.com/2007/09/07/virtualisation-update/_title=Virtualisation+Update_srcURL=http_//www.thestoragearchitect.com&amp;referer=');"><img
src="http://www.thestoragearchitect.com/wp-content/plugins/google-buzz-button-for-wordpress/images/google-buzz.png" alt="Google Buzz" /></a>]]></content:encoded>
			<wfw:commentRss>http://www.thestoragearchitect.com/2007/09/07/virtualisation-update/feed/</wfw:commentRss>
		<slash:comments>6</slash:comments>
		</item>
		<item>
		<title>Using Virtualisation for DR</title>
		<link>http://www.thestoragearchitect.com/2007/09/07/using-virtualisation-for-dr/</link>
		<comments>http://www.thestoragearchitect.com/2007/09/07/using-virtualisation-for-dr/#comments</comments>
		<pubDate>Fri, 07 Sep 2007 05:47:00 +0000</pubDate>
		<dc:creator>Chris Evans</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[data integrity]]></category>
		<category><![CDATA[Invista]]></category>
		<category><![CDATA[svc]]></category>
		<category><![CDATA[usp]]></category>
		<category><![CDATA[Virtualisation]]></category>

		<guid isPermaLink="false">http://thestoragearchitect.wordpress.com/2007/09/07/using-virtualisation-for-dr/</guid>
		<description><![CDATA[
			
				
			
		

It&#8217;s good to see virtualisation and the various products being discussed again at length. Here&#8217;s an idea I had some time ago for implementing remote replication by using virtualisation. I&#8217;d be interested to know whether it is possible (so far no-one from HDS can answer the question on whether USP/UVM can do this, but read [...]]]></description>
			<content:encoded><![CDATA[<div class="tweetmeme_button" style="float: right; margin-left: 10px;">
			<a href="http://api.tweetmeme.com/share?url=http%3A%2F%2Fwww.thestoragearchitect.com%2F2007%2F09%2F07%2Fusing-virtualisation-for-dr%2F" onclick="pageTracker._trackPageview('/outgoing/api.tweetmeme.com/share?url=http_3A_2F_2Fwww.thestoragearchitect.com_2F2007_2F09_2F07_2Fusing-virtualisation-for-dr_2F&amp;referer=');"><br />
				<img src="http://api.tweetmeme.com/imagebutton.gif?url=http%3A%2F%2Fwww.thestoragearchitect.com%2F2007%2F09%2F07%2Fusing-virtualisation-for-dr%2F&amp;style=normal" height="61" width="50" /><br />
			</a>
		</div>
<p><a href="http://2.bp.blogspot.com/_b1B7GuxiR0o/RuDiW-FcbcI/AAAAAAAAACA/xxvAaoTG_u8/s1600-h/3DC-1.jpg" onclick="pageTracker._trackPageview('/outgoing/2.bp.blogspot.com/_b1B7GuxiR0o/RuDiW-FcbcI/AAAAAAAAACA/xxvAaoTG_u8/s1600-h/3DC-1.jpg?referer=');"><img style="float:right;cursor:hand;margin:0 0 10px 10px;" alt="" src="http://2.bp.blogspot.com/_b1B7GuxiR0o/RuDiW-FcbcI/AAAAAAAAACA/xxvAaoTG_u8/s320/3DC-1.jpg" border="0" /></a></p>
<p>It&#8217;s good to see virtualisation and the various products being discussed again at length. Here&#8217;s an idea I had some time ago for implementing remote replication by using virtualisation. I&#8217;d be interested to know whether it is possible (so far no-one from HDS can answer the question on whether USP/UVM can do this, but read on).</p>
<p>The virtualisation products make a virtue out of allowing heterogenous environments to be presented as a unified storage infrastructure. This even means carving LUNs/LDEVs presented from an array into consituent parts to make logical virtual volumes at the virtualisation level. Whilst this can be done, it isn&#8217;t a requirement and in fact HDS sell the USP virtualisation on the basis that you can virtualise an existing array through the USP without destroying the data, then use the USP to move the data to another physical LUN. Presumably the 1:1 mapping can be achieved on Invista and SVC (I see no reason why this wouldn&#8217;t be the case). Now, as the virtualisation layer simply acts as a host (in USP&#8217;s case a Windows one &#8211; not sure what the others emulate) then it is possible (but not usually desirable) to present storage which is being virtualised to both the virtual device and a local host, by using multiple paths from the external array.</p>
<p>If the virtualisation engine is placed in one site and the external storage in another, then the external storage could be configured to be accessed in the remote site by a DR server. See example 1.</p>
<p>Obviously this doesn&#8217;t gain much over a standard solution using TC/SRDF other than perhaps the ability to asynchronously write to the remote storage, making use of the cache in the virtualisation engine to provide good response times. So, the second picture shows using a USP as an example, a 3 datacentre configuration where there are two local USP&#8217;s providing replication between each other but the secondary LUNs in the &#8220;local DR site&#8221; are actually located on external storage in a remote datacentre. This configuration gives failover between the local site pair and also access to a third copy of data in a remote site (although technically, the third copy doesn&#8217;t actually exist). </p>
<p>
</p>
<p>
<p>Why do this? Well, if you have two closely sited locations with existing USPs where you want to retain synchronous replication and don&#8217;t want to pay for a 3rd copy of data then you get a poor man&#8217;s 3DC solution without paying for that third data copy.</p>
<p>Clearly there are some drawbacks; you are dependent on com<a href="http://1.bp.blogspot.com/_b1B7GuxiR0o/RuDkYuFcbdI/AAAAAAAAACI/hJjeHOzeGDM/s1600-h/3DC-2.jpg" onclick="pageTracker._trackPageview('/outgoing/1.bp.blogspot.com/_b1B7GuxiR0o/RuDkYuFcbdI/AAAAAAAAACI/hJjeHOzeGDM/s1600-h/3DC-2.jpg?referer=');"><img style="float:right;cursor:hand;margin:0 0 10px 10px;" alt="" src="http://1.bp.blogspot.com/_b1B7GuxiR0o/RuDkYuFcbdI/AAAAAAAAACI/hJjeHOzeGDM/s320/3DC-2.jpg" border="0" /></a>ms links to access the secondary copy of data and in a DR scenario performance may be poor. In addition, as the DR USP has to cache writes, it may not be able to destage them to the external storage in a timely fashion to prevent cache overrun due to the latency on writing to the remote external copy.</p>
<p>I think there&#8217;s one technical question which determines whether this solution is technically feasible and that is; how do virtualisation devices destage cached I/O to their external disks? There are two options I see; firstly they destage using an algorithm which minimises the amount of disk activity or they destage in order to ensure integrity of data on the external disk in case of a failure of the virtualisation hardware itself. I would hope the answer would be the latter rather than the former here, as if the virtualisation engine suffered some kind of hardware failure, I would want the data on disk to still have write order integrity. If this is the case then my designs presented here should mean that the remote copy of data would still be valid in case of loss of both local sites, albeit as an async copy slightly out of date.</p>
<p>Can IBM/HDS/EMC answer the question of integrity?</p>
<div class="blogger-post-footer">
<p>_uacct = &#8220;UA-1104321-2&#8243;;<br />
urchinTracker();
</p></div>
<a class="google_buzz"  
href="http://www.google.com/reader/link?url=http://www.thestoragearchitect.com/2007/09/07/using-virtualisation-for-dr/&title=Using+Virtualisation+for+DR&srcURL=http://www.thestoragearchitect.com" target="_blank" rel="nofollow" onclick="pageTracker._trackPageview('/outgoing/www.google.com/reader/link?url=http_//www.thestoragearchitect.com/2007/09/07/using-virtualisation-for-dr/_title=Using+Virtualisation+for+DR_srcURL=http_//www.thestoragearchitect.com&amp;referer=');"><img
src="http://www.thestoragearchitect.com/wp-content/plugins/google-buzz-button-for-wordpress/images/google-buzz.png" alt="Google Buzz" /></a>]]></content:encoded>
			<wfw:commentRss>http://www.thestoragearchitect.com/2007/09/07/using-virtualisation-for-dr/feed/</wfw:commentRss>
		<slash:comments>5</slash:comments>
		</item>
	</channel>
</rss>
