<html><head><style type='text/css'>p { margin: 0; }</style></head><body><div style='font-family: Times New Roman; font-size: 12pt; color: #000000'>I understand that some of it may be a simple bug, but should it hang _all_ the pools? That's what happens when the third drive is removed...<br><br>roy<br><br><hr id="zwchr"><blockquote style="border-left: 2px solid rgb(16, 16, 255); margin-left: 5px; padding-left: 5px;">This looks like a pretty simple bug. The issue is that the state of the SPARE vdev is being reported as REMOVED instead of DEGRADED. If it were the latter (as it should be), then everything would work just fine. Please file a bug at <a href="http://bugs.illumos.org" target="_blank">bugs.illumos.org</a>.<div>
<br></div><div>On a side note, this continues to expose the overly simplistic vdev state model used by ZFS (one which I can take a bulk of the responsibility for). Back before the days of ditto blocks and SPA3.0, it was sufficient to model state as a fairly binary proposition. But this now has ramifications that don't necessarily make sense. For example, one may be able open a pool even if a toplevel vdev is faulted. And even when a spare has finished resilvering, it's left in the DEGRADED state, which has implications for allocation policies (though I remember discussions around changing this). But the pool state is derived directly from the toplevel vdev state, so if you switch spares to be ONLINE, then 'zpool status' would think your pool is perfectly healthy. In this case it's true from a data protection standpoint, but not necessarily from a "all is well in the world" standpoint, as you are down one spare, and that spare may not have the same RAS properties as other devices in your RAID-Z stripe (it may put 3 disks on the same controller in one stripe, for example).</div>
<div><br></div><div>- Eric<br><br><div class="gmail_quote">On Fri, Mar 4, 2011 at 7:06 AM, Roy Sigurd Karlsbakk <span dir="ltr"><<a href="mailto:roy@karlsbakk.net" target="_blank">roy@karlsbakk.net</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
Hi all<br>
<br>
I just did a small test on RAIDz2 to check whether my suspicion was right about ZFS not treating spares as replicas/copies of drives, and I think I've found it true. The short story: If two spares replaces two drives in raidz2, losing a third drive, even with the spares active, makes the pool unavailable. See full report on<br>
<br>
ODT: <a href="http://karlsbakk.net/ZFS/ZFS%20Spare%20disk%20usage.odt" target="_blank">http://karlsbakk.net/ZFS/ZFS%20Spare%20disk%20usage.odt</a><br>
PDF: <a href="http://karlsbakk.net/ZFS/ZFS%20Spare%20disk%20usage.pdf" target="_blank">http://karlsbakk.net/ZFS/ZFS%20Spare%20disk%20usage.pdf</a><br>
<br>
Vennlige hilsener / Best regards<br>
<br>
roy<br>
--<br>
Roy Sigurd Karlsbakk<br>
<a href="tel:%28%2B47%29%2097542685" target="_blank">(+47) 97542685</a><br>
<a href="mailto:roy@karlsbakk.net" target="_blank">roy@karlsbakk.net</a><br>
<a href="http://blogg.karlsbakk.net/" target="_blank">http://blogg.karlsbakk.net/</a><br>
<font color="#888888">--<br>
I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk.<br>
<br>
_______________________________________________<br>
Developer mailing list<br>
<a href="mailto:Developer@lists.illumos.org" target="_blank">Developer@lists.illumos.org</a><br>
<a href="http://lists.illumos.org/m/listinfo/developer" target="_blank">http://lists.illumos.org/m/listinfo/developer</a><br>
</font></blockquote></div><br><br clear="all"><br>-- <br><div>Eric Schrock</div><div>Delphix</div><div><br></div><div><span style="font-family: arial,sans-serif; font-size: 13px; border-collapse: collapse;"><span style="font-family: arial,sans-serif; border-collapse: collapse;">275 Middlefield Road, Suite 50<br>
Menlo Park, CA 94025</span><br><a href="http://www.delphix.com/" style="color: rgb(29, 30, 206);" target="_blank">http://www.delphix.com</a></span></div><br>
</div>
</blockquote><br><span><br><br>-- <br><span name="x"></span>Vennlige hilsener / Best regards<br><br>roy<br>--<br>Roy Sigurd Karlsbakk<br>(+47) 97542685<br>roy@karlsbakk.net<br>http://blogg.karlsbakk.net/<br>--<br>I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk.<span name="x"></span><br></span></div></body></html>