Further information- I can't find any rhyme or reason as to why some files have this problems and others don't. It's not every file on dht or every file on stripe.... I don't think I've found any broken files on stripe, everything that's broken is on dht, but not every dht file is broken.<div>
<br></div><div>Please advise.<br clear="all"><br>Dan<br>
<br><br><div class="gmail_quote">On Wed, Feb 25, 2009 at 1:47 PM, Dan Parsons <span dir="ltr"><<a href="mailto:dparsons@nyip.net">dparsons@nyip.net</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
Upon further examination, it looks like maybe unify is expecting that .pni file to be handled by stripe, as according to the error message, it's expecting to find the file on more than 1 server. It's supposed to be handled by dht though, and I've verified that this file exists on just one server, like it should.<div>
<br></div><div>Did the syntax for specifying file extensions to 'option scheduler switch' change between rc1 and rc2?<br clear="all"><font color="#888888"><br>Dan</font><div><div></div><div class="Wj3C7c"><br>
<br><br><div class="gmail_quote">On Wed, Feb 25, 2009 at 1:44 PM, Dan Parsons <span dir="ltr"><<a href="mailto:dparsons@nyip.net" target="_blank">dparsons@nyip.net</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
After upgrading to rc2, I'm getting unify errors for a lot of files. If I try to read one of these files, I get an I/O error. Here are the corresponding lines from gluster log:<div><br></div><div><div>2009-02-25 13:42:49 E [unify.c:1239:unify_open] unify: /bio/db/blast/blastp-nr_v9/blastp-nr.19.pni: entry_count is 1</div>
<div>2009-02-25 13:42:49 E [unify.c:1242:unify_open] unify: /bio/db/blast/blastp-nr_v9/blastp-nr.19.pni: found on unify-switch-ns</div><div>2009-02-25 13:42:49 E [unify.c:1246:unify_open] unify: returning EIO as file found on onlyone node</div>
<div>2009-02-25 13:42:49 E [fuse-bridge.c:667:fuse_fd_cbk] glusterfs-fuse: 4152: OPEN() /bio/db/blast/blastp-nr_v9/blastp-nr.19.pni => -1 (Input/output error)</div><div><br></div><div>No errors on any of the servers, and I've verified that the files DO exist on the server. Here's my client config:</div>
<div><br></div><div><div>volume unify-switch-ns</div><div> type protocol/client</div><div> option transport-type tcp</div><div> option remote-host 10.8.101.51</div><div> option remote-subvolume posix-unify-switch-ns</div>
<div>end-volume</div><div><br></div><div>#volume distfs01-ns-readahead</div><div># type performance/read-ahead</div><div># option page-size 1MB</div><div># option page-count 8</div><div># subvolumes distfs01-ns-brick</div>
<div>#end-volume</div><div><br></div><div>#volume unify-switch-ns</div><div># type performance/write-behind</div><div># option block-size 1MB</div><div># option cache-size 3MB</div><div># subvolumes distfs01-ns-readahead</div>
<div>#end-volume</div><div><br></div><div>volume distfs01-unify</div><div> type protocol/client</div><div> option transport-type tcp</div><div> option remote-host 10.8.101.51</div><div> option remote-subvolume posix-unify</div>
<div>end-volume</div><div><br></div><div>volume distfs02-unify</div><div> type protocol/client</div><div> option transport-type tcp</div><div> option remote-host 10.8.101.52</div><div> option remote-subvolume posix-unify</div>
<div>end-volume</div><div><br></div><div>volume distfs03-unify</div><div> type protocol/client</div><div> option transport-type tcp</div><div> option remote-host 10.8.101.53</div><div> option remote-subvolume posix-unify</div>
<div>end-volume</div><div><br></div><div>volume distfs04-unify</div><div> type protocol/client</div><div> option transport-type tcp</div><div> option remote-host 10.8.101.54</div><div> option remote-subvolume posix-unify</div>
<div>end-volume</div><div><br></div><div>volume distfs01-stripe</div><div> type protocol/client</div><div> option transport-type tcp</div><div> option remote-host 10.8.101.51</div><div> option remote-subvolume posix-stripe</div>
<div>end-volume</div><div><br></div><div>volume distfs02-stripe</div><div> type protocol/client</div><div> option transport-type tcp</div><div> option remote-host 10.8.101.52</div><div> option remote-subvolume posix-stripe</div>
<div>end-volume</div><div><br></div><div>volume distfs03-stripe</div><div> type protocol/client</div><div> option transport-type tcp</div><div> option remote-host 10.8.101.53</div><div> option remote-subvolume posix-stripe</div>
<div>end-volume</div><div><br></div><div>volume distfs04-stripe</div><div> type protocol/client</div><div> option transport-type tcp</div><div> option remote-host 10.8.101.54</div><div> option remote-subvolume posix-stripe</div>
<div>end-volume</div><div><br></div><div>volume stripe0</div><div><span style="white-space:pre">        </span>type cluster/stripe</div><div><span style="white-space:pre">        </span>option block-size *.jar,*.pin:1MB,*:2MB</div>
<div><span style="white-space:pre">        </span>subvolumes distfs01-stripe distfs02-stripe distfs03-stripe distfs04-stripe</div><div>end-volume</div><div><br></div><div>volume dht0</div><div><span style="white-space:pre">        </span>type cluster/dht</div>
<div><span style="white-space:pre">        </span>subvolumes distfs01-unify distfs02-unify distfs03-unify distfs04-unify</div><div>end-volume</div><div><br></div><div>volume unify</div><div><span style="white-space:pre">        </span>type cluster/unify</div>
<div><span style="white-space:pre">        </span>option namespace unify-switch-ns</div><div><span style="white-space:pre">        </span>option self-heal off</div><div><span style="white-space:pre">        </span>option scheduler switch</div>
<div># send *.phr/psq/pnd etc to stripe0, send the rest to hash</div><div># extensions have to be *.foo* and not simply *.foo or rsync's tmp file naming will prevent files from being matched</div><div><span style="white-space:pre">        </span>option scheduler.switch.case *.phr*:stripe0;*.psq*:stripe0;*.pnd*:stripe0;*.psd*:stripe0;*.pin*:stripe0;*.nsi*:stripe0;*.nin*:stripe0;*.nsd*:stripe0;*.nhr*:stripe0;*.nsq*:stripe0;*.tar*:stripe0;*.tar.gz*:stripe0;*.jar*:stripe0;*.img*:stripe0;*.perf*:stripe0;*.tgz*:stripe0;*.fasta*:stripe0;*.huge*:stripe0</div>
<div><span style="white-space:pre">        </span>subvolumes stripe0 dht0</div><div>end-volume</div><div><br></div><div>volume ioc</div><div> type performance/io-cache</div><div> subvolumes unify</div>
<div> option cache-size 3000MB</div><div><span style="white-space:pre">        </span>option cache-timeout 3600</div><div>end-volume</div><div><br></div><div>volume filter</div><div> type features/filter</div>
<div> option fixed-uid 0</div><div> option fixed-gid 900</div><div> subvolumes ioc</div><div>end-volume</div><div><br></div></div><br>Dan<br>
</div>
</blockquote></div><br></div></div></div>
</blockquote></div><br></div>