<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META http-equiv="Content-Type" content="text/html; charset=iso-8859-2">
<META name="GENERATOR" content="onet.poczta">
<STYLE TYPE="text/css"><!--P {margin:0px}--></STYLE>
</HEAD><BODY>Hi!<br>We have some problems with glusterfs. Configuration: 2x clients and 2x servers. On both clients we run this loop: <br><br>#!/bin/bash<br><br><br>for ((i = 0; i < 100000000; i++)) {<br><br> KAT=$RANDOM<br> mkdir /mnt/glusterfs/$KAT<br> for ((j=0; j< $RANDOM; j++)) {<br> PLIK=$RANDOM.$RANDOM<br> echo "PLIK: $KAT/$PLIK "<br> dd if=/dev/urandom of=/mnt/glusterfs/$KAT/$PLIK bs=$RANDOM count=1<br> dd if=/mnt/glusterfs/$KAT/$PLIK of=/dev/null<br> rm -f /mnt/glusterfs/$KAT/$PLIK<br> }<br> rm -rf /mnt/glusterfs/$KAT<br>}<br><br>Both servers are running, and everything looks ok. When I stoped one server lopp are going and everything looks ok. When, afftr 1-2 minutes I started this stopped earlier server, on one or both clients dd can't write/read file: <br><br>PLIK: 32586/21510.20986<br>dd: opening `/mnt/glusterfs/32586/21510.20986': No such file or directory<br>dd: opening `/mnt/glusterfs/32586/21510.20986': No such file or directory<br>PLIK: 32586/8965.12208<br>dd: opening `/mnt/glusterfs/32586/8965.12208': No such file or directory<br>dd: opening `/mnt/glusterfs/32586/8965.12208': No such file or directory<br>PLIK: 32586/6812.30905<br>dd: opening `/mnt/glusterfs/32586/6812.30905': No such file or directory<br>dd: opening `/mnt/glusterfs/32586/6812.30905': No such file or directory<br>PLIK: 86/14676.13776<br>1+0 records in<br>1+0 records out<br>20064 bytes (20 kB) copied, 0.00489 seconds, 4.1 MB/s<br>39+1 records in<br>39+1 records out<br>20064 bytes (20 kB) copied, 0.002158 seconds, 9.3 MB/s<br>PLIK: 86/4774.7934<br>1+0 records in<br>1+0 records out<br>14855 bytes (15 kB) copied, 0.004141 seconds, 3.6 MB/s<br>29+1 records in<br>29+1 records out<br>14855 bytes (15 kB) copied, 0.001101 seconds, 13.5 MB/s<br>PLIK: 86/20883.24292<br>1+0 records in<br>1+0 records out<br>9717 bytes (9.7 kB) copied, 0.002439 seconds, 4.0 MB/s<br>18+1 records in<br>18+1 records out<br>9717 bytes (9.7 kB) copied, 0.0007 seconds, 13.9 MB/s<br>PLIK: 86/13210.19257<br>1+0 records in<br>1+0 records out<br>31787 bytes (32 kB) copied, 0.007434 seconds, 4.3 MB/s<br>62+1 records in<br>62+1 records out<br><br><br>Afetr few secunds everything its fine. We think that glusterfs, when secund server connecting after shutdown, transfers I/O to this newly connected server and generates errors. How to fix it ?<br><br><br>client:<br><br>volume client1<br> type protocol/client<br> option transport-type tcp/client<br> option remote-host 10.1.100.130<br> option remote-port 6996<br> option remote-subvolume posix1<br>end-volume<br><br>volume client2<br> type protocol/client<br> option transport-type tcp/client<br> option remote-host 10.1.100.131<br> option remote-port 6996<br> option remote-subvolume posix2<br>end-volume<br><br>volume afr<br> type cluster/afr<br> subvolumes client1 client2<br>end-volume<br><br>volume rh<br> type performance/read-ahead<br> option page-size 100KB<br> option page-count 3<br> subvolumes afr<br>end-volume<br><br>volume wh<br> type performance/write-behind<br> option aggregate-size 1MB<br> option flush-behind on<br> subvolumes rh<br>end-volume<br><br><br>server:<br><br>volume posix2<br> type storage/posix<br> option directory /var/storage/glusterfs<br>end-volume<br><br>volume posix-locks<br> type features/posix-locks<br> option mandatory on<br> subvolumes posix2<br>end-volume<br><br>volume io-thr<br> type performance/io-threads<br> option thread-count 2<br> option cache-size 64MB<br> subvolumes posix-locks<br>end-volume<br><br>volume server<br> type protocol/server<br> option transport-type tcp/server<br> option listen-port 6996<br> subvolumes io-thr<br> option auth.ip.posix2.allow 10.*.*.*<br>end-volume<br><br><br><br>version:<br>glusterfs 1.3.12 built on Dec 11 2008 13:41:06<br>Repository revision: glusterfs--mainline--2.5--patch-797<br>Copyright (c) 2006, 2007, 2008 Z RESEARCH Inc. <http://www.zresearch.com><br>GlusterFS comes with ABSOLUTELY NO WARRANTY.<br>You may redistribute copies of GlusterFS under the terms of the GNU General Public License.<br><br></BODY></HTML>