Glustefs Transport endpoint is not connected

[c_parapat]

Hello,

I try to configure glusterfs with 3 servers on centos platform.
After follow the way on howtoforge, i get some error when i try to looks with "df -h", or "ls".
Here is the output ;
================================================== ================
[root@sys-testbed3 glusterfs]# mount
/dev/mapper/VolGroup00-LogVol00 on / type ext3 (rw)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
/dev/hda1 on /boot type ext3 (rw)
tmpfs on /dev/shm type tmpfs (rw)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
glusterfs#/etc/glusterfs/glusterfs.vol on /mnt/glusterfs type fuse (rw,allow_other,default_permissions,max_read=13107 2)
[root@sys-testbed3 glusterfs]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
8.9G 3.2G 5.3G 38% /
/dev/hda1 99M 34M 61M 36% /boot
tmpfs 189M 0 189M 0% /dev/shm
df: `/mnt/glusterfs': Transport endpoint is not connected
[root@sys-testbed3 glusterfs]# ls /mnt/glusterfs
ls: /mnt/glusterfs: Transport endpoint is not connected
[root@sys-testbed3 glusterfs]# ll /mnt/glusterfs
ls: /mnt/glusterfs: Transport endpoint is not connected
[root@sys-testbed3 glusterfs]# ll /mnt/
total 0
?--------- ? ? ? ? ? glusterfs
[root@sys-testbed3 glusterfs]#
================================================== ================
What it mean from that error ?

I really still not understand how the concept of this gluster work.
I have a plan to building cluster for storage server. The idea is, if the capacity of the current storage cluster system will empty i just add the new server with full storage and so on. So i can get more new capacity after adding a new server on the fly (maybe it could be Like youtube.com storage server). Can I do this with glusterfs ?
Please help me to do this, and correct me if i have something wrong here and sorry for my bad english.

Regards,

Parapat

[c_parapat]

Okay, finally i was succes to make the glusterfs works for me.
After i try the configuration, i still not looks that glusterfs still not able to combine all resources harddrive be one unity storage.
But i still have the questions here. Are the glusterfs can combine all resources harddrive on another server to be one unity ? Is there anybody can help me how to do this ?
Thank you for your response.

[falko]

Originally Posted by c_parapat

Are the glusterfs can combine all resources harddrive on another server to be one unity ?

Yes, you can set up a kind of network RAID1 with GlusterFS, and you can also combine multiple hard drives to one big storage.

[c_parapat]

Hello Falko,

Thanks for your reply. I am glad you reply my question. Falko, can you help me what is it mean about for this log :
"Volume 'bricks', line 49: type 'cluster/unify' is not valid or not found on this machine" ?
When I try to make unify, but the system always show that log.
Let me shared my client configuration here ;

################ glusterfs.vol client configuration #############################

volume client1
type protocol/client
option transport-type tcp
option remote-host 192.168.0.5
option transport.socket.remote-port 6996
option remote-subvolume brick1
end-volume

volume client2
type protocol/client
option transport-type tcp
option remote-host 192.168.0.6
option transport.socket.remote-port 6997
option remote-subvolume brick2
end-volume

volume bricks
type cluster/unify
option namespace client-ns
subvolumes client1 client2

option self-heal background
option scheduler alu
option alu.limits.min-free-disk 5%
option alu.limits.max-open-files 10000
option alu.order disk-usage:read-usage:write-usagepen-files-usage:disk-speed-usage
option alu.disk-usage.entry-threshold 2GB
option alu.disk-usage.exit-threshold 128MB
option alu.open-files-usage.entry-threshold 1024
option alu.open-files-usage.exit-threshold 32
option alu.read-usage.entry-threshold 20
option alu.read-usage.exit-threshold 4
option alu.write-usage.entry-threshold 20
option alu.write-usage.exit-threshold 4
option alu.disk-speed-usage.entry-threshold 0
option alu.disk-speed-usage.exit-threshold 0
option alu.stat-refresh.interval 10sec
option alu.stat-refresh.num-file-create 10
end-volume

################### End of glusterfs.vol client configuration ######################

And here is configuration for 1 of the server
###################### glusterfsd.vol server configuration ######################

volume posix2
type storage/posix # POSIX FS translator
option directory /data/export
end-volume

volume brick2
type features/posix-locks
option mandatory on
subvolumes posix2
end-volume

volume server
type protocol/server
option transport-type tcp
option transport.socket.listen-port 6997 # Default is 6996
subvolumes brick2
option auth.addr.brick2.allow *
end-volume
############### End of glusterfsd.vol server configuration ########################

What i Want here is, I want to use all storage space from all server without use replication.
Thanks before for your answers, Falko.

[c_parapat]

Okay, now i know what is mean of "type 'cluster/unify' is not valid or not found on this machine".
I try to debug, and it try to load the "unify" module on my system. But the file is not there. So i try to search the file with "locate unify.so" and copy it to the directory that glusterfs wants. And it working.
But I still have an issue here.
I don't know how to make the script configuration for "ioctl".
I still get the message error is ;
"glusterfs: end of file- Inappropriate ioctl for device.
Is there anybody know how to make the script for this ?

Originally Posted by c_parapat

Hello Falko,

Thanks for your reply. I am glad you reply my question. Falko, can you help me what is it mean about for this log :
"Volume 'bricks', line 49: type 'cluster/unify' is not valid or not found on this machine" ?
When I try to make unify, but the system always show that log.
Let me shared my client configuration here ;

################ glusterfs.vol client configuration #############################

volume client1
type protocol/client
option transport-type tcp
option remote-host 192.168.0.5
option transport.socket.remote-port 6996
option remote-subvolume brick1
end-volume

volume client2
type protocol/client
option transport-type tcp
option remote-host 192.168.0.6
option transport.socket.remote-port 6997
option remote-subvolume brick2
end-volume

volume bricks
type cluster/unify
option namespace client-ns
subvolumes client1 client2

option self-heal background
option scheduler alu
option alu.limits.min-free-disk 5%
option alu.limits.max-open-files 10000
option alu.order disk-usage:read-usage:write-usagepen-files-usage:disk-speed-usage
option alu.disk-usage.entry-threshold 2GB
option alu.disk-usage.exit-threshold 128MB
option alu.open-files-usage.entry-threshold 1024
option alu.open-files-usage.exit-threshold 32
option alu.read-usage.entry-threshold 20
option alu.read-usage.exit-threshold 4
option alu.write-usage.entry-threshold 20
option alu.write-usage.exit-threshold 4
option alu.disk-speed-usage.entry-threshold 0
option alu.disk-speed-usage.exit-threshold 0
option alu.stat-refresh.interval 10sec
option alu.stat-refresh.num-file-create 10
end-volume

################### End of glusterfs.vol client configuration ######################

And here is configuration for 1 of the server
###################### glusterfsd.vol server configuration ######################

volume posix2
type storage/posix # POSIX FS translator
option directory /data/export
end-volume

volume brick2
type features/posix-locks
option mandatory on
subvolumes posix2
end-volume

volume server
type protocol/server
option transport-type tcp
option transport.socket.listen-port 6997 # Default is 6996
subvolumes brick2
option auth.addr.brick2.allow *
end-volume
############### End of glusterfsd.vol server configuration ########################

What i Want here is, I want to use all storage space from all server without use replication.
Thanks before for your answers, Falko.