Go Back   HowtoForge Forums | HowtoForge - Linux Howtos and Tutorials > ISPConfig 3 > Installation/Configuration

Do you like HowtoForge? Please consider supporting us by becoming a subscriber.
Reply
 
Thread Tools Display Modes
  #1  
Old 3rd April 2012, 09:32
diablo666 diablo666 is offline
Member
 
Join Date: Mar 2007
Posts: 95
Thanks: 15
Thanked 2 Times in 2 Posts
Default Ispconfig 3.0 and glusterfs problem

I've configured ispconfig 3 in cluster mode, following the guide on how to forge.

All works fine, but i've a problem with glusterfs.

I've used 2 virtual machine on vmware esxi.

The problem is that when i'll try to unplug the network for test failover both partition /var/www and /var/vmail become inaccessibile on both servers.

Any idea about that?
Reply With Quote
Sponsored Links
  #2  
Old 4th April 2012, 12:17
diablo666 diablo666 is offline
Member
 
Join Date: Mar 2007
Posts: 95
Thanks: 15
Thanked 2 Times in 2 Posts
Default

No idea about that?

I've read other ppl got same problem.
Reply With Quote
  #3  
Old 4th April 2012, 12:22
till till is offline
Super Moderator
 
Join Date: Apr 2005
Location: Lneburg, Germany
Posts: 36,202
Thanks: 829
Thanked 5,420 Times in 4,262 Posts
Default

Which errors do you get in the glusterfs log files?
__________________
Till Brehm
--
Get ISPConfig support and the ISPConfig 3 manual from ispconfig.org.
Reply With Quote
  #4  
Old 4th April 2012, 13:13
diablo666 diablo666 is offline
Member
 
Join Date: Mar 2007
Posts: 95
Thanks: 15
Thanked 2 Times in 2 Posts
Default

Hi there i've two server 172.16.46.244 and 172.16.46.243, when i unplug the .243 in the logs i can't see anything.


[2012-04-04 13:03:20] N [server-protocol.c:6788:notify] server: 172.16.46.243:1023 disconnected
[2012-04-04 13:03:21] N [server-protocol.c:6788:notify] server: 172.16.46.243:1022 disconnected
[2012-04-04 13:03:21] N [server-protocol.c:6788:notify] server: 172.16.46.243:1019 disconnected
[2012-04-04 13:03:21] N [server-helpers.c:842:server_connection_destroy] server: destroyed connection of cluster02-777-2012/04/02-22:59:06:137852-remote1-vmail
[2012-04-04 13:03:24] N [server-protocol.c:5852:mop_setvolume] server: accepted client from 172.16.46.243:1023
[2012-04-04 13:03:30] N [server-protocol.c:5852:mop_setvolume] server: accepted client from 172.16.46.243:1022
[2012-04-04 13:03:30] N [server-protocol.c:5852:mop_setvolume] server: accepted client from 172.16.46.243:1019

Seems something like that when i unplug the connection, gluster got a long timeout before he can recognize lost of connection, infact when i reconnect he recognize the disconnection and reastablish the connection. Is that true?
Reply With Quote
  #5  
Old 4th April 2012, 13:21
till till is offline
Super Moderator
 
Join Date: Apr 2005
Location: Lneburg, Germany
Posts: 36,202
Thanks: 829
Thanked 5,420 Times in 4,262 Posts
Default

If you followed the tutorial, then glusterfs has two connections for each volume, one to the local server and one to the remote server. If you disconnect the remote server then gluterfs will use the connection to the local server to accessthe volume data, so the volume does not get disconnected. Maybe there is something wrong with your glusterfs config so that the volume runs on the remote connection only.
__________________
Till Brehm
--
Get ISPConfig support and the ISPConfig 3 manual from ispconfig.org.
Reply With Quote
  #6  
Old 4th April 2012, 13:31
diablo666 diablo666 is offline
Member
 
Join Date: Mar 2007
Posts: 95
Thanks: 15
Thanked 2 Times in 2 Posts
Default

Here are my two configs file

glusterfsd.vol
Code:
# Configuration for the vmail server volume
volume posix-vmail
  type storage/posix
  option directory /data/export-vmail
end-volume
volume locks-vmail
  type features/locks
  subvolumes posix-vmail
end-volume
volume brick-vmail
  type performance/io-threads
  option thread-count 8
  subvolumes locks-vmail
end-volume
# Configuration for the www server volume
volume posix-www
  type storage/posix
  option directory /data/export-www
end-volume
volume locks-www
  type features/locks
  subvolumes posix-www
end-volume
volume brick-www
  type performance/io-threads
  option thread-count 8
  subvolumes locks-www
end-volume
# export all volumes
volume server
  type protocol/server
  option transport-type tcp
  subvolumes brick-vmail brick-www

  # Authentification options for the vmail volume
  option auth.addr.brick-vmail.allow 172.16.46.244,172.16.46.243
  option auth.login.brick-vmail.allow user-vmail
  option auth.login.user-vmail.password XXXX


  # authentification options for www
  option auth.addr.brick-www.allow 172.16.46.244,172.16.46.243
  option auth.login.brick-www.allow user-www
  option auth.login.user-www.password XXXX

end-volume
glusterfs-www.vol
Code:
volume remote1-www
  type protocol/client
  option transport-type tcp
  option remote-host 172.16.46.244
  option remote-subvolume brick-www
  option username user-www
  option password XXXX
end-volume
volume remote2-www
  type protocol/client
  option transport-type tcp
  option remote-host 172.16.46.243
  option remote-subvolume brick-www
  option username user-www
  option password XXXX
end-volume
volume replicate-www
  type cluster/replicate
  subvolumes remote1-www remote2-www
end-volume
volume writebehind-www
  type performance/write-behind
  option window-size 1MB
  subvolumes replicate-www
end-volume
volume cache-www
  type performance/io-cache
  option cache-size 256MB
  subvolumes writebehind-www
end-volume
Reply With Quote
  #7  
Old 4th April 2012, 19:07
diablo666 diablo666 is offline
Member
 
Join Date: Mar 2007
Posts: 95
Thanks: 15
Thanked 2 Times in 2 Posts
 
Default

Strange thing....

About 15 i've unplugged the host .244 after some minutes (may be 10-15 minutes) glusterfs on the .243 started to work correctly.

The strange thing is that the online node (.243) had recognized the previous disconnection only 2 hourse later

[2012-04-04 17:02:39] N [server-protocol.c:6788:notify] server: 172.16.46.244:1020 disconnected
[2012-04-04 17:06:16] N [server-protocol.c:6788:notify] server: 172.16.46.244:1018 disconnected

Whats' going on? Some Timouts? Retry? Something else?
Reply With Quote
Reply

Bookmarks

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
GlusterFS: Severe performance problem with concurrent HTTP requests fredkin HOWTO-Related Questions 0 15th November 2011 21:52
Mirror Setup - ISPconfig install issues James A Installation/Configuration 1 31st August 2011 11:17
Apache boot problem / GlusterFS loading stefanm Installation/Configuration 2 9th August 2011 14:25
Strange GlusterFS problem Torsson Server Operation 0 12th January 2011 21:24
Problem with Master-Master MySQL replication of ISPConfig database voltron81 Installation/Configuration 3 5th January 2011 18:00


All times are GMT +2. The time now is 12:58.


Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2014, vBulletin Solutions, Inc.