ISPconfig 2 FTP transfer slow on LAN

[orasis]

Hi, I installed ISPconfig 2 back again and uploading sites on a LAN connection using Filezilla.
I had ISPconfig 3 since today, and the FTP transfer was extremely fast, I was uploading 8000 files in less than a minute.
in ISPconfig 2 it takes more than 15 minutes to do this


Edit: I have similar problem with Web-FTP too. It takes long to enter and show the contents.

what do I need to check please ?

thanks a lot

[falko]

Did you try both active and passive transfers in your FTP client?

[edge]

Read all of this thread. It might help you.

http://www.howtoforge.com/forums/showthread.php?t=5114

[orasis]

Hi there guys,

thanks to both of you for your reply and help me into this really,

Originally Posted by falko

Did you try both active and passive transfers in your FTP client?

yes in Filezilla I have tried both Default // Active // Passive modes, even restarting the client on every change. I even tried this from a linux os running on same computer connecting to the same server.

Originally Posted by edge

Read all of this thread. It might help you.

http://www.howtoforge.com/forums/showthread.php?t=5114

I read it, thanks for pointing me there, I also found lots of other ones before I posted my problem. Well Actually, my problem is not the speed I get in order to connect to the server actually, which is an issue you can say compared to how it was before, but the speed I get in transfering files.

Example:
- If I try to transfer a large file, as a tested a 1GB WAV file, it transfers it with the limits of my lan connection. about 11,7MB/s
- But If I try to upload say, a Joomla unpacked archive, which is about 6000 files or so, I see the files uploading slow.

So it is not the actual speed of 1 file itself, but how long it takes for 1 file to the next. As I said, in ISPconfig 3, it was uploading 8000 files in like WOW les than a minute like a lightning. Now it takes 2 cigarettes (or more).

This is my ping results from a Windows OS, (default firewall disabled completely from the windows services even, no firewall on OS/Computer itself):

Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
Reply from 192.168.0.150: bytes=32 time=1ms TTL=64
Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
Reply from 192.168.0.150: bytes=32 time=1ms TTL=64
Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
Reply from 192.168.0.150: bytes=32 time=1ms TTL=64
Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
Reply from 192.168.0.150: bytes=32 time=1ms TTL=64
Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
Reply from 192.168.0.150: bytes=32 time<1ms TTL=64

I also haven't added any jobs to this ubuntu machine, I did install some more software to it, but the test I am talking about, and slow file transfer is since I first installed it and it was 100% clean of other installations. I have rebooted the machine lots of times too. It should also not be a ram issue, I don't have slow logins either (I remind you on same laptop computer I was running ISPconfig 3 the previous day). I also don't have more IPs added.


netstat -tap

Proto Recv-Q Send-Q Local Address            Foreign Address         State       PID/Program name
tcp        0      0 *:https                  *:*                     LISTEN      3431/apache2    
tcp        0      0 example1.mydomain.:10024 *:*                     LISTEN      1488/amavisd (maste
tcp        0      0 *:mysql                  *:*                     LISTEN      1667/mysqld     
tcp        0      0 *:www                    *:*                     LISTEN      3431/apache2    
tcp        0      0 *:81                     *:*                     LISTEN      3263/ispconfig_http
tcp        0      0 *:ftp                    *:*                     LISTEN      4836/proftpd: (acce
tcp        0      0 example1.mydomain:domain *:*                     LISTEN      3598/named      
tcp        0      0 example1.mydomain:domain *:*                     LISTEN      3598/named      
tcp        0      0 *:ssh                    *:*                     LISTEN      1374/sshd       
tcp        0      0 example1.mydomain.ne:ipp *:*                     LISTEN      2795/cupsd      
tcp        0      0 example1.mydomain.ne:953 *:*                     LISTEN      3598/named      
tcp        0      0 *:smtp                   *:*                     LISTEN      3555/master     
tcp        0      0 example1.mydomain.ne:ftp example2.myotherdomain.ne:2281 ESTABLISHED 4840/proftpd: example2
tcp6       0      0 [::]:imaps               [::]:*                  LISTEN      2166/couriertcpd
tcp6       0      0 [::]:pop3s               [::]:*                  LISTEN      2210/couriertcpd
tcp6       0      0 [::]:pop3                [::]:*                  LISTEN      2185/couriertcpd
tcp6       0      0 [::]:imap2               [::]:*                  LISTEN      2141/couriertcpd
tcp6       0      0 [::]:ssh                 [::]:*                  LISTEN      1374/sshd       
tcp6       0      0 localhost:ipp            [::]:*                  LISTEN      2795/cupsd      
tcp6       0      0 localhost:953            [::]:*                  LISTEN      3598/named      
tcp6       0      0 [::]:smtp                [::]:*                  LISTEN      3555/master

iptables -L

Chain INPUT (policy DROP)
target     prot opt source               destination         
DROP       tcp  --  anywhere             127.0.0.0/8         
ACCEPT     all  --  anywhere             anywhere            state RELATED,ESTABLISHED 
ACCEPT     all  --  anywhere             anywhere            
DROP       all  --  BASE-ADDRESS.MCAST.NET/4  anywhere            
PUB_IN     all  --  anywhere             anywhere            
PUB_IN     all  --  anywhere             anywhere            
PUB_IN     all  --  anywhere             anywhere            
PUB_IN     all  --  anywhere             anywhere            
DROP       all  --  anywhere             anywhere            

Chain FORWARD (policy DROP)
target     prot opt source               destination         
ACCEPT     all  --  anywhere             anywhere            state RELATED,ESTABLISHED 
DROP       all  --  anywhere             anywhere            

Chain OUTPUT (policy ACCEPT)
target     prot opt source               destination         
PUB_OUT    all  --  anywhere             anywhere            
PUB_OUT    all  --  anywhere             anywhere            
PUB_OUT    all  --  anywhere             anywhere            
PUB_OUT    all  --  anywhere             anywhere            

Chain INT_IN (0 references)
target     prot opt source               destination         
ACCEPT     icmp --  anywhere             anywhere            
DROP       all  --  anywhere             anywhere            

Chain INT_OUT (0 references)
target     prot opt source               destination         
ACCEPT     icmp --  anywhere             anywhere            
ACCEPT     all  --  anywhere             anywhere            

Chain PAROLE (10 references)
target     prot opt source               destination         
ACCEPT     all  --  anywhere             anywhere            

Chain PUB_IN (4 references)
target     prot opt source               destination         
ACCEPT     icmp --  anywhere             anywhere            icmp destination-unreachable 
ACCEPT     icmp --  anywhere             anywhere            icmp echo-reply 
ACCEPT     icmp --  anywhere             anywhere            icmp time-exceeded 
ACCEPT     icmp --  anywhere             anywhere            icmp echo-request 
PAROLE     tcp  --  anywhere             anywhere            tcp dpt:ftp 
PAROLE     tcp  --  anywhere             anywhere            tcp dpt:ssh 
PAROLE     tcp  --  anywhere             anywhere            tcp dpt:smtp 
PAROLE     tcp  --  anywhere             anywhere            tcp dpt:domain 
PAROLE     tcp  --  anywhere             anywhere            tcp dpt:www 
PAROLE     tcp  --  anywhere             anywhere            tcp dpt:81 
PAROLE     tcp  --  anywhere             anywhere            tcp dpt:pop3 
PAROLE     tcp  --  anywhere             anywhere            tcp dpt:imap2 
PAROLE     tcp  --  anywhere             anywhere            tcp dpt:https 
PAROLE     tcp  --  anywhere             anywhere            tcp dpt:webmin 
ACCEPT     udp  --  anywhere             anywhere            udp dpt:domain 
DROP       icmp --  anywhere             anywhere            
DROP       all  --  anywhere             anywhere            

Chain PUB_OUT (4 references)
target     prot opt source               destination         
ACCEPT     all  --  anywhere             anywhere

Now I first noticed the problem when the server was fresh installed and the ISPconfig Firewall was not ON. So turning it ON/OFF has same results.

This is what my proftpd.conf looks like:

#
# /etc/proftpd/proftpd.conf -- This is a basic ProFTPD configuration file.
# To really apply changes reload proftpd after modifications.
# 

# Includes DSO modules
Include /etc/proftpd/modules.conf

# Set off to disable IPv6 support which is annoying on IPv4 only boxes.
UseIPv6                on
# If set on you can experience a longer connection delay in many cases.
IdentLookups            off

ServerName            "Debian"
ServerType            standalone
DeferWelcome            off

MultilineRFC2228        on
DefaultServer            on
ShowSymlinks            on

TimeoutNoTransfer        600
TimeoutStalled            600
TimeoutIdle            1200

DisplayLogin                    welcome.msg
DisplayChdir                   .message true
ListOptions                    "-l"

DenyFilter            \*.*/

# Use this to jail all users in their homes 
DefaultRoot            ~

# Users require a valid shell listed in /etc/shells to login.
# Use this directive to release that constrain.
# RequireValidShell        off

# Port 21 is the standard FTP port.
Port                21

# In some cases you have to specify passive ports range to by-pass
# firewall limitations. Ephemeral ports can be used for that, but
# feel free to use a more narrow range.
# PassivePorts                  49152 65534

# If your host was NATted, this option is useful in order to
# allow passive tranfers to work. You have to use your public
# address and opening the passive ports used on your firewall as well.
# MasqueradeAddress        1.2.3.4

# This is useful for masquerading address with dynamic IPs:
# refresh any configured MasqueradeAddress directives every 8 hours
<IfModule mod_dynmasq.c>
# DynMasqRefresh 28800
</IfModule>

# To prevent DoS attacks, set the maximum number of child processes
# to 30.  If you need to allow more than 30 concurrent connections
# at once, simply increase this value.  Note that this ONLY works
# in standalone mode, in inetd mode you should use an inetd server
# that allows you to limit maximum number of processes per service
# (such as xinetd)
MaxInstances            30

# Set the user and group that the server normally runs at.
User                proftpd
Group                nogroup

# Umask 022 is a good standard umask to prevent new files and dirs
# (second parm) from being group and world writable.
Umask                022  022
# Normally, we want files to be overwriteable.
AllowOverwrite            on

# Uncomment this if you are using NIS or LDAP via NSS to retrieve passwords:
# PersistentPasswd        off

# This is required to use both PAM-based authentication and local passwords
# AuthOrder            mod_auth_pam.c* mod_auth_unix.c

# Be warned: use of this directive impacts CPU average load!
# Uncomment this if you like to see progress and transfer rate with ftpwho
# in downloads. That is not needed for uploads rates.
#
# UseSendFile            off

TransferLog /var/log/proftpd/xferlog
SystemLog   /var/log/proftpd/proftpd.log

<IfModule mod_quotatab.c>
QuotaEngine off
</IfModule>

<IfModule mod_ratio.c>
Ratios off
</IfModule>


# Delay engine reduces impact of the so-called Timing Attack described in
# http://security.lss.hr/index.php?page=details&ID=LSS-2004-10-02
# It is on by default. 
<IfModule mod_delay.c>
DelayEngine off
</IfModule>

<IfModule mod_ctrls.c>
ControlsEngine        off
ControlsMaxClients    2
ControlsLog           /var/log/proftpd/controls.log
ControlsInterval      5
ControlsSocket        /var/run/proftpd/proftpd.sock
</IfModule>

<IfModule mod_ctrls_admin.c>
AdminControlsEngine off
</IfModule>

#
# Alternative authentication frameworks
#
#Include /etc/proftpd/ldap.conf
#Include /etc/proftpd/sql.conf

#
# This is used for FTPS connections
#
#Include /etc/proftpd/tls.conf

# A basic anonymous configuration, no upload directories.

# <Anonymous ~ftp>
#   User                ftp
#   Group                nogroup
#   # We want clients to be able to login with "anonymous" as well as "ftp"
#   UserAlias            anonymous ftp
#   # Cosmetic changes, all files belongs to ftp user
#   DirFakeUser    on ftp
#   DirFakeGroup on ftp
# 
#   RequireValidShell        off
# 
#   # Limit the maximum number of anonymous logins
#   MaxClients            10
# 
#   # We want 'welcome.msg' displayed at login, and '.message' displayed
#   # in each newly chdired directory.
#   DisplayLogin            welcome.msg
#   DisplayChdir        .message
# 
#   # Limit WRITE everywhere in the anonymous chroot
#   <Directory *>
#     <Limit WRITE>
#       DenyAll
#     </Limit>
#   </Directory>
# 
#   # Uncomment this if you're brave.
#   # <Directory incoming>
#   #   # Umask 022 is a good standard umask to prevent new files and dirs
#   #   # (second parm) from being group and world writable.
#   #   Umask                022  022
#   #            <Limit READ WRITE>
#   #            DenyAll
#   #            </Limit>
#   #            <Limit STOR>
#   #            AllowAll
#   #            </Limit>
#   # </Directory>
# 
# </Anonymous>


ServerIdent on "FTP Server ready."

DefaultRoot ~

Include /etc/proftpd_ispconfig.conf

UseReverseDNS off

If I turn the "UseIPv6 on" to "off" as by someone's advice, then the FTP server goes completely down.

Most important for me is, that even if I connect from the same computer that the server is installed on, I get absolutely same speed results. So it must be some special setting that I need to alter.

ISP Server Status

Status:

Server Online since:  	
0d, 0:13h
Users Online: 	
2 users
System Load 1 Minute: 	
0.00
System Load 5 Minutes: 	
0.06
System Load 15 Minutes: 	
0.09 

Filesystem	Size	Used	Avail	Use%	Mounted
/dev/sda3	20G	6.4G	13G	35%	/
udev	1006M	280K	1006M	1%	/dev
none	1006M	1.4M	1005M	1%	/dev/shm
none	1006M	136K	1006M	1%	/var/run
none	1006M	0	1006M	0%	/var/lock
none	1006M	0	1006M	0%	/lib/init/rw

Main Memory:

Cached:  	 346956 kB
SwapCached: 	0 kB
Active: 	447084 kB
Inactive: 	285204 kB
Active(anon): 	348952 kB
Inactive(anon): 	48 kB
Active(file): 	98132 kB
Inactive(file): 	285156 kB
Unevictable: 	0 kB
Mlocked: 	0 kB
HighTotal: 	1186248 kB
HighFree: 	478640 kB
LowTotal: 	873956 kB
LowFree: 	785076 kB
SwapTotal: 	4200956 kB
SwapFree: 	4200956 kB
Dirty: 	112 kB
Writeback: 	0 kB
AnonPages: 	340244 kB
Mapped: 	85932 kB
Slab: 	24948 kB
SReclaimable: 	14988 kB
SUnreclaim: 	9960 kB
PageTables: 	6268 kB
NFS_Unstable: 	0 kB
Bounce: 	0 kB
WritebackTmp: 	0 kB
CommitLimit: 	5231056 kB
Committed_AS: 	1089652 kB
VmallocTotal: 	122880 kB
VmallocUsed: 	53336 kB
VmallocChunk: 	61940 kB
HugePages_Total: 	0
HugePages_Free: 	0
HugePages_Rsvd: 	0
HugePages_Surp: 	0
Hugepagesize: 	4096 kB
DirectMap4k: 	53240 kB
DirectMap4M: 	856064 kB

CPU:

processor :  	 0
vendor_id : 	GenuineIntel
cpu family : 	6
model : 	15
model name : 	Intel(R) Core(TM)2 CPU T7200 @ 2.00GHz
stepping : 	6
cpu MHz : 	1000.000
cache size : 	4096 KB
physical id : 	0
siblings : 	2
core id : 	0
cpu cores : 	2
apicid : 	0
initial apicid : 	0
fdiv_bug : 	no
hlt_bug : 	no
f00f_bug : 	no
coma_bug : 	no
fpu : 	yes
fpu_exception : 	yes
cpuid level : 	10
wp : 	yes
flags : 	fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx lm constant_tsc arch_perfmon pebs bts pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm lahf_lm tpr_shadow
bogomips : 	3991.73
clflush size : 	64
power management: 	
processor : 	1
vendor_id : 	GenuineIntel
cpu family : 	6
model : 	15
model name : 	Intel(R) Core(TM)2 CPU T7200 @ 2.00GHz
stepping : 	6
cpu MHz : 	1000.000
cache size : 	4096 KB
physical id : 	0
siblings : 	2
core id : 	1
cpu cores : 	2
apicid : 	1
initial apicid : 	1
fdiv_bug : 	no
hlt_bug : 	no
f00f_bug : 	no
coma_bug : 	no
fpu : 	yes
fpu_exception : 	yes
cpuid level : 	10
wp : 	yes
flags : 	fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx lm constant_tsc arch_perfmon pebs bts pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm lahf_lm tpr_shadow
bogomips : 	3929.44
clflush size : 	64
power management:

Services:

Web-Server:      
Online
FTP-Server:     
Online
SMTP-Server:     
Online
POP3-Server:     
Online
BIND-Server:     
Online
mySQL-Server:     
Online

ISPConfig
Version: 2.2.37
(c) ISPConfig 2010

[orasis]

I just restarted into linux (the computer I just posted the above reply),
installed gFTP to try the same thing. Result, even slower, I actually don't like gFTP at all.

Also testing right now with Filezilla on linux, same thing.

By the way, same kinda slow speed I have even when deleting files from server. ( 6000 files = 2 cigarettes long )