proftpd upload fails, limits seem okay?

Discussion in 'General' started by crypted, Aug 29, 2007.

  1. crypted

    crypted New Member

    We haven't tried uploading large files since we redeployed onto a ISPConfig server from a Plesk server, but there seems to be issues when uploading files suddenly (those of any size specifically)... We're using CentOS 4.4 and the latest Proftpd (Pureftpd stopped letting us connect, it would just time out so we switched to Proftpd)...

    Any advice would on solving this issue would be greatly appreciated. Here's logs and information:

    Website Information:
    Storage space: 10000 MB
    used: 1.10G
    /log 2.5M
    /ssl 4.0K
    /user 1.4M
    /phptmp 4.0K
    /web 1.1G
    /cgi-bin 4.0K


    The only log file with data for Proftpd is /var/log/messages:
    Aug 29 00:00:02 its proftpd[29672]: localhost.localdomain :):ffff:127.0.0.1[::ffff:127.0.0.1]) - FTP session opened.
    Aug 29 00:00:02 its proftpd[29672]: localhost.localdomain :):ffff:127.0.0.1[::ffff:127.0.0.1]) - FTP session closed.
    Aug 29 00:01:04 its proftpd[29707]: localhost.localdomain :):ffff:70.178.214.97[::ffff:70.178.214.97]) - FTP session opened.
    Aug 29 00:01:04 its proftpd(pam_unix)[29707]: session opened for user web5_postmaster by (uid=0)
    Aug 29 00:27:15 its proftpd[30402]: localhost.localdomain :):ffff:70.178.214.97[::ffff:70.178.214.97]) - FTP session opened.
    Aug 29 00:27:15 its proftpd(pam_unix)[30402]: session opened for user web5_postmaster by (uid=0)
    Aug 29 00:27:49 its su(pam_unix)[30442]: session opened for user root by dingle(uid=10005)
    Aug 29 00:30:01 its proftpd[30539]: localhost.localdomain :):ffff:127.0.0.1[::ffff:127.0.0.1]) - FTP session opened.
    Aug 29 00:30:01 its proftpd[30539]: localhost.localdomain :):ffff:127.0.0.1[::ffff:127.0.0.1]) - FTP session closed.

    FlashFXP status output is the following:
    [R] CWD /web/skype-debug
    [R] 250 CWD command successful
    [R] PWD
    [R] 257 "/web/skype-debug" is current directory.
    [R] TYPE I
    [R] 200 Type set to I
    [R] PASV
    [R] 227 Entering Passive Mode (207,150,163,130,229,74).
    [R] Opening data connection IP: 207.150.163.130 PORT: 58698
    [R] REST 152576000
    [R] 350 Restarting at 152576000. Send STORE or RETRIEVE to initiate transfer
    [R] STOR debug-20070826-2251.log
    [R] 150 Opening BINARY mode data connection for debug-20070826-2251.log
    [R] Transfer Failed!
    [R] Connection lost: Inter5.Org
    [R] Attempting to Reconnect.
    [R] Connecting to Inter5.Org -> IP=207.150.163.

    The connection is lost and it FAILS after FlashFXP reaches 100%. I noticed that there's no file in the directory when viewing it in SSH while the file is supposed to be uploading.

    Proftpd is setup with its standard stand-alone configuration file with allowance of FXPing for sever-to-server data transfers...
     
  2. till

    till Super Moderator

    Please check with:

    repquota -avug

    that the user that you use to upload the file and the group have enough free space.
     
  3. crypted

    crypted New Member

    I don't see "web5" under repquota, but after using grep with it I find individual users...

    web5_boxdata -- 52 0 0 8 0 0
    web5_canel -- 36 0 0 10 0 0
    web5_postmaster -- 2269116 0 0 1023 0 0
    web5_sales -- 224 0 0 14 0 0
    web5_webmaster -- 256 0 0 7 0 0
    web5_partnerships -- 3320 0 0 6 0 0
    web5_derek -- 84 0 0 16 0 0
    web5_shiz -- 16 0 0 5 0 0

    web5_postmaster controls the website as administrator...


    standard output:
    Block limits File limits
    Group used soft hard grace used soft hard grace
    ----------------------------------------------------------------------
    root -- 15359164 0 0 250899 0 0
    bin -- 78880 0 0 14626 0 0
    daemon -- 36 0 0 5 0 0
    sys -- 116 0 0 17 0 0
    tty -- 24 0 0 2 0 0
    disk -- 4 0 0 1 0 0
    wheel -- 65904 0 0 3706 0 0
    mail -- 80424 0 0 73 0 0
    uucp -- 164 0 0 1 0 0
    man -- 256 0 0 32 0 0
    ftp -- 4 0 0 1 0 0
    lock -- 24 0 0 2 0 0
    nobody -- 68 0 0 2 0 0
    users -- 512 0 0 84 0 0
    rpm -- 29424 0 0 67 0 0
    utmp -- 392 0 0 1 0 0
    netdump -- 16 0 0 2 0 0
    slocate -- 3904 0 0 5 0 0
    rpcuser -- 20 0 0 4 0 0
    smmsp -- 1100 0 0 90 0 0
    xfs -- 0 0 0 1 0 0
    htt -- 20 0 0 4 0 0
    canna -- 15072 0 0 37 0 0
    named -- 428 0 0 104 0 0
    mysql -- 275768 0 0 8068 0 0
    dovecot -- 4 0 0 1 0 0
    postdrop -- 296 0 0 4 0 0
    postfix -- 304 0 0 78 0 0
    apache -- 638636 0 0 7854 0 0
    ntp -- 8 0 0 2 0 0
    altnetclient -- 8672 0 0 569 0 0
    altnethub -- 28222064 0 0 1163880 0 0
    scpuser -- 8300 0 0 58 0 0
    voiceserver -- 11304 0 0 416 0 0
    derek -- 102268 0 0 494 0 0
    admispconfig -- 1822916 0 0 2632 0 0
    web1 -- 180924 0 0 4315 0 0
    fork -- 229120 0 0 8826 0 0
    web3 -- 985800 14336000 14337024 19394 0 0
    dingle -- 2269684 10240000 10241024 1069 0 0
    bling0r -- 591632 3072000 3073024 3014 0 0
    web4 -- 221208 4096000 4097024 15660 0 0
    web12 -- 1052 1536000 1537024 66 0 0
    web13 -- 125636 1536000 1537024 115 0 0
    web15 -- 13520 819200 820224 71 0 0
    web16 -- 9764 8192000 8193024 87 0 0
    web17 -- 2280 1024000 1025024 83 0 0
    web18 -- 8380 1024000 1025024 66 0 0
    web19 -- 72 1024000 1025024 20 0 0
    web20 -- 72 1024000 1025024 20 0 0
    web22 -- 928 3584000 3585024 66 0 0
    web23 -- 924 2252800 2253824 79 0 0
    web25 -- 16332 1024000 1025024 132 0 0
    web28 -- 34876 512000 513024 70 0 0
    shawn -- 23992 0 0 61 0 0
    web29 -- 6108 1024000 1025024 61 0 0
    web32 -- 72 1024000 1025024 19 0 0
    web33 -- 76 2048000 2049024 21 0 0
    web36 -- 680 2048000 2049024 57 0 0
    web37 -- 72 2048000 2049024 19 0 0
    web39 -- 72 2048000 2049024 19 0 0
    web40 -- 764 2048000 2049024 57 0 0
    web42 -- 76 2048000 2049024 21 0 0
    web47 -- 1384 2048000 2049024 33 0 0
    web48 -- 72 2048000 2049024 19 0 0
    web49 -- 10656 102400 103424 272 0 0
    web50 -- 38664 102400 103424 997 0 0
    web51 -- 38548 102400 103424 220 0 0
    web52 -- 2744 102400 103424 76 0 0
    web53 -- 8356 102400 103424 134 0 0
    web55 -- 22116 102400 103424 124 0 0
    web57 -- 19388 665600 666624 2105 0 0
    web58 -- 267948 5120000 5121024 20818 0 0
    web59 -- 19988 256000 257024 2140 0 0
    web61 -- 950092 0 0 13149 0 0
    web63 -- 9440 0 0 26 0 0
    web66 -- 2004 0 0 52 0 0
    web67 -- 41724 665600 666624 5059 0 0
    web68 -- 3602264 4096000 4097024 2593 0 0
    web69 -- 92 1024000 1025024 24 0 0
    squid -- 160 0 0 6 0 0
    web70 -- 41752 0 0 5217 0 0
    web71 -- 83164 0 0 12879 0 0
    #1000 -- 2052 0 0 1281 0 0
    #10056 -- 32 0 0 7 0 0
    #21000 -- 2768 0 0 254 0 0
    #33 -- 568 0 0 28 0 0
    #2526 -- 62668 0 0 2963 0 0
     
  4. crypted

    crypted New Member

    anyone have thoughts???
     
  5. till

    till Super Moderator

    Please try to set the quota of the website to a higher limit and then set the quota of the administrator user of the website to the same limit.

    If this wont help, please post the output of:

    ls -la /var/www/web5/web/skype-debug
     
  6. crypted

    crypted New Member

    I tried the upload after those modifications and it still didn't work. In fact, I tried uploading to several other domains as well as direct server users (not website accounts) and the same thing is happening consistently.

    dingle@its:/home# ls -la /var/www/web5/web/skype-debug
    total 173500
    drwxr-xr-x 2 web5_postmaster dingle 4096 Aug 31 12:33 .
    drwxrwxr-x 19 web5_postmaster dingle 4096 Aug 27 08:42 ..
    -rw-r--r-- 1 web5_postmaster dingle 172895477 Aug 29 00:25 debug-20070826-2251.log
    -rw-r--r-- 1 web5_postmaster dingle 4571071 Aug 31 12:38 debug-20070826-2251.trace.txt
    dingle@its:/home#

    I would note that it is currently retrying to upload, that's wht the trace.txt file is showing right now. However, at 100% that file will disappear and thus no longer be available after completion.
     
  7. till

    till Super Moderator

    Please post the content of your proftpd.conf file, comments stripped.
     
  8. crypted

    crypted New Member

    ServerName "ProFTPD server"
    ServerIdent on "FTP Server ready."
    ServerAdmin root@localhost
    ServerType standalone
    #ServerType inetd
    DefaultServer on
    AccessGrantMsg "User %u logged in."
    #DisplayConnect /etc/ftpissue
    #DisplayLogin /etc/ftpmotd
    #DisplayGoAway /etc/ftpgoaway
    DeferWelcome off
    DefaultRoot ~ !adm
    AuthPAMConfig proftpd
    AuthOrder mod_auth_pam.c* mod_auth_unix.c
    IdentLookups off
    UseReverseDNS off
    Port 21
    Umask 022
    ListOptions "-a"
    AllowForeignAddress on # For FXP
    AllowRetrieveRestart on
    AllowStoreRestart on
    MaxInstances 20
    User nobody
    Group nobody
    UseSendfile no
    ScoreboardFile /var/run/proftpd.score
    <Global>
    AllowOverwrite yes
    IdentLookups off
    <Limit ALL SITE_CHMOD>
    AllowAll
    </Limit>
    </Global>
    LogFormat default "%h %l %u %t \"%r\" %s %b"
    LogFormat auth "%v [%P] %h %t \"%r\" %s"
    DefaultRoot ~
    Include /etc/proftpd_ispconfig.conf


    ISPconf top portion is below, and it repeats several times for all the VHOST ips:
    DefaultAddress 127.0.0.1
    <VirtualHost 207.150.163.130>
    DefaultRoot ~
    AllowOverwrite on
    Umask 002
    </VirtualHost>
     
  9. jmroth

    jmroth ISPConfig Developer

    What happens when you do a transfer locally?
    I.e. from the server to the server via ftp:
    Code:
    # ftp
    ftp> open localhost
    Connected to localhost.localdomain.
    220 ProFTPD 1.3.0 Server (xxx) [::ffff:127.0.0.1]
    Name (localhost:root): web8_admin
    234 AUTH SSL successful
    [SSL Cipher DHE-RSA-AES256-SHA]
    331 Password required for web8_admin.
    Password:
    230 User web8_admin logged in.
    Remote system type is UNIX.
    Using binary mode to transfer files.
    ftp> bin
    200 Type set to I
    ftp> put bla.avi
    local: bla.avi remote: bla.avi
    200 PORT command successful
    150 Opening BINARY mode data connection for bla.avi
    226 Transfer complete.
    730329088 bytes sent in 186.00 secs (3834.5 kB/s)
    
     
  10. crypted

    crypted New Member

    Yeah I just thought of that a bit ago before reading this... I tried fxping from site to site and it worked okay. This is quite odd. I can upload to other servers and other networks without a problem from my LAN though... Weird.
     
  11. till

    till Super Moderator

    Have you tried active and passive FTP mode?
     
  12. crypted

    crypted New Member

    Trying that now; thanks a lot for the help guys... It seems others are now able to upload (after the box rebooted at least) while I still can't. It's probably something weird on my end and I'll have to figure it out as I don't want you all having to try and troubleshoot a network and Windoze... Thanks a lot.
     

Share This Page