#1  
Old 12th October 2010, 14:00
Davide Davide is offline
Senior Member
 
Join Date: Jul 2006
Posts: 123
Thanks: 16
Thanked 9 Times in 8 Posts
Default Post traffic

Hi

I have a client who is downloading a remote webpage every 20 seconds from its main page, using php's cURL.
Although remote webpage weights only 11 KiB, they are reloading it about 30-40k times a day, and that's a lot of traffic.

Problem is that this traffic is not accounted in ISPConfig, I can only see a 5 bytes POST entry for each remote page reload, but nothing about remote page wheigh.

Is it possible to account this traffic?

Thank you.
Reply With Quote
Sponsored Links
  #2  
Old 13th October 2010, 18:56
falko falko is offline
Super Moderator
 
Join Date: Apr 2005
Location: Lüneburg, Germany
Posts: 41,701
Thanks: 1,900
Thanked 2,747 Times in 2,578 Posts
Default

Do you see that page in the access.log each time it is reloaded?
__________________
Falko
--
Download the ISPConfig 3 Manual! | Check out the ISPConfig 3 Billing Module!

FB: http://www.facebook.com/howtoforge

nginx-Webhosting: Timme Hosting | Follow me on:
Reply With Quote
  #3  
Old 13th October 2010, 19:10
Davide Davide is offline
Senior Member
 
Join Date: Jul 2006
Posts: 123
Thanks: 16
Thanked 9 Times in 8 Posts
Default

Yes, one entry for every reload, but only as a 5 byte POST:

www.example.com||||5||||1.2.3.4 - - [13/Oct/2010:02:06:15 +0200] "POST /script_cURL.php HTTP/1.1" 200 5 "http://www.example.com/" "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; msn OptimizedIE8;ESES)"
Reply With Quote
  #4  
Old 14th October 2010, 18:13
falko falko is offline
Super Moderator
 
Join Date: Apr 2005
Location: Lüneburg, Germany
Posts: 41,701
Thanks: 1,900
Thanked 2,747 Times in 2,578 Posts
Default

Is this script somehow getting cached?
__________________
Falko
--
Download the ISPConfig 3 Manual! | Check out the ISPConfig 3 Billing Module!

FB: http://www.facebook.com/howtoforge

nginx-Webhosting: Timme Hosting | Follow me on:
Reply With Quote
  #5  
Old 14th October 2010, 18:20
Davide Davide is offline
Senior Member
 
Join Date: Jul 2006
Posts: 123
Thanks: 16
Thanked 9 Times in 8 Posts
Default

No AFAIK.

Every client accesing this page is automatically calling this script every 20 seconds.

In this script, they are downloading via cURL a remote page, parsing its code, and updating its page with new data.

I could paste the code if you want
Reply With Quote
  #6  
Old 15th October 2010, 17:25
falko falko is offline
Super Moderator
 
Join Date: Apr 2005
Location: Lüneburg, Germany
Posts: 41,701
Thanks: 1,900
Thanked 2,747 Times in 2,578 Posts
Default

Yes, maybe that helps in understanding what is happening.
__________________
Falko
--
Download the ISPConfig 3 Manual! | Check out the ISPConfig 3 Billing Module!

FB: http://www.facebook.com/howtoforge

nginx-Webhosting: Timme Hosting | Follow me on:
Reply With Quote
  #7  
Old 18th October 2010, 21:31
Davide Davide is offline
Senior Member
 
Join Date: Jul 2006
Posts: 123
Thanks: 16
Thanked 9 Times in 8 Posts
Default

Sorry for my late reply

The funcion my client uses is this one:

http://ryan.ifupdown.com/2008/11/07/...-curl-and-php/
Reply With Quote
  #8  
Old 1st December 2010, 11:33
Davide Davide is offline
Senior Member
 
Join Date: Jul 2006
Posts: 123
Thanks: 16
Thanked 9 Times in 8 Posts
Default

Any new on this?
Reply With Quote
  #9  
Old 2nd December 2010, 16:26
falko falko is offline
Super Moderator
 
Join Date: Apr 2005
Location: Lüneburg, Germany
Posts: 41,701
Thanks: 1,900
Thanked 2,747 Times in 2,578 Posts
 
Default

I have no idea...
__________________
Falko
--
Download the ISPConfig 3 Manual! | Check out the ISPConfig 3 Billing Module!

FB: http://www.facebook.com/howtoforge

nginx-Webhosting: Timme Hosting | Follow me on:
Reply With Quote
Reply

Bookmarks

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Routing - Forward all traffic to an ip to another ip bsgcic Installation/Configuration 0 25th July 2010 12:26
Abnormally High Upload Network Usage HenryTheEight Server Operation 6 15th June 2010 20:43
HTTP POST request over GPRS doesn't work. hiharsh Technical 2 23rd July 2008 17:52
WEBALIZER FTP TRAFFIC CONT in WEB TRAFFIC dloopsrl Installation/Configuration 3 20th September 2006 18:39
Traffic Limit katschi Feature Requests 2 17th August 2005 00:40


All times are GMT +2. The time now is 04:58.


Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2014, vBulletin Solutions, Inc.