Go Back   HowtoForge Forums | HowtoForge - Linux Howtos and Tutorials > Linux Forums > Technical

Do you like HowtoForge? Please consider supporting us by becoming a subscriber.
Reply
 
Thread Tools Display Modes
  #1  
Old 18th June 2008, 21:15
Tipem Tipem is offline
Junior Member
 
Join Date: Jun 2008
Posts: 14
Thanks: 4
Thanked 0 Times in 0 Posts
Default Static image server requirements/thoughts?

Hello,

Ok, so I run a website thedailyneopets.com that has gotten 1m+ pageviews within the past month (20,000 visits a day, yikes!). If you go to the website, you can tell that we're pretty image heavy (entertainment-related, yup). Every page on my site AT LEAST has 19 images, I've calculated. And some other pages, as many as 50.

Accordingly to my webstats in my Ensim control panel (which I highly doubt, but still, it's the root server logs), the directory "/uploads/" accounts for 40% of all of my total request last week (2406974 to be exact). The uploads directory is where all of my staff members upload their static images for pages and guides and such (basically where all images are stored). I also have an /images/ directory which serves images for JUST our layout (e.g., headers, footers, sidebars, etc) which accounts for another 29% percent of all incoming requests last week week (another 1736824 to be exact).

Now the server I'm on (CentOS, 6gb of RAM or something crazy like that, I can't remember exactly but minimum is 6gb) is actually handling the load quite well. It doesn't crash or anything. I'm nice and happy. But because we're handling an exceptionally LARGE load and considering most of the load is just static content, I figure now would be a good time to start splitting up servers and "branching" out instead of getting to the point where my current server starts crashing.

Based on my stats, what kind of server requirements would be needed for a STATIC IMAGE SERVER? Notice STATIC which means it wouldn't serve dynamic content such as php/mysql scripts. I was thinking Lighttpd + minimal installation of CentOS (Lighttpd is super fast for static content, I love it). But what kind of hardware would I need to handle nearly 69% of all my total requests? I currently have a free server sitting around that has 3.7 gb of RAM with a Pentium 4 in it... could this work?? Again, it wouldn't need to run big apache modules... just lighttpd and static content. No need for a bulky control panel such as Ensim either; just a dedicated IP box.

Let me know what your thoughts are. b)

Tipem
Reply With Quote
Sponsored Links
  #2  
Old 19th June 2008, 17:48
falko falko is offline
Super Moderator
 
Join Date: Apr 2005
Location: Lüneburg, Germany
Posts: 41,701
Thanks: 1,900
Thanked 2,751 Times in 2,581 Posts
Default

We're doing it like this: we've set up an image server with lighttpd (it's an OpenVZ vm with 1GB RAM, I think) and have a cron job that transfers the images from the HTTP servers to the image server with rsync. lighttpd handles the load exceptionally well, there's no load on the vm (0.00 or 0.01 all the time), and our web site has even more visits than yours.
__________________
Falko
--
Download the ISPConfig 3 Manual! | Check out the ISPConfig 3 Billing Module!

FB: http://www.facebook.com/howtoforge

nginx-Webhosting: Timme Hosting | Follow me on:
Reply With Quote
  #3  
Old 22nd June 2008, 18:57
Tipem Tipem is offline
Junior Member
 
Join Date: Jun 2008
Posts: 14
Thanks: 4
Thanked 0 Times in 0 Posts
Default

Hmmm, so do you think, in the end a

Lighttpd
Centos 5
3gb of RAM
Pentium 4
Backbone: RoadRunner Business Class (not datacenter T3 connection, just T1)

server could handle about 600,000 static image requests per day?? Give me your honest opinion. Lol, I wanna make sure this will work before I wipe the box.
Reply With Quote
  #4  
Old 23rd June 2008, 21:50
falko falko is offline
Super Moderator
 
Join Date: Apr 2005
Location: Lüneburg, Germany
Posts: 41,701
Thanks: 1,900
Thanked 2,751 Times in 2,581 Posts
 
Default

I'm not sure about the P4, but I think it *should* work.
__________________
Falko
--
Download the ISPConfig 3 Manual! | Check out the ISPConfig 3 Billing Module!

FB: http://www.facebook.com/howtoforge

nginx-Webhosting: Timme Hosting | Follow me on:
Reply With Quote
Reply

Bookmarks

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Email Clients cannot send mail iverson0881 Installation/Configuration 3 8th May 2008 09:34
postfix bounced email question daveb Server Operation 8 3rd February 2008 21:32
Administrator receive empty mail ??? Stanev General 16 7th April 2006 21:56
ispconfig and mambo shajazzi Installation/Configuration 70 28th March 2006 20:29
Mail not working Roadracer Installation/Configuration 16 31st December 2005 00:40


All times are GMT +2. The time now is 00:43.


Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2014, vBulletin Solutions, Inc.