Topic - Large scale deployment
Topic - Large scale deployment Topic - Large scale deployment
from forum General Chat
 forum index   my profile   search 
 new topic  post reply 
moderators: pjr tab
Large scale deployment
Joined: 28-May-2007
Posts: 1
Posted: 28-May-2007 07:40
I am investigating various approaches for developing a web-app that (if successful) will need to scale to millions of page hits per day and up.

Has NetKernel been used in such an environment? I understand that the concepts upon which it is based are specifically intended to enable scaling. But I'm wondering if NetKernel (as an implementation of those concepts) has been pounded on enough to verify that it has the durability and internal performance to handle such loads.

I'm imagining that NetKernel would be on back-end systems, but I'm also wondering if anyone has tried to use it on scaled-out front-end systems. My rough idea is something like this:

back-end           cache       front-end
--------           -----       ---------

Netkern-1-----                 -----httpd-1
             |                 |
Netkern-2----------Squid------------httpd-2
             |                 |
NetKern-N-----                 -----httpd-N

In practice there would be many more front-ends than back-ends. The primary idea behind squid is to consolidate caches, but it also has many nice cache specific features. The back-end NetKern servers would not all be identical (although some might be load balanced clones) and sit atop various resources like RDBMS, static files, external data, etc.

Anyway, I've been pondering this all day and wanted some feedback since it's rather different from what I've done previously.

Thanks,
-Brad
Large scale deployments
Joined: 7-February-2005
Posts: 397
Location: UK
Posted: 28-May-2007 09:48
Hi Schikb,

Welcome to the NetKernel community.  Your proposed architecture is definitely well proven - one of our oldest customers has been in production for several years using NetKernel behind a very large scale web property.   Unfortunately for commercial reasons we're not able to publicly say which site this is.

Our customers page on the 1060research.com site points to some other similar examples.   

I completely understand the need to establish confidence in infrastructural software.   I'm very pleased to say that NetKernel has been around for nearly 5 years now and is the basis of many large scale commercial systems.

Cheers,

Peter
 new topic  post reply  To find out about new replies to this post as they occur
please subscribe to one of these feeds:
AtomRSS moderate 
© 2003-2006, 1060 Research Limited. 1060 registered trademark, NetKernel trademark of 1060 Research Limited.