Digg

Introducing Digg Dialogg!
Check out the first Digg Dialogg with Nancy Pelosi. More guests to be announced soon!

See the original image at deepfriedbytes.com

Deep Fried Bytes 4: Scaling Large Web Sites with Joe Stump

deepfriedbytes.com — Have you ever wanted to learn how top 100 web sites are architected? Deep Fried Bytes hosts Keith Elder and Chris Woodruff sat down with Joe Stump, Lead Architect at DIGG to discuss scaling large web sites, his life, development experiences and team building.

Bury

cwoodruff 70 days ago, made popular 70 days ago

674 diggs
digg it

joestump, on 06/18/2008, -4/+37Warning: 1 hour and 15 minutes of me babbling incoherently.
- trammell, on 06/18/2008, -0/+12"1 hour and 15 minutes of [Joe] babbling incoherently." Now the world knows what lunch with Joe is like.
  - keithelder, on 06/18/2008, -1/+2Just be thankful he wasn't drinking when we recorded it! It would have been 3 hours! Bahaha!
  - joestump, on 06/18/2008, -0/+7Well played Trammell. Well played.
- ssn697, on 06/19/2008, -0/+2I wish, wish, WISH I had recordings (audio and/or video) or the Pshop programmers back in the day, rambling on in meetings, trying to convince everyone it was THEIR program now, not the Knoll bros.
  
  You are erudite in comparison. Own it baby!
  
  I enjoyed this, sadly ;-) Keep the front page podcasts coming!
- ucdesemuscles, on 06/19/2008, -0/+1Very good insights Joe! Thanks!
- BogusRed, on 06/19/2008, -0/+0Hi Joe,
  The feed link on your site joestump.net doesn't appear to work (the link at the footer of the page). I'd like to subscribe to your blog feed :D
  - joestump, on 06/20/2008, -0/+1Weird. Works for me in NetNewsWire on OSX.
melkirk, on 06/18/2008, -3/+7Joe rocks :)
jayadelson, on 06/18/2008, -2/+12Two words: Rock Star.
- ieure, on 06/18/2008, -1/+4Two more: A-List.
  - MikeSD34, on 06/19/2008, -0/+5Two more: Cheese Crackers
    
    I think I'm doing it wrong.
sfrench, on 06/18/2008, -2/+8I haven't listened to the whole thing yet, but I sure hope he didn't divulge where we get the magic pixie dust we sprinkle on the servers.
optimusprime01, on 06/19/2008, -3/+2Informative, to the point and worth the time.
metric7, on 06/19/2008, -2/+1It's down already
- metric7, on 06/19/2008, -1/+1whoops wrong place
- ssn697, on 06/19/2008, -0/+1that is because I am listening to it. I like me streams to be exclusive...
Ganja420, on 06/19/2008, -4/+6Podcasts make it to front page now??? wtf
ethornquist, on 06/19/2008, -4/+2I'm into computational linguistics so (believe it or not) this interests me.
ssn697, on 06/19/2008, -4/+4wait a sec. A digg architect talking about scaling, when I have to wait 5 minutes to get to my part of the comment thread, if the thread breaks 150 comments or so?

I call shenanigans!

/couldn't help a little ball busting...
- bronxelf, on 06/19/2008, -1/+1Better, a digg architect who doesn't know that "architect" and "architecture" aren't verbs. "Architected"? Seriously?
- MikeSD34, on 06/19/2008, -0/+3I don't like the comment loading the way it is right now either. In my opinion (and only that), AJAX shouldn't be used to pull in information on the initial page load. I've never seen it done that way anywhere else and liked it, and I don't think it plays well for the usability. The page has a tendency to jump around much more than it should while it's still loading.
  - ssn697, on 06/19/2008, -1/+3you can literally see the code working, as the page jumps up and down. Quit making me dizzy ;-)
    
    I can forgive spaghetti code at some level ( I worked on Illustrator before it was re-written. The horror, the horror), but we aren't THAT far into the story on Digg.
    
    I expect to see the latest iteration to improve in steps over the next few months. New code takes time, especially on this scale. That does mean I won't ***** on it for fun now and then ;-)
Brennan, on 06/19/2008, -2/+3Too bad that site doesn't scale
HomieG6189, on 06/19/2008, -1/+5http://www.joestump.net/
He writes some good blog posts on PHP, MySQL, etc.
ruddy, on 06/19/2008, -0/+8building applications for large scales is fun. you get to design solutions for problems that most people don't have, and it's a fun challenge.
ssn697, on 06/19/2008, -1/+1Nice tidbit on gearman. Thanks for that.

./blame.sh

pretty funny stuff
LanceUppercut, on 06/19/2008, -6/+5How about using a well tested hardened deeply integrated and superior file serving OS like Windows Server 2008 and IIS 7. Oh wait, this is digg, where if you actually buy a license or pay for anything, you are burned at the ***** stake. Layers of replication and load balanching are absolutely trivial with asp.net on IIS7 on WinServer 2008, so you don't need "Rockstars" to make the half assed ***** work that everyone uses because they blow their budget on the dude they keep around to order pizza and hump well lubed wax toilet gaskets.

Bitches.
- sfrench, on 06/19/2008, -0/+5You get a +1 for making me laugh my ass off.... the world needs more sarcasm.
  - h0dges, on 06/19/2008, -0/+0Oh yeah, more sarcasm, good one. pfft
    
    xD
- WomensUnderwear, on 06/19/2008, -1/+1dugg for truth
- fugazied, on 06/19/2008, -1/+2..and IIS makes a mean cup of coffee.
rushonerok, on 06/19/2008, -0/+1awesome interview!
perot9296, on 06/19/2008, -0/+2This is what I hate about MP3s or videos, no transcripts. I really dont want to listen to this podcast and hear a bunch of BS with a few trinkets sprinkled in. Even though I could listen to it while I'm at work, I wont.
- cwoodruff, on 06/19/2008, -0/+1We at Deep Fried Bytes are looking at getting transcripts for all episodes. Not a very affordable service so we are exploring options right now. Hopefully soon. We do listen to criticisms.
ivanbev, on 06/19/2008, -0/+3A very worthwhile listen for anyone who has to architect or deal with high-traffic sites - both the technical and management sides. Very pragmatic and objective technical discussion. Sounds like a great guy to work with, and a very interesting company to work for!
Livewired, on 06/19/2008, -2/+2VIM ftw!
samotage, on 06/20/2008, -0/+1Sweet! Some weekend entertainment. Thanks for sharing.
ProphetPX, on 06/25/2008, -0/+1My name is Ryan Hall, and once upon a time, I worked with Joe Stump and Keith Elder, oh about 10 years ago now, at a small computer company in Ann Arbor, Michigan, and Joe (and Keith too really) was super smart back then! I have yet to listen to this or read much of what he has been doing since then, other than finding out that he works at DIGG now. I wish I knew even half of what he knows about making websites ...

oh btw i found this digg post on Keith's blog post:
http://www.DeepFriedBytes.com/
DuncanSmart, on 07/03/2008, -0/+0Warning - 5 minutes of talking about the weather in some godforsaken part of the states at the beginning...
Login or register to add a comment

Create a new account or login to join in the conversation on Digg. You'll also be able to Digg stories to help promote things you like.

Deep Fried Bytes 4: Scaling Large Web Sites with Joe Stump

Login or register to add a comment