Shopzilla's Site Redo - You Get What You Measure

Keynote , Web Performance
Location: Regency Ballroom Level: Novice
Average rating: ****.
(4.12, 26 ratings)

Founded in 1996, Shopzilla is a leading comparison shopping service. The company’s mission is to enable shoppers to quickly and easily find compare and buy anything, sold by virtually anyone, anywhere. Each month, Shopzilla connects millions of consumers with thousands of stores. On Cyber Monday 2008, Shopzilla was proud to be ranked by ComScore as the #1 Comparison Shopping Engine and #11 overall retail site (as measured by average daily unique visitors: 1.95M).

In the summer of 2007, Shopzilla decided to finally do something about the fact that our websites ( and had become so slow for our users. Our original consumer sites were built on a monolithic design and had over 6-7 years become difficult to change and more difficult still to scale engineering teams to support. We had a platform with more than 6 years of accrued technical debt, but were presented with a classic dilemma for an established internet market player: Can we really afford the costs – real and opportunity – and the risks of re-engineering a site platform responsible for all of our revenue? Perhaps even more importantly: What will we really get from a site overhaul? Will the site really be faster? Can we really innovate more easily given a “better” software design? Will we even complete the project, or will we be forced to abandon it mid-stream? Will we make more money?


Just in time for the 2008 holiday shopping crush, Shopzilla successfully completed a 16 month re-engineering initiative and released and on a new site platform we call “site 2”. At the time of release, the sites’ functionally were the same as “before”, but the consumer experience changed dramatically. The following are some highlights of the many benefits realized by our re-engineering:

• Dramatically faster page load times for our users: The site 2 average full-page download time is now 1.2 seconds (sub-second above the fold) for – down from 6-9 seconds! (1.9 seconds for Bizrate due to banners).

• Huge improvements in availability: The “platform” is much more than the software. As we re-engineered the site platform, a significant area of design focus was on sustainability, support and management of the entire delivery ecosystem – from the software, to the people, to the systems. The result has been a significant increase in both uptime and availability. In Q4, 2008, our site availability was 99.97%, up from 99.51% in Q3 – and an average of 99.65%. In terms of innovation, we have been able to maintain this availability rate into 2009 while increasing our platform release velocity by more than 200%. After all, it doesn’t matter much if your site is fast if people can’t get to it…

• Significant decrease in total cost of ownership: The site hardware (server) stack for site 2 requires approx 10% of the physical resources of site 1. From a capacity perspective, even that 10% is overbuilt by 2.5x based on our capacity forecasts through 2009.

• We make (a lot) more money! Based on a number of factors which we will explore in the talk, the site 2 stack has delivered a 5% – 12% lift in top-line revenue (depending on traffic source and Bizrate vs. Shopzilla)! This revenue lift comes primarily from intra-session (financial) performance drivers, but also in part due to an increase in sessions from the search engines. (details in the talk :)

Our talk will explore Shopzilla’s site 2 initiative in great detail. We will discuss:

• The Shopzilla site (2) architecture – A detailed and highly technical review of the technology choices made by the Shopzilla team, the trade-offs and the architecture itself. We will also take a frank look at wrong turns, poor choices and lessons learned in the design and implementation process.

• You get what you measure – Why any team should obsess over this concept – from technical SLA’s to financial performance metrics.

• What actually made the difference – A discovery of what really matters. Remember that part of our initiative was focused on simply making the site easier to support and innovate. In retrospect, what where the key drivers of our performance gains (both technical and financial)?

• How to sell an initiative like this. We will discuss how the technology leaders at Shopzilla sold this initiative in the face of so many questions – and how we kept the senior leadership and company at-large excited for more than 16 months.

• The platform is bigger than the software – it includes the infrastructure, the people and the leadership.

Photo of Philip Dixon

Philip Dixon


Phil Dixon is the VP of Engineering for one of the largest and most comprehensive shopping networks on the planet. Each day millions of consumers shop for virtually anything via our websites, and and our publisher network.

Prior to Shopzilla, Phil was co-founder, director and CTO of — a premier provider of Enterprise Project Management software. From its inception in 1999 to over 200,000 seats deployed worldwide, Phil was a driving force behind the company’s launch, its technology innovation, its sales success and its eventual sale.

A serial entrepreneur, Phil also founded or had senior leadership roles with numerous other high-technology companies including NetProfit Investment Technologies, Rockwell Semiconductor systems, Sourcefinder where he served as Chief Technology Officer; and Internet Services Corporation a full-service Internet services company.

Phil studied Advanced Mathematics and Computer Science at Carnegie Mellon University.

Phil has a family, lives in San Diego and has lots of varied interests including sailing, golf and flying airplanes (often to work!).


Twitter: @philipdixon

Comments on this page are now closed.


Picture of Philip Dixon
Philip Dixon
06/26/2009 7:01am PDT

Thanks for the feedback! Once we get our blog going, I’ll post a link so we can share more details.

Picture of Nick Gerner
Nick Gerner
06/25/2009 1:34am PDT

One of my favorite talks. The data was great, connecting perf to biz metrics was WONDERFUL. I can take that back to the office and say that I’ve discovered a new way to increase revenue.

Tim Armandpour
06/24/2009 9:13am PDT

Philip – Great talk this morning. I’ve gone through the same re-do at my company (mod_perl to java) and we also saw material improvements in performance, ability to scale quickly, and overall maintenance of our code.

Thanks for sharing your experience.


  • Keynote Systems
  • Google
  • Shopzilla
  • Aptimize
  • Facebook
  • NeuStar
  • Rackspace Cloud
  • Schooner Information Technology
  • SoftLayer
  • SpringSource
  • Sun Microsystems

Sponsorship Opportunities

For information on exhibition and sponsorship opportunities at the conference, contact Sharon Cordesse at

Download the Velocity Sponsor/Exhibitor Prospectus

Media Partner Opportunities

Download the Media & Promotional Partner Brochure (PDF) for information on trade opportunities with O'Reilly conferences or contact mediapartners@

Press and Media

For media-related inquiries, contact Maureen Jennings at

Velocity Newsletter

To stay abreast of conference news and to receive email notification when registration opens, please sign up for the Velocity Conference newsletter (login required)

Contact Us

View a complete list of Velocity contacts