Building a Business on Open Source Distributed Computing

Business, Emerging Topics
Location: Meeting Room B3
Average rating: ***..
(3.14, 7 ratings)

Visible Technologies is a Social
Media Analysis and Monitoring company. They collect millions of blogs
and other forms of social media, performing data mining and heavy
semantic analysis. Visible uses this data to provide advanced Business
Intelligence to many clients, including several Fortune 100 companies.

Visible’s MS-exclusive “2.x” platform is being replaced with a “3.x”
infrastructure built on software such as Hadoop, Nutch, Lucene,
Mahout, Solr, Zookeeper, HBase, ActiveObjects, and more. It’s provided
amazing agility and leverage for the R&D investment.

Bradford Stephens the Lead Engineer on the Data Platform team, which
is in charge of Visible’s distributed computing core.

We’ll be discuss the lessons learned along the way so others can avoid
going down the wrong path we once did (aka “RDBMS Hell”).

Presentation topics may include:
-The importance of “scale-out” over “scale-up” from business and
technology perspectives
-BI without SQL Server – it can be done!
-Overview of a collection, data processing, and document storage system
-Leveraging Hadoop, Lucene, Mahout, Nutch, Lucene, Zookeeper, HBase, and more
-MapReduce and the importance of high-latency, high-bandwidth computing
-Semantic Analysis on Social Media with Distributed Systems and Machine Learning

Apache’s “Cloud Stack” is enabling a new generation of companies to
process “Google-scale” data, promising to change the way we analyze
and use the web forever.

Photo of Bradford Stephens

Bradford Stephens


Bradford spends countless hours architecting distributed systems, designing social media analysis frameworks, and learning how to manage humans (when he’s not playing music or buried in a Space Opera novel).

He’s currently the lead engineer for the Data Platform group at Visible Technologies , where his team “is doing very large-scale things in the Social Media field”.

You can keep up with his pithy witticisms on engineering at Road To Failure.

  • Intel
  • Microsoft
  • Google
  • Sun Microsystems
  • Facebook
  • Gear6
  • Kaltura
  • Liferay
  • MindTouch
  • Novell, Inc.
  • Open Invention Network
  • Rackspace Cloud
  • Schooner Information Technology
  • Silicon Mechanics
  • Symbian Foundation
  • Twilio
  • WSO2
  • Yabarana Corporation

Sponsorship Opportunities

For information on exhibition and sponsorship opportunities at the conference, contact Sharon Cordesse at

Download the OSCON Sponsor/Exhibitor Prospectus

Media Partner Opportunities

Download the Media & Promotional Partner Brochure (PDF) for information on trade opportunities with O'Reilly conferences or contact mediapartners@

Press and Media

For media-related inquiries, contact Maureen Jennings at

OSCON Newsletter

To stay abreast of conference news and to receive email notification when registration opens, please sign up for the OSCON newsletter (login required)

Contact Us

View a complete list of OSCON contacts