DataSift Takes Big Data Analytics of Social Networks to the Next Level

We all know data is growing at an astronomical pace. By many accounts, the sheer amount of data coming at us is overwhelming. According to one survey, enterprises today create only 8% of the entire data set they consume. That leaves quite a bit of external data to collect and process. Increasingly, for many this data is coming from Social Media. The concept of Big Data does address these large, growing datasets. However, challenges still await the social media data landscape.

Enter DataSift, a UK-based startup launched in November 2011. Since then, they’ve covered quite a bit of ground and just secured an additional $7.2M this week. I had the opportunity to sit down with Rob Bailey, CEO of DataSift at the Under The Radar conference last week to discuss the company and their value proposition. Rob confirmed that “data is exploding” and while many companies are able to track sentiment of social networks, DataSift is able to provide the “metadata of social data platforms through the aggregation of social data platforms.” Simply screen-scraping data from social networks provides one level of value to users. By using “augmentations of the data using geo, sentiment, meaning and context”, DataSift is able to provide a much richer context to clients. It is this very metadata or relationships between data, over time that starts to get interesting.

According to Rob, the challenge facing DataSift is people understanding the space. Bringing different data elements and considering the metadata of social networks is an exercise in thought. Integration of massive data streams and context on the data present an interesting challenge. These challenges could be addressed over time with adequate resources. However, providing trending information from the variety of data social media sources, with context, in real-time is valuable.

Analytics of data performed by data scientists is one approach. For everyone else, gaining ready access to valuable data sources and making sense of them in real-time is one area to watch very closely.

Tim Crawford is ranked as one of the Top 100 Most Influential Chief Information Technology Officers (#4), Top 100 Most Social CIOs (#7), Top 20 People Most Retweeted by IT Leaders (#5) and Top 100 Cloud Experts and Influencers. Tim is a strategic CIO & advisor that works with large global enterprise organizations across a number of industries including financial services, healthcare, major airlines and high-tech. Tim’s work differentiates and catapults organizations in transformative ways through the use of technology as a strategic lever. Tim takes a provocative, but pragmatic approach to the intersection of business and technology. Tim is an internationally renowned CIO thought leader including Digital Transformation, Cloud Computing, Data Analytics and Internet of Things (IoT). Tim has served as CIO and other senior IT roles with global organizations such as Konica Minolta/ All Covered, Stanford University, Knight-Ridder, Philips Electronics and National Semiconductor. Tim is also the host of the CIO In The Know (CIOitk) podcast. CIOitk is a weekly podcast that interviews CIOs on the top issues facing CIOs today. Tim holds an MBA in International Business with Honors from Golden Gate University Ageno School of Business and a Bachelor of Science degree in Computer Information Systems from Golden Gate University.

0 comments on “DataSift Takes Big Data Analytics of Social Networks to the Next Level

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.