{"id":625,"date":"2010-02-22T21:48:30","date_gmt":"2010-02-23T05:48:30","guid":{"rendered":"http:\/\/www.spreadingscience.com\/2010\/02\/22\/getting-at-data\/"},"modified":"2010-02-22T21:51:39","modified_gmt":"2010-02-23T05:51:39","slug":"getting-at-data","status":"publish","type":"post","link":"https:\/\/www.spreadingscience.com\/2010\/02\/22\/getting-at-data\/","title":{"rendered":"Getting at data"},"content":{"rendered":"

Four Ways of Looking at Twitter
\n<\/a> [Via HarvardBusiness.org<\/a>]<\/span><\/span><\/p>\n

Data visualization is cool. It’s also becoming ever more useful, as the vibrant online community of data visualizers (programmers, designers, artists, and statisticians \u2014 sometimes all in one person) grows and the tools to execute their visions improve.<\/p>\n

Jeff Clark<\/a> is part of this community. He, like many data visualization enthusiasts, fell into it after being inspired by pioneer Martin Wattenberg<\/a>‘s landmark treemap<\/a> that visualized the stock market.<\/p>\n

Clark’s latest work shows much promise. He’s built four engines that visualize that giant pile of data known as Twitter. All four basically search words used in tweets, then look for relationships to other words or to other Tweeters. They function in almost real time.<\/p>\n

“Twitter is an obvious data source for lots of text information,” says Clark. “It’s actually proven to be a great playground for testing out data visualization ideas.” Clark readily admits not all the visualizations are the product of his design genius. It’s his programming skills that allow him to build engines that drive the visualizations. “I spend a fair amount of time looking at what’s out there. I’ll take what someone did visually and use a different data source. Twitter Spectrum was based on things people search for on Google. Chris Harrison did interesting work that looks really great and I thought, I can do something like that that’s based on live data. So I brought it to Twitter.”<\/p>\n

His tools are definitely early stages, but even now, it’s easy to imagine where they could be taken.<\/p>\n

Take TwitterVenn<\/a>. You enter three search terms and the app returns a venn diagram showing frequency of use of each term and frequency of overlap of the terms in a single tweet. As a bonus, it shows a small word map of the most common terms related to each search term; tweets per day for each term by itself and each combination of terms; and a recent tweet. I entered “apple, google, microsoft.” Here’s what a got:<\/p>\n

\"twittervenn.jpg\"<\/span><\/p>\n

Right away I see Apple tweets are dominating, not surprisingly. But notice the high frequency of unexpected words like “win” “free” and “capacitive” used with the term “apple.” That suggests marketing (spam?) of apple products via Twitter, i.e. “Win a free iPad…”.<\/p>\n

I was shocked at the relative infrequency of “google” tweets. In fact there were on average more tweets that included both “microsoft” and “google” than ones that just mentioned “google.”<\/p>\n

[More<\/a>]<\/p><\/blockquote>\n

Social media sites provide a way to not only map human networks but also to get a good idea of what the conversations are about. Here we can see not only how many tweets are discussing apple, microsoft and goggle but the combinations of each.<\/em><\/p>\n

Now, the really interesting question is how ti really get at the data, how to examine it in order to discover really amazing things. This post examines ways to visually present the data.<\/em><\/p>\n

Visuals – those will be some of the key revolutionary approaches that allow us to take complex data and put it into terms we can understand. These are some nice begining points.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

Four Ways of Looking at Twitter [Via HarvardBusiness.org] Data visualization is cool. It’s also becoming ever more useful, as the vibrant online community of data visualizers (programmers, designers, artists, and statisticians \u2014 sometimes all in one person) grows and the tools to execute their visions improve. Jeff Clark is part of this community. He, like … Continue reading Getting at data<\/span> →<\/span><\/a><\/p>\n","protected":false},"author":5,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","footnotes":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false},"categories":[3,4],"tags":[31,33],"class_list":["post-625","post","type-post","status-publish","format-standard","hentry","category-science","category-web-20","tag-science","tag-web-20"],"jetpack_featured_media_url":"","jetpack_publicize_connections":[],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/pe2yp-a5","jetpack_likes_enabled":true,"jetpack-related-posts":[{"id":406,"url":"https:\/\/www.spreadingscience.com\/2008\/10\/15\/many-eyes-many-brains\/","url_meta":{"origin":625,"position":0},"title":"Many Eyes = Many Brains","date":"October 15, 2008","format":false,"excerpt":"Many Eyes = Many Brains: [Via The Scholarly Kitchen] Socially networked data visualization becomes a reality with Many Eyes. [More]I've seen this before and it is a great idea. Lets make data visualization open and allow social networking approaches help come up with new ways to look at data. Visit\u2026","rel":"","context":"In "Open Access"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":272,"url":"https:\/\/www.spreadingscience.com\/2008\/07\/11\/browsing-clouds-not-papers\/","url_meta":{"origin":625,"position":1},"title":"Browsing clouds, not papers","date":"July 11, 2008","format":false,"excerpt":"Commentary: Summarizing papers as word clouds: [Via Buried Treasure] The web provides entirely new avenues for decimating information and for visualizing it. It can be very time consuming to browse throught the literature, even though the most creative research often comes from the intervention of Serendipity (the Wikipedia article lists\u2026","rel":"","context":"In "Science"","img":{"alt_text":"","src":"https:\/\/larsjuhljensen.files.wordpress.com\/2008\/06\/kuh08nar_small.png?w=350&h=200&crop=1","width":350,"height":200},"classes":[]},{"id":89,"url":"https:\/\/www.spreadingscience.com\/2008\/04\/05\/discussing-science-20\/","url_meta":{"origin":625,"position":2},"title":"Discussing Science 2.0","date":"April 5, 2008","format":false,"excerpt":"by geishaboy500 Web 2.0 for Biologists-Are any of the current tools worth using?: [Via Bench Marks] David Crotty has been leading a discussion regarding the acceptance of Science 2.0 by scientists. Or rather the non-acceptance. It is ironic to use Web 2.0 approaches to examine why scientists do not use\u2026","rel":"","context":"In "Science"","img":{"alt_text":"","src":"https:\/\/i1.wp.com\/www.spreadingscience.com\/wp-content\/uploads\/2008\/04\/tools.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":520,"url":"https:\/\/www.spreadingscience.com\/2009\/05\/11\/five-researchers-2\/","url_meta":{"origin":625,"position":3},"title":"Five Researchers","date":"May 11, 2009","format":false,"excerpt":"I published a new version of my Five Researchers Helped by Science 2.0. Hope you like it. Technorati Tags: Science, Web 2.0","rel":"","context":"In "Science"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":82,"url":"https:\/\/www.spreadingscience.com\/2008\/04\/01\/going-live-slowly\/","url_meta":{"origin":625,"position":4},"title":"Going Live, Slowly","date":"April 1, 2008","format":false,"excerpt":"by m o d e This site will be coming alive over the next week or so. We have a lot to cover and want it to be done without overwhelming anyone. SpreadingScience will make it easier for researchers to deal with the tremendous amount of information that threatens to\u2026","rel":"","context":"In "General"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.spreadingscience.com\/wp-content\/uploads\/2008\/04\/construction.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":122,"url":"https:\/\/www.spreadingscience.com\/2008\/04\/18\/a-new-page-what-is-science-20\/","url_meta":{"origin":625,"position":5},"title":"A New Page - What is Science 2.0?","date":"April 18, 2008","format":false,"excerpt":"Well, Science 2.0 must be the next full release after Science 1.5.b13, right? Not quite. It takes its lead from applying Web 2.0 approaches to scientific research. So, what is Web 2.0? In 2005, Tim O\u2019Reilly described in detail what he meant by Web 2.0. Since then, there has been\u2026","rel":"","context":"In "General"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/www.spreadingscience.com\/wp-json\/wp\/v2\/posts\/625"}],"collection":[{"href":"https:\/\/www.spreadingscience.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.spreadingscience.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.spreadingscience.com\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/www.spreadingscience.com\/wp-json\/wp\/v2\/comments?post=625"}],"version-history":[{"count":0,"href":"https:\/\/www.spreadingscience.com\/wp-json\/wp\/v2\/posts\/625\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.spreadingscience.com\/wp-json\/wp\/v2\/media?parent=625"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.spreadingscience.com\/wp-json\/wp\/v2\/categories?post=625"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.spreadingscience.com\/wp-json\/wp\/v2\/tags?post=625"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}