Tweak the Tweet
Project Twitter hashtag:
This project seeks to build a collaboration network to promote Tweet-friendly hashtag-based syntax to help direct Twitter communications for more efficient data extraction for those communicating about the Haiti earthquake disaster. Use only requires modifications of Tweet messages to make information pieces that refer to #location, #status, #needs, #damage and several other elements of emergency communications more machine parsable.
This syntax is constantly evolving. The link below describes current version. Please look at this as you work on the parsers. And check out recent examples. Parsers written during week one will miss many new tags - and a slight modification that reduced the number of tags for usability. Also, there are French tags defined and some examples out there (in the Twitterverse) to test on. Keep those in mind as well.
- Jacob Rothstein, jacob.rothstein(at)gmail(dot)com,
- Multi-site technical coordinator for Tweak the Tweet
- Kate Starbird, University of Colorado, catharine(dot)starbird(at)colorado(dot)edu,
- Syntax adoption, CO Coordinator
- Jeannie Stamberger, email@example.com
- Cities Interested:
- Portland, OR (Lots of Ruby folks planning to attend)
- Boston, MA (we've got Ruby folks, including a handful that know the twitter API)
- Assigned Project Manager(s) Across all Cities:
Silicon Valley - Jeannie Stamberger, firstname.lastname@example.org,
- Interested participants:
- Wiki Link: Tweak the Tweet
Subproject: Tweet Triage
Project Twitter hashtag:
Crowdsourced triaging oftweets so that aid groups can focus attention on tweets that need it.
- Project Lead: Seth
- Location of Lead: Boston
- Volunteers: MatthewG, James, Nat, Sam, and many others at Boston
- Web Link: Tweet Triage
Subproject: Sending to Sahana
Sending the Tweak the Tweet data to Sahana. The goal is to send structured data with arbitrary key/value pairs, where the keys are the hashtags and the values are what follow the hashtags.
- Tweak the Tweet Repository: http://github.com/lazylester/follow-that-bird
- Sahana Repository: https://code.launchpad.net/~d-launchpad-omer-bar-or-org/sahana/arbitrary-request-detail
- Location: Silicon Valley
- Volunteers: Claudia, John, Les, Omer
- Issue in Tweak the Tweet: http://github.com/jbr/follow-that-bird/issues#issue/1
- Mailing List
Boston folks should use GitHub/jamesarosen/follow-that-bird, which is a fork of the master repository. We'll then merge the into jbr's. The Boston efforts have a somewhat different focus -- see Tweet Triage.
See readme and issues)
How to Get Started
To pull Tweets: script/runner Tweet.poll_indefinitely
http://www.colorado.edu/news/r/1f74204947e4aeb86d328beb616ad826.html This project seeks to build a collaboration network to promote Tweet-friendly hashtag-based syntax to help direct Twitter communications for more efficient data extraction for those communicating about the Haiti earthquake disaster. Use only requires modifications of Tweet messages to make information pieces that refer to #location, #status, #needs, #damage and several other elements of emergency communications more machine parsable.
Jacob Rothstein, jacob.rothstein(at)gmail(dot)com, Multi-site technical coordinator for Tweak the Tweet
Kate Starbird, University of Colorado, catharine(dot)starbird(at)colorado(dot)edu, Syntax adoption, CO Coordinator
Jeannie Stamberger, email@example.com, Title
Ongoing work: Developers
Please contact Jeannie Stamberger to join the Tweak the Tweet google group, where we are continuing development work after the January 16th 2010 Crisis Camp
Ongoing work: Syntax
Each tweet needs to have both #haiti and one and only one primary tag PRIMARY TAG 1. #need [explain the needs using the appropriate keywords below] 2. #offering or #offer or #have [explain what you have using appropriate keywords below] 3. #imok [name] <reporting I AM OKAY> 4. #ruok [name] <asking ARE YOU OKAY?> 5. #trapped [name] 5. #injured [name] 6. #open [write what is open, a road? a hospital? a store? try to use keywords] 7. #closed [write what is closed? a road? a shelter? try to use keywords] .....<categories are growing; we are adding tags here as they appear on the wiki>
Tweets can have many data tags that allow us to create more detailed records DATA TAG 1. #name [name] 2. #loc [location] --> Text helps but if you can, provide GPS lat/long coordinates 3. #num [amount or capacity] 4. #contact [email, phone, link, other] or #con 5. #photo [link to photo] 6. #source [source of info] or #src 7. #status [e.g., open, closed, injured, etc.] 8. #date [date or time] 9. #info [other information] .....<categories are growing>
The following is a list of Searchable Keywords that can be classified. SEARCHABLE KEYWORDS supplies, food, water or h2o, fuel or diesel, medical of med, hospital, shelter, road, transport, rescue, help, volunteer(s) or vol(s), translator, security, information or info, communication or comm, open, close
Examples of tweets we're seeing - transcribed using the current adaptations of other Twitterers.
TWEET-BEFORE: Altagrace Pierre needs help at Delmas 14 House no. 14. TWEET-AFTER:#haiti #name Altagrace Pierre #need help #loc Delmas 14 House no. 14.
TWEET-BEFORE:Sherline Birotte aka Memen. Last seen at 19 Ruelle Riviere College University of Porter a 3 story schol building TWEET-AFTER:#haiti #ruok Sherline Birotte aka Memen. Last seen #loc 19 Ruelle Riviere College University of Porter #info a 3 story schol building
TWEET-BEFORE: Mirna Nazaire lives in P-A-P at Bizoton 6#12. Entire neighborhood without food. People are dying. TWEET-AFTER: #haiti #need food #name Mirna Nazaire lives in #loc PAP at Bizoton 6 #12 #info neighborhood w/o food. People dying
TWEET-BEFORE: roads from PAP to les Cayes are open migration from PAP to rural areas has begun TWEET-AFTER: #haiti #open roads from #loc PAP to les Cayes are open #info migration from PAP to rural areas has begun
Saturday 1/16/10 Volunteer Team
CrisisCamp Colorado Volunteers
- Kate Starbird, firstname.lastname@example.org
- Sophia B Liu
- Mark Chance
- Ricky Rainy
- Pranshu Arya
- Lee Becker
- Jennifer Gold
- Fiona Schlachter
CrisisCamp Silicon Valley Volunteers
- Paige Saez, Makerlab
, coordination, outreach
- Anselm Hook, Makerlab
, software architecture, programming,
- Erik Ostrom @erikostrom, programmer
- Jeannie Stamberger, @jstamb, coordinator email@example.com
- A. Karriem Kahn @ak2consulting, programming
- Chirag Shah
, programming - Developed a webservice that converts twitter data to PFIF (http://twitter-haiti.appspot.com/pfif?role=provide)
CrisisCamp Boston Volunteers
- Seth Woodworth, @sethish, firstname.lastname@example.org, coordinator
- User:MatthewG, lieutenant
- Sam Gilbert: @sam1vp, sam DOT o DOT gilbert AT gmail DOT com, developer
- External PR
- BBC Miami scheduling interview w/ Sophia of UC Boulder. **update - looking for another interviewee who speaks Kreyol.
- 1/28/10 : Noel Dickover interviewed by BBC Miami on overall project.
- News Organizations: contacted 9News, CBS4, Fox31, and CNN for local coverage of this event. Fox31 and 9News sent photographers for interviews. YouTube
- Denver News Channel 7 (Jan 20-21, 2010) - [ http://www.thedenverchannel.com/education/22298199/detail.html CU Students Author New Twitter Language for Disaster Relief] and Video
- Shiny Shiny (Jan 21, 2010) Twitter Hashtags that Can Help Organize Aid in Haiti
---> University of Colorado at Boulder News (Jan 20, 2010)
CU Grad Student's 'Tweet' Approach Streamlines Online Communications During Haiti Disaster: http://www.colorado.edu/news/r/1520cc2fd03a61d9140f927e4a29b11d.html
---> Colorado Daily (Jan 20, 2010)
CU-Boulder Grad Students Improve Haiti Communication Through Twitter: http://ow.ly/YPwo
---> NPR Andy Carvin (Jan 20, 2010)
@NPRNews Tweet about Tweak the Tweet: http://twitter.com/nprnews/status/7987153853
---> Tech-Ed Collisions by Jerry Leeson (Jan 20, 2010)
Tweak the Tweet: A Lesson in Standards Development: http://blogs.educationau.edu.au/jleeson/2010/01/20/tweak-the-tweet-a-lesson-in-standards-development/
---> IEEE Spectrum Tech-Talk Blog (Jan 20, 2010)
Engineers Race to Restore Communications After Haiti Quake: http://spectrum.ieee.org/tech-talk/telecom/internet/engineers-race-to-restore-communications-after-haiti-quake
--> IndyPosted: The New Media (Jan 20, 2010)
Hacked Hashtags Offer Twitter Help for Haiti, Other Disasters: http://indyposted.com/9284/hacked-hashtags-offer-twitter-help-for-haiti-other-disasters/
---> ReadWriteWeb (Jan 19, 2010)
Tweak the Tweet: New Twitter Hashtag Syntax for Sharing Information During Catastrophes: http://www.readwriteweb.com/archives/a_new_twitter_hashtag_syntax_to_help_during_catast.php
---> CNN (Jan 19, 2010)
Tech Camp Yield Programs for Haiti: http://edition.cnn.com/2010/TECH/01/19/tech.camp.haiti/index.html?hpt=T2
---> Smart Mobs Blog (Jan 19, 2010)
Project EPIC: Helping Haiti / Tweak the Tweet: http://www.smartmobs.com/2010/01/19/project-epic-helping-haititweak-the-tweet/
Tweak the Tweet: las Redes Sociales, Útiles en crisis: http://www.adivor.com.mx/blogmarketingeninternet/marketing/tweak-the-tweet-las-redes-sociales-a%c2%batiles-en-crisis/
---> Tech News Daily (Jan 19, 2010)
Tweak the Tweet: New Twitter Hashtag Syntax for Sharing Information During Catastrophes: http://tndaily01.blogspot.com/2010/01/tweak-tweet-new-twitter-hashtag-syntax.html
---> Chris Messina's FactoryCity Blog (Jan 18, 2010)
Designing Hashtags for Emergency Response: http://factoryjoe.com/blog/2010/01/18/designing-hashtags-for-emergency-response/
---> Stowe Boyd (Jan 18, 2010)
Disaster Microsyntax: Project EPIC, Tweak the Tweet, and Emergency Codes: http://www.stoweboyd.com/message/2010/01/project-epic-and-disaster-microsyntax.html
---> Manus Tungare Blog (Jan 18, 2010)
Simplified Twitter Microsyntax for the Haiti Earthquake: http://manas.tungare.name/blog/simplified-twitter-microsyntax-for-the-haiti-earthquake/
---> Chris Messina aka FactoryJoe (Jan 18, 2010)
Tweak the Tweet Flickr Image: http://www.flickr.com/photos/factoryjoe/4285526524/
---> Emergency Management Blog (Jan 16, 2010)
---> Pop Tech (Jan 16, 2010)
You Can Help a UN Citizen Ambassador in Haiti: http://www.poptech.org/blog/you_can_help_a_un_citizen_ambassador_in_haiti
---> Fox 31 Denver (Jan 16, 2010)
Crisis Camp Colorado: http://www.youtube.com/watch?v=uvLeTm1_hoU
---> Boing Boing (Jan 15, 2010)
Haiti: News Roundup, New Satellite Images, Tweets from the Ground: http://www.boingboing.net/2010/01/15/haiti-news-roundup-n.html
---> NPR Blogs by Andy Carvin (Jan 15, 2010)
Volunteer Techies Needed to Participate in Haiti CrisisCamp: http://www.npr.org/blogs/inside/2010/01/this_saturday_volunteer_coders.html
---> Daily Camera (Dec 3, 2009)
'Tweak the Tweet' Wins Second Place Technology Award for CU Graduate Student
---> University of Colorado at Boulder News (Dec 3, 2009)
'Tweak the Tweet' Earns CU Graduate Student Second Place in National Technology Competition: http://www.dailycamera.com/ci_13917948
---> Cnet (Nov 15, 2009)
Hackers Create Tools for Disaster Relief: http://news.cnet.com/8301-27080_3-10398073-245.html
- 1. Building tools
Results from CrisisCamp CO - Sat Jan 16 Develop quick tool to use to rebroadcast tweets to demonstrate concept. Crisis Camp volunteers are working to develop apps that process and re-distribute Tweets using the hashtag grammar onto web-based resources. At this point, we've created a few small apps that process tweets and post info to the web. We are working still on geo-locating tweets with location information and for classifying information according to different tags: needs, offering help, missing person reports, etc.
- This app uses the Twitter Search API to gather tweets using the TtT syntax, sorts them by certain primary tags, and displays them at http://twitagsearch.appspot.com/need, /locations, /ruok. Code would benefit from searching for terms w/o # before search terms.
See the following links for small examples:
Develop script that parses tweets into a table of key, value pairs according to the hashtags used.
- This app parses a string from a tweaked tweet and returns a python dict (hash table) of key, value pairs between hashtag and its arguments.
Status: Spread the word
Application to Tweak the Tweet
We are actively trying to seed the Twitterverse with prescriptive examples and tweets incorporating real information about the event using the TtT syntax. This has led the adoption of the syntax by a group of Twitterers willing to translate other information into tweaked tweets. We have identified few tweeters on the ground, and believe that adoption of the TtT syntax from those people at this time is unlikely - and not something that we are actively pushing. Second wave tweeters, those arriving now from other places with mobile phones are more likely sources for direct TtT tweets. Another source are the people in the Twitterverse willing to retweet messages from Twitterers on the ground and other sources into the TtT syntax.
One goal of our project is to see more Haitians connected to communication technologies from the ground. We have talked to people here in the US who are still having trouble contacting their loved ones from the states, and have heard of their relative unable to connect from Haitian locations to other Haitian locations. One way to address this would be to help state-side Haitians or those connected to the Haitian community create Twitter accounts and connect them the phones of their relatives/loved ones - leveraging the simple power of Twitter in its intended form to help people connect. We intend to pursue this in the near future.
On Friday, January 15th, I (Sophia Liu, CO) mentioned some of the primary twitter users that appear on multiple Twitter lists and began spreading the word about Tweak the Tweet. I have been pulling back from asking some of these on-the-ground Twitter users to use the Tweak the Tweet syntax because these people are not just tweeting only need and offering issues but rather their emotional experiences and human feelings from this event that just does not follow the current syntax we have. These people are going through some really hard times and asking them to use this syntax I do not believe will happen that easily and it does not always feel appropriate. Instead, what we have observed is the emergence of Tweaking Volunteers in the Twitterverse helping us to monitor these users and lists and Tweak the Tweets that seem to have the information we need to fit our current syntax. Tweak the Tweet is still an emerging practice and we have yet to see what other practices and types of users will emerge from these efforts.