Skip navigation

Twitter is useful for a lot of things. One of those things is information. I wanted to see if I could pull out the trash from the information. Answer, actually a really simple classifier with only about 300 labeled tweets can do a pretty good job. Right now it has no real interface except some output. I stopped work on the interface because it should be done in a web-technology, not processing.

Twitter...

Right now it will output something like the following, based on the last 20 public tweets:

btw, giving is def. hands down better than receiving . time to rest . gonna pray/talk with God . goodnight & Godbless world of twitter :]
charLength: 137  atCount: 0  punctuation: 9  linkCount: 0  RT: 0  percentCap: 1

A27 Almere richting Utrecht: Tussen knooppunt Almere-Stad en knooppunt Eemnes 7 km http://twurl.nl/wbrmuu
charLength: 105  atCount: 0  punctuation: 7  linkCount: 1  RT: 0  percentCap: 6

Sun K Kwak and her black tape installations http://tinyurl.com/c495jd
charLength: 69  atCount: 0  punctuation: 5  linkCount: 1  RT: 0  percentCap: 4

A27 Gorinchem richting Utrecht: Tussen afrit Lexmond en afrit Hagestein 4.7 km http://twurl.nl/qqhimi
charLength: 101  atCount: 0  punctuation: 7  linkCount: 1  RT: 0  percentCap: 5

Engadget Update: Sony PSP hacked for use as PC status monitor: 
No money for a secondary display.. http://tinyurl.com/dkteuk
charLength: 124  atCount: 0  punctuation: 10  linkCount: 1  RT: 0  percentCap: 7

TechRepublic - Fast Video Indexer 1.12 (Windows) http://bit.ly/4n8ZYp
charLength: 69  atCount: 0  punctuation: 9  linkCount: 1  RT: 0  percentCap: 11
6/20 were informative

It decided 6 of those 20 were informative, based on the following six features:

  • charLength: how many characters was the tweet
  • atCount: how many ‘@’ are in the tweet; these are used in twitter to indicate response
  • punctuation: the number of punctuation characters used
  • linkCount: the number of links …
  • RT: if ‘RT’ appears in the tweet, this means re-tweet, or indicates someone is directly repeating what someone else said
  • percentCap: the percentage (of 100) of capital letter in the tweet… indicative of shouting
Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: