Wednesday, December 15, 2010

Final Project and Paper - December 15 2010

Intro:

The dropping of the two American nuclear bombs at the end of the second world war is one of History's most signifigant military milestones, as it was the first tested form of nuclear warfare.  I have gone in depth to analyze all the data I could find relating to the subject.  My hope is to remediate the data in such a way that it is not only understandable but now more efficient than it was before.  I have done this through a multi-step process involving my first video, scanned and digitalized copies of top secret US military files,  photographs, speeches from both sides and pertinent statistics. 

Video (digitization and remediation):
 


Some Additional Scanned Documents:

Unclassified Occupation Report (USA in Japan, unknown year)
New York Times, August 6th 1945
Wartime map from USA, battle positions shown (1944)
"Leaflets" explaining nuclear radiation for the residents of Nagasaki 


 Graphs:

Bubblelines:
Timeline:
A Word Cloud for the Potsdam Agreement:


 Google Map of Ground-Zero Hiroshima and Memorial:

View Larger Map
Google Map of Ground Zero Nagasaki and Peace Park:

View Larger Map

Sunday, November 28, 2010

November 25th - Progress Report

I have began researching databases relating to my proposed project to try and gain ideas.  Seeing the flaws and perfections of similar databases provides a great point of reference.  I have recently overcome illness so I budgeted my time accordingly to ensure I will complete the assignment on time.  The notes I have taken from these sources have contributed a great deal to help develop innovative and new concepts in order to simplify the process of research.  So far I have had no issues staying on schedule and I hope to have my final product finished within the end of this week.

Thursday, November 11, 2010

Nov11 - Project Pitch

For my final project I plan on assessing a historical event by analyzing it and displaying the data that is pertinent through visual aids.  I chose the event of President Truman dropping the atomic bomb on Hiroshima and Nagasaki, Japan to end the second world war in 1945.  I chose such an event because there are tonnes of accessible resources and information such as speeches, medical data and political effects which can be analyzed to better understand the events that took place.  Examining historical documents such as the Potsdam Declaration and the San Fransisco Peace Treaty will be very interesting to look at because of their political and historical signifigance.  There are also resources such as the transcript of Truman's bombing announcement and audio clips of his actual speech.

Tuesday, October 19, 2010

Text Analysis and Data Visualization Exercise Oct19

   W.W Denslow's Three Bears (1903)

Three Bears is one of the world's oldest and most treasured ferry tales which has been passed on for centuries since it's original narration in 1837.  I chose it because it is a simple and familiar example which is very helpful when learning new software. By using text analysis and data visualization tool, Voyeur Tools, it becomes simple to determine that the most commonly used subject term is "She" (19 times) followed by "Bear" (18 times) - now we can ask ourselves is this story really about three bears or is it about a girl?  We scroll down the list of frequently used words and determine that "Bears" plural is used twelve times, and "Girl" as an alternative to "She" is only used twice.  So far, we've collected the story is going to be about bears.  In order to cut down on the time and inefficiency of multi-checking a word frequency list, the best sollution is to make a quick wordle.  Entering the text in to a wordle will give you the same word count results but it also provides a handy visual which can help the reader determine what groups of words will be used frequently as a general idea of how many times.  I would say Voyeur Tools is an excellent program when it comes to text analysis but I would also be wary of revlying solely on it because of its lack of features.  


Next, I used ManyEyes and it's many tool sets to further analyze the text.  I started out with the word tree application to analyze my data set.  By entering a phrase in the search box, a user can find out not only how many times that phrase is used but also every sentence which is started by the search term.  Displayed through the form of a tree (seen below), the user also has the option to narrow the search by clicking the next word in a possible sentence.  For example if you search "three" you can then click "bears" to find out all sentences that start with "three bears".  Or you can click "beds" to find out what's so important about the three beds, or who they belong to.  Next, I chose to search "she" because the Wordle determined it was the most frequent term.  One might do this in order to learn everything there is to know about the main character.  By clicking "She->Went" I could find out in seconds everywhere "she" (Goldie Locks) goes.  This type of technology would be ideal for the Police.  It could be used to screen a violent paroled convict's text messages and emails for unsafe terms like "drug", "meet", "hurt" or "beat" which would lead the police to only incriminating messages.  This would be a great alternative to manual screening through dozens of pages of text.  


Lastly, I used the phrase net tool:

The phrase net is unique, as it crosses the visuals of a word tree and a wordle.  It shows the frequency of the words in their size while it also shows the concordance of the words through arrows.  The user can also choose to narrow results by selecting in particular what word the arrow should represent.  For example if you entered, "The", it would yield every sentence where "the" is used between two words (i.e, liked --- porridge, ran --- water, over --- woods).  By doing this, you can find correlation hidden deep in texts by having clear visual word groupings which are all related (i.e if you enter "girl" and you get many intelligent ---- told, or similar results you can presume the girl is going to be smart).  Though an effective combination of Wordle and word trees, analysis is more centralized when all of the tools are used individually.

Blog Post for Oct14


Our group chose to analyze assorted types of text and data because the program we were assigned to use, ManyEyes is efficient when visualizing all kinds of data. We used everything from charts and graphs to display things such as the 2008 demographics of Hawaii and crime rates in developing countries while we used word trees and word frequency applications for written texts.  


We used the word-tree application to analyze a text about Denmark.  Every time we would enter a word like "economic", you would return sentences like "economic... downturn in Denmark will diminish industrial production".  The word tree seems useful in determining if a topic of interest lies deep in a text.  For example, if there's a journal about Canada and its Climate and you want to see if they will be referencing climate change or the actual Canadian climate more, you could enter "climate".  Results would either be "climate... change is something Canadians must reverse" or "climate... in northern Manitoba seems to vary slightly through the spring months". After using the word tree as well as the other graphs and charts that were available, I determined that this application would be the most useful at text analysis, so long as you know what you're looking for.  I would say that among the data visualization tools, the clouds were pretty useful by taking data and grouping it into different sized and coloured clouds to represent different proportional values.


For my text analysis and data visualization exercise I plan on assessing W.W Denslow's "Three Bears".  A classic ferry tail of which I have familiarity will be perfect for this sort of analysis.  I think I will be using Wordle and ManyEyes in order to analyze the text due only slightly to familiarity, I feel ManyEyes has several tools which would be ideal for this kind of review.  

Tuesday, October 5, 2010

LAB Assignment-Oct5

When scanning quickly through the article, words such as "job", "employment" and "education" tend to jump off the page due to the article's theme.  I collected from the title that the article would discuss the importance, or irrelevance of a paper degree.  More specifically the text is presumed to outline the competition and competitiveness of the current job market and the path which one needs to take in order to succeed in a professional field.  After processing the wordle I found the most common words tend to be "a", "the", "of" etc.   The most common content word however is "education", not to my surprise.  When removing the "a"s and "the"s, I was left with the more prominent and relevant terms such as, "Education", "College" and "Job" which appear (11, 10 and 8 times respectively, much ahead of the other terms.  Although on the other hand, I was reviewing the list of common words and stumbled across "you" which is used 33 times.  Despite "you" being a very common word that doesn't necessarily relate to any given topic, I gathered that the author must be writing about observed experiences rather than first hand.  The author seems very insistent on pushing "you" (the reader) into taking action, whether it be in the form of getting an education or not I knew the author was bound to have an insistent tone considering the volume of "you"s used in the text.  Then, notice how the author only used "I" 7 times throughout the entire read.
Stemwedel's "What's the Point of a College Education?"
Through my eyes this wordle reflects the importance of education, specifically college when it comes to life and getting a job.  Some vivid medium sized words include "particular" and "ability" which tells me the text is going to be case specific and it will stress the importance of becoming good at something "particular", like a "job" after attending "College" based mainly off of "facts" (used 6 times) as opposed to "fun" (used once). From what I see,  I would presume the author is in strong favour of post secondary education for the purpose of employment.
George Orwell's "1984"


 In George Orwell's 1984, the most common words are much different.  Before reading, I noticed the name "Winston" used several times through the first couple of paragraphs.  By reviewing the wordle however, it has been brought to my attention that Winston is the most commonly used word and since it's a name, I can now assume "Winston" will be the main character and he will last longer than the first couple of paragraphs as the plot develops around him.  Another phrase that popped out at me several times was, "Big Brother" and "Watching You".  Because the wordle shows these as medium-small phrases despite the fact the term is seen often, one will presume that the phrases are used less frequently as the text goes on as a result of the deceiving sample.  However, my imagined story was sad, dangerous or lonely as words like "cold", dust", "wind" and "Police" would rapidly appear.  On the other hand, if you remove these words you are left with meaningless and confusing terms which have less relevance.  Therefore, the importance of these sad and cold phrases is shown to be very strong as without them the reader would most likely become disengaged or confused which highlights the usefulness of adjectives.  Building upon text analysis and data visualization, one is able to utilize a wordle to not only do a word count, but to visualize the importance and relevance of each word and how it will tie into other ideas.  Though we still emphasize the concept of complete readings as opposed to text analysis becoming a feasible substitute, methods such as wordle become a key factor in quickly gathering a feel for a text before reading.  Like illuminating a cave, one would rather be sure of their footing before they step into something they're not familiar with, though the light will not navigate you through the cave, it will still give you an idea of where you stand.

Steve Jobs' Commencement Speech 2005

In the summer of 2005, Steve Jobs attended the Stanford commencement ceremony in order to deliver a historical speech.  Enclosed were parting words of wisdom from one of the world's most successful entrepreneurs upon a bunch of newly educated go getting whipper snappers.  Steve mentioned phrases like "college", "Apple" and "life" (the most common) throughout his speech, to no one's surprise.  Essentially, a man shows up to give a speech about life, and in this case Wordle agrees.  Before reading, I presumed the speech would contain personal anecdotes from Jobs' past and I was proven correct.  I tried to remove the words "life" and "college", the two high points of his speech and I'm left with a very dominant "Apple" and "Dropped".  Sure, Apple could help us determine the gist of the speech, but when you see "Dropped" and there's no "College" or "Job", the frequent "dropped" makes no sense in relation to the other words.  This wordle is an accurate guideline of the speech when left un-touched or edited.

Cecil Frances Alexander: Maker of Heaven and Earth
Before reading the text, it was clear from the title that the poem was going to be religious, and deal with God or the idea of creationism.  While briefly browsing the wordle, the theme is clear.  If you were to remove any of these popular words, the poem would look to have nothing to do with religion.  It is interesting to see words like "Lord" and "Almighty" in such small font when in a poem such as this which makes the reader believe it is possible the author called God "Lord almighty" once or twice, but prefers the term "God".  Unfortunately the poem isn't very long so there is only so much text analysis that can be preformed before just quickly reading the actual work which takes no more than 30 seconds. This shows me that wordles may be very useful for longer works, but it's almost worth it to just read a short work to get the gist, so long as you're on the right track.

Eric Grills' Facebook Wall
When composing a wordle based upon my Facebook wall, I presumed I would see my name, either Eric or Grills used extensively throughout the text.  Like thought, Eric and Grills were indeed the most common words with the exception of "Remove".  I was surprised to see "remove" as the most common word.  From this, I gather Facebook has made it very easy to hide or delete things you don't want others to see, promoting itself as a "safe" form of social networking.  I ended up removing "Remove" so I could confirm that my name was the most frequently seen phrase, when I noticed Commented is also a huge one.  This tells me that commenting, and people's opinions must be a corner stone of my FaceBook wall, which is true, without comments we have nothing.

Add caption


This wordle, composed of an Essay I wrote last year on the Climate Change Conference in Denmark.  The conference itself is known as a useless convention in which world leaders meet and discuss pretty much nothing until they sign a sheet of paper that makes their Nation slightly more egotistical.  My job was to find the truth about the conference.  I concluded that the conference is indeed necessary, although I do believe it is very difficult to tell from a wordle.  This is because most of the words I would generally use to support or negate the topic would be similar regardless the case in which they were used.   Although, notice how I use very few doubting words, such as "false" or "lousy".  Mostly all of the larger words are supporting the idea of a conference, such as "Effort", "Help", "Order" and "Global Pact".  I tried removing "climate change" and "global warming" from the wordle and was left with a bunch of country's names and random adjectives.  Had I scanned the wordle with these words removed, I might have gathered a different interpretation of the text all together, figuring it could be an essay about geography, or great world wars.

This wordle of the famous song, "Shook Ones Part Two" by the infamous group Mobb Deep is clearly from the rap genre.  Judging from words like "ain't", "crooks", "death", "money" and "yo" we can tell the song is going to be about illegal activity.  By removing key words such as, "Crooks", "Shook" and "Scared", the selection is still clearly going to be a rap song.  I also noticed that the words from the chorus, "you scared to death, scared to look, you shook cause there ain't no such thing as half way crooks" are defiantly the most common because they appear frequently throughout the song.  I used Tag Cloud as well as Wordle for this song and I was surprised to see the difference.  Wordle in my opinion is much better, I prefer the ability to change the font, text and colours as well as arrangement of text.  In Tag Cloud, you must view the selection in standard horizontal text, with some words bolder and bigger than other.  I defiantly see how the "word search" like pattern is much easier to look at and have words jump out at you.  I also like how there are different font colours so different words stand out better.

Tuesday, September 21, 2010

LAB Assignment - Sep21

1) Discuss how you and your partner chose the object that you did (because of a common interest, perhaps?)
  • Netflix is truly revolutionary, considered by some as an impossible alternative to the video store, run simply through your local mail office.  The system they have implemented has baffled me for years, being one who considers "through the mail" businesses too much of a liability from the operator's end.  My goal with this lab assignment was to research exactly how Netflix was successfully launched and thrived in a market of uncertainty.  In order to do this, I will be examining the remediation of digital media rentals.  I will find out how they have earned the business of thousands of customers, taking away from the "Blockbuster Empire" which is known to have outlets peppered throughout suburbia.
2) Discuss the specific steps that you took to find the object (web search, did you already know where to look?, etc.)  
  • Already being familiar with the concept of mail order movies, I had a prior knowledge of Netflix.
3) Include a picture / video clip / etc of that object

4) Expand upon the answers you walked away with in Tuesday’s lab.
  • Up until recently, in order for a consumer to rent any form of digital media it would require about five dollars, a half an hour and a ride to your local video store.  Netflix, founded in 1997 has became a remediated form of loaning out games and movies on a "we come to you" basis.  Eliminating the need for their couch potato cliental to travel in order to rent that late night movie, Netflix has captured the hearts of millions of users.  Realistically, the biggest obstacle presented when renting a movie is traveling to the store and returning the disc on time in order to avoid pesty late rental return fees.  Netflix has effectively removed this obstacle by offering movies and games through the mail.  Consumers open very affordable accounts based upon a system of unlimited rentals, they choose a movie or game online through the Netflix website, abracadabra, 24 hours later your title is in your mailbox, then when you're done drop it in the mail with it's prepaid postage and the movie is returned to the Netflix warehouse.  By keeping the customer's credit card on file in their account, late fees become obsolete. If a customer has an account that entitles them to unlimited rentals for $X/month, and chooses to not return a rented movie after 30 days of rental, it will be replaced using their financial collateral (credit cards etc.)  This form of remediation not only makes digital media more accessible, but also makes the process more relaxing and worry free, transferring all responsibilities of renting from the customer to the operator.  Though this form of renting is much more convenient and simple, there will always remain those who would rather go to the store, physically view what is available to them, ask the counter clerk for recommendations on good new movies etc.  Therefore, it is clear that this form of remediation is emphasizing the availability of said media rather than replacing the concept of renting.  This form of remediation is also seen as an older medium (renting from a store, browsing isles, asking employees for assistance) being represented in a newer and simpler digital form of keyword searches and paperless purchasing.