Posts

Showing posts from November, 2017

5- Major Brick Wall

Image
5- Major Brick Wall Objectives: Address the Problem Find a Solution Begin Implementing Solution In his talk, which has become known as The Last Lecture, Randy Pausch discusses the many challenges a person faces in their life as they attempt to achieve their goals.  He calls them "brick walls" and says that they are there to help you figure out how to get around them.   We have hit a major brick wall. I am intentionally making this post uninteresting so that you skip it and go to the next post, which will solve the problems outlined in this post. Address the Problem The next step in our NiFi flow is to process the data we are getting from GetTwitter.  We know that it is providing us with a JSON file, which is great, but it is raw data.  This JSON file, unprocessed, is practically useless to us.  It provides us with WAY too much information, and some of the files that we are outputting are not even real tweets. Boiled down, the probl...