Posts

Showing posts from December, 2017

7 - GCP to Tableau Finale

Image
7- Grand Finale - GCP to Tableau Objectives: Install and Setup Tableau Connect Final Thoughts Install and Setup Tableau Welcome to the final post that I will be making for this blog... more sentimental writing later on, for now DATA! Remember that this is our gameplan: Last post we handled the Twitter to NiFi to GCP part, now we just need to tackle GCP to Tableau. If you are a student, there is a free version of Tableau, a software for visualizing data, available to you at no cost. It is available here: https://www.tableau.com/academic/students Once you have Tableau, start a new book. Connect GCP to Tableau Your data is saved in a GCP bucket.  In order for Tableau to see it, it must be accessible through Google Big Query, so go into BigQuery and create a new table that points to the GCP bucket. So I'm running into a problem where BigQuery is denying me access to my bucket to build a table.  Without this table, we can't access it in Tab...

6- Finale Part 1: NiFi

Image
6 - Finale Part 1: NiFi Objectives: Current State of the Flow Processing Data Where's it all going? Current State of the Flow Before I get into this, I would like to briefly remind you what our goal is... Take data from Twitter and display it at some endpoint and try to make it look nice. Spoiler Alert: It's not working out for us this time, but we're going to put together the pieces so that it can happen in the future. Last post I said that we would be switching to using Tableau, and we're still going to try something with that... I'm not sure if it will work.  Now we are adding a step in the process: Google Cloud. What will the Google Cloud allow us to do? Google Cloud Platform (GCP) uses these objects called "buckets" to store information in the cloud.  NiFi has a PutGCP processor, which we will utilize to connect NiFi to GCP.  From there we should be able to connect up to Tableau, but that will be for next time. Here is a visual b...