7 - GCP to Tableau Finale

-

7- Grand Finale - GCP to Tableau

Objectives:

  • Install and Setup Tableau
  • Connect
  • Final Thoughts

Install and Setup Tableau

Welcome to the final post that I will be making for this blog... more sentimental writing later on, for now DATA!

Remember that this is our gameplan:



Last post we handled the Twitter to NiFi to GCP part, now we just need to tackle GCP to Tableau.

If you are a student, there is a free version of Tableau, a software for visualizing data, available to you at no cost.

It is available here: https://www.tableau.com/academic/students

Once you have Tableau, start a new book.

Connect GCP to Tableau

Your data is saved in a GCP bucket.  In order for Tableau to see it, it must be accessible through Google Big Query, so go into BigQuery and create a new table that points to the GCP bucket.

So I'm running into a problem where BigQuery is denying me access to my bucket to build a table.  Without this table, we can't access it in Tableau.  We're going to accept this defeat and use a public dataset instead.

When you open Tableau, start a new book and click "Connect to Data", which will open all your connection options.  Use Google BigQuery.  You will prompted to sign in for authorization.  Once this is done, you will need to select a project, use your Billing Project, then use publicdata, samples, shakespeare.


So that's pretty sweet.  We have now connected Tableau to Google BigQuery.

Final Thoughts

I enjoyed this blog a lot and I hope you did, too.  We didn't run into too many issues until this end came along.  I hope you continue learning more about NiFi, as I know I will.  I am also interested in doing more with Google Cloud and the connections between NiFi are promising.

What I love most about Apache NiFi is that it is open source and thus it is always changing.  If something needs to be added to it, it can be added through the Github.  New content is always being developed in the NiFi community.

I hope you found this blog to be at least partially interesting, and I'm sorry that I've failed to deliver on the final product.  Maybe another time I'll revisit this blog and be able to fix this problem.

Thanks for reading this blog post!

Until next time...
Take it easy, Dude.
(^ This is a movie reference, props if you got it ^)

Comments

Post a Comment

Popular posts from this blog

1 - Getting Started with Apache NiFi

-
Image
Getting Started with Apache NiFi Objectives: Learn about history of NiFi Install NiFi Start up NiFi for first time on local machine NiFi Overview: The project was created by the United States' infamous National Security Agency (NSA) and had the codename "Niagarafiles".  In 2014 the NSA released it as open-source software.  The primary developer of the project so far has been Hortonworks who are also well known for Hadoop and their suite of data science software. At its core, Apache NiFi is used to manage data flow.  This means that its job is to take in data, process it, then send it along to another destination.  Think of it as a mail service for data.  One of the advantages that it has is that uses a web based interface that is simple and allows users to manage the data flow in real time. Installing NiFi: I am installing NiFi on my Windows 7 PC, installing it on a Mac or Linux OS will follow a different procedure.  Also of note: We w...
Read more

2 - NiFi: UI, Processors, and Flow

-
Image
NiFi: UI, Processors, and Flow Objectives: NiFi Web UI Overview Create a processor and flow Start a flow NiFi Web UI Overview: First things first, fire up your local NiFi instance by running the run-nifi.bat file in the bin folder.  If you are new here, starting up the instance is detailed in the previous blog. Open up a web browser and access the NiFi UI on your local machine by going to this url: http://localhost:8080/nifi You should see your empty NiFi flow which is in the root Process Group.  A NiFi Flow is the whitish grid area.  This first flow is in the root Process Group, meaning everything is contained within this initial root flow.  Process Groups can be nested within each other, so we can make Process Groups within the root Process Group... Your screen should look like this: Blank NiFi UI On the top dark blue bar, you have several buttons that can be used to drag various items into your NiFi Flow.  Those items include: ...
Read more

4- Moving Data Out of NiFi

-
Image
4- Moving Data Out of NiFi Objectives: Examine data in Queues from GetTwitter Create flow from GetTwitter to Local Folder Use Templates to Create Multiple Flows Examine data in Queues from GetTwitter Last time we successfully pulled data from a Twitter account into our local instance of NiFi.  We are going to pick up right where we left off, so the NiFi Flow should look something like this (I have removed the GenerateFlowFile to Log Processors): So if you run the GetTwitter Processor without turning on the LogAttribute Processor, you will see the Queue in the link between the processors fill up.  You'll notice in the above picture that I have 976 files queued. Using these Queues is a good way to look at the data before it reaches a processor, which will be useful when debugging a problem when moving files through multiple processors in a larger flow. To see a file in the Queue, right click on the Queue, and click on the "List queue" option.  You will...
Read more