How to get data from Twitter using Webhook and Google cloud | C2C Community
Question

How to get data from Twitter using Webhook and Google cloud

  • 13 September 2021
  • 2 replies
  • 23 views

I’m having problem getting data from Twitter via webhook using Google Cloud service. I tried different google cloud services such as Cloud run, Pub/sub, server less functions.

Any suggestion and direction would be helpful. Thank you.

 


2 replies

Userlevel 7
Badge +37

Have you tried any of the following ways?

https://medium.com/google-cloud/twitter-analytics-part-1-801c9d494487

https://medium.com/google-cloud/stream-twitter-data-into-bigquery-with-cloud-dataprep-73aa8998fcc1

https://github.com/twitterdev/twitter-for-bigquery

https://cloud.google.com/blog/products/data-analytics/real-time-cdc-replication-bigquery?utm_source=twitter&utm_medium=unpaidsoc&utm_campaign=FY21-Q2-Google-Cloud-Blog&utm_content=cdc&utm_term=-

https://www.syntio.net/en/labs-musings/streaming-data-from-twitter-to-gcp

Userlevel 5
Badge +5

Hi @Corinne David 

There are several ways to do that, the approach depends on the amount of data, the retention, if you need realtime data, who is going to consume the data, etc…

If its a personal project and you don’t need all that powerful GCP features you can try using a Google spreadsheet with Zapier to get the data and analyze it with Google Data Studio.

Let us know which route you chose!

Reply