Connect
Articles
Events
About C2C

Home
Community overview
Google Cloud Platform Solutions and Technologies
Data Analytics

Data Analytics

Configure highly available data and real-time analytics to optimize performance, improve decision-making, and unlock new value.

86 Topics
72 Replies

Subscribed members will receive emails when there is a new post in this community category.

86 Topics

Recently active

Most replies Most views Newest first

fhkCommunity Member

asked in Data Analytics

Is anyone else using or-tools on cloud functions/run?

There is a huge domain of using optimization to solve business problems. My company is using optimization including https://developers.google.com/optimization to solver broadband network design and funding. I’m very interested to learn if anyone else is using it and how.

4 months ago

apouxCommunity Member

asked in Data Analytics

Big Query - How to create an external connexion to only one table from the database ?

I created connected sheets with Big Query. But when building the retreive we can write any request to the database. In my point of view, that is creating a security breach.How can I manage a connexion to a single table in BigQuery ? Thank you for your answers

5 months ago

AlfonsC2C Team Member

posted in Data Analytics

NEW DATE SpringML will be speaking in our next AI & ML Coffee Chat - Mon, 31 January

Hi all,Next friday our friends from SpringML will be talking about “Addressing the Supply Chain Crisis with AI”. During the last two years since the world first fell into the COVID-19 pandemic, we have seen a number of disturbances throughout all of the industries. One in particular was the dramatic impact on the supply chain worldwide and the effects on all consumers. Join SpringML as we discuss how combining artificial intelligence with a number of additional technologies and innovations, can be the answer to addressing consumer demand, labor shortage, and preventative measures.I hope to see you all there. It will be time for questions and comments!

5 months ago

parentiv

asked in Data Analytics

UTC to User timezone in Google Data Studio

Hi All,I have a bigquery table which stores data from Firestore. Firestore stores all the timestamps in UTC timezone. Is there a best practice how I can display those timestamps in user timezone (not in UTC timezone) in Google Data Studio Dashboards?I would like to avoid converting the timestamp adding another field such as CreatedDateNY (using DateDiff). regards,Manish

5 months ago

RambabuyadavCommunity Member

posted in Data Analytics

gmail recovery

Problem with my previous email id ramdevy360@gmail.com I have recovery mobile number but Google ask to email verification code which was already lost(ramdevy360@gmail.com) ..no any back-up code …Anyone help me

5 months ago

AlfonsC2C Team Member

posted in Data Analytics

New Year, New C2C Connect: Data and Analytics

We will start a new year and a new C2C Connect Coffee Chat series for Data and Analytics with it. Join this recurrent event once a week to meet other people interested in Data and Analytics on Google Cloud.What is the C2C Connect: Data and Analytics Coffee Chat?These Coffee Chats are informal meetings designed to bring Google Cloud customers a place to meet, casually interact, and share knowledge with other users.How many Chats do I need to attend?You can assist as many Coffee Chats as you want. Some members use it sporadically to show and exchange information with others, and other members use it as a regular place to gain and share knowledge and network.How can I get the most of these events?There is always something to comment or talk about in the Coffee Chats, but coming prepared with something to share is the best strategy. Use this forum (look for the new topic button on the top-right) to post doubts, questions, or share a story in advance, so other people know how to help before

6 months ago

AlfonsC2C Team Member

posted in Data Analytics

Bringing More Insights to the Table with Cloud Bigtable

Hi Data gurus and fans!We have a new article in the learn section about Google Cloud Bigtable. take a look!

6 months ago

dhusainCommunity Member

asked in Data Analytics

Bigquery commands in Oozie

Hello,Can someone please share sample oozie workflow to create BigQuery table, load data from gcs bucket and read table.Thank you!

6 months ago

RonGuidaCommunity Member

posted in Data Analytics

Dask/Coiled to BigQuery connector

Dask/Coiled to BigQuery connector repo: https://github.com/coiled/dask-bigquery. Read data from Google BigQuery with Dask.

6 months ago

TomNomCommunity Member

asked in Data Analytics

Dataflow and Bigquery pricing

Hi all, I am a little bit confused and I would like to have your clarification. About dataflow pricingWhen working on dataflow, we have to specify a GCS bucket for temp_location. So is the use of this bucket subject to a google cloud storage pricing?About the Bigquery pricingWhen I do bacth load from dataflow to bigquery, I have to specify a bucket on google cloud storage. Do I also have to pay for the usage of this bucket? And after the load to bigquery, will the data be deleted from this bucket?

6 months ago

retomeierGoogle Employee

posted in Data Analytics

[Article] Query BIG with BigQuery: A cheat sheet

Hey Folks! This article, written by Priyanka Vergadia (Developer Advocate), was originally published on the Google Cloud Tech Blog. For more #GCPSketchnote, follow the GitHub repo. For similar cloud content follow Priyanka on Twitter @pvergadia and keep an eye out on thecloudgirl.dev. Organizations rely on data warehouses to aggregate data from disparate sources, process it, and make it available for data analysis in support of strategic decision-making. BigQuery is the Google Cloud enterprise data warehouse designed to help organizations to run large scale analytics with ease and quickly unlock actionable insights. You can ingest data into BigQuery either through batch uploading or by streaming data directly to unlock real-time insights. As a fully-managed data warehouse, BigQuery takes care of the infrastructure so you can focus on analyzing your data up to petabyte-scale. BigQuery supports SQL (Structured Query Language), which you’re likely already familiar with if you've worked wi

8 months ago

ashishtamanCommunity Member

asked in Data Analytics

MarissaCommunity Member

posted in Data Analytics

Data Monitoring and the 4 Golden Signals

In case you missed this Automated Monitoring and Microservices event with Fulfilld, check out the summary here. Question for you all: in your experience, which signal requires the most human power to monitor successfully?

8 months ago

Content SabinaCommunity Member

posted in Data Analytics

EVERY FRIDAY! C2C Connect: Data/Analytics Headlines Chat

Hey! Good Morning Data/Analytics Group! Wake up with C2C is a new offering where community members can spend 30 minutes every Friday at 10 am CST discussing recent Data/Analytics headlines and share their current projects. You supply the coffee, we’ll bring the conversation. Please register for the event, you’ll find the joining information in the invite

9 months ago

Content SabinaCommunity Member

posted in Data Analytics

Want to write for C2C?

9 months ago

IndraykkCommunity Member

posted in Data Analytics

s3 to big query data transfer

when I use data transfer from S3 to big query it's stores data as duplicate as I try to store last 7 days data. But if I use same transfer from sa360 to big query it updates existing records and appends new one. is there a way i can enable same feature for S3 transfer. or any workaround any sample pub sub model that can remove duplicates.

9 months ago

Corinne DavidCommunity Member

asked in Data Analytics

How to get data from Twitter using Webhook and Google cloud

I’m having problem getting data from Twitter via webhook using Google Cloud service. I tried different google cloud services such as Cloud run, Pub/sub, server less functions.Any suggestion and direction would be helpful. Thank you.

9 months ago

MarissaCommunity Member

posted in Data Analytics

[Article] How to run Python on Google Cloud

For all those Python users ready to jump off prem, check this article out: What third party libraries do you prefer?

10 months ago

MarissaCommunity Member

posted in Data Analytics

No more cookies! What's your game plan?

Thanks @AnnaRadewahn for bringing this up in the coffee chat today. I saw this article about a new startup trying to remedy the issue, but in the meantime; how do all you marketing folks getting what you need?

10 months ago

ArtemPlyuschFoundational Platinum Partner

posted in Data Analytics

BigQuery Omni as a migration assistant

1 List of acronyms and terms AWS—Amazon Web ServicesGCP—Google Cloud PlatformGCS—Google Cloud StorageS3 bucket—public cloud storage resource available in Amazon Web Services 2 IntroductionBigQuery is a serverless and highly scalable data warehouse. It gives a possibility to query petabytes of data and gain insights within minutes as well as provides an ecosystem for doing different kinds of analytics such as business intelligence, geospatial analysis, machine learning, and AI.BigQuery Omni is a multi-cloud analytics solution that brings capabilities of querying data across other cloud computing platforms such as AWS and Azure. At SoftServe, we’ve been working with BigQuery Omni since its launch and found out that it can be used to simplify data migration challenges. 3 Data reconciliationDuring the migration process, it may be difficult to avoid different kinds of data corruption. Business metrics may lose their precision, records may be truncated, and some data may just be lost. To be

10 months ago

iliasC2C Team Member

posted in Data Analytics

An end-to-end automated analytics workload

Do you know how to create a fully functional automated initial ETL + Analytics workload?Did you create an automated Analytics workload end-to-end using Cloud Functions, Data Fusion, BigQuery and Data Studio?Image source: from DV’s article on Medium In this article Daniel Villegas is using baby steps to explain how we can do it. Read the article and then all you have to do is keep feeding data into GCS and whenever you need it, you can have Data Studio send scheduled reports with up-to-date data. QUIZWhich Cloud Data Fusion edition offers FREE hours per month per account and how many are there? The author uses BigQuery. For building Replication jobs which BigQuery pricing model is recommended?

11 months ago

iliasC2C Team Member

posted in Data Analytics

Data Fusion

Data Fusion is Google’s cloud native, fully managed, scalable enterprise data integration platform.It offers a one-stop-shop for all enterprise data integration activities including ingestion, ETL, ELT and Streaming and with an execution engine optimized for SLAs and cost.Data Fusion supports a broad set of more than 200 connectors and formats, provides data wrangling capabilities to prepare data and provides capabilities to operationalize the data wrangling to improve business IT collaboration. Data Fusion builds confidence in business decision-making with advanced data consistency features and makes it easy to gain insights with metadata.Data Fusion is cloud-native and powered by CDAP, a 100% open-source framework for building on-premises and cloud data analytics applications. You can sign-up here for the CDAP Day on Google Open Source Live.Read more about Data Fusion.Image Source: Google Cloud Blog

11 months ago

MarissaCommunity Member

posted in Data Analytics

End of Week Wins for Data and Analytics (07/23)

Hello Data and Analytics Group! As people around the world are wrapping up their work week, let’s take a moment to celebrate the wins (both big and small). Feel free to share:Your personal victories this week Any company victories you would like to share out General achievements that this group can all get behind

11 months ago

Page 2 / 4

Recently Awarded Badges

Vickhas earned the badge C2C Conversationalist - Gold Level
pamboshas earned the badge Team Leader
andy.yateshas earned the badge Team Leader
PaulRLeeshas earned the badge Team Leader
guillaume blaquierehas earned the badge Team Leader

Show all badges

Terms & Conditions

Sign up

Already have an account? Login

Social Login

Login to the community

Social Login

Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.

Username or e-mail

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.