Groups
Articles
Resources
Events
About C2C

Home
Community overview
Google Cloud Platform Solutions and Technologies
Data Analytics

Data Analytics

Configure highly available data and real-time analytics to optimize performance, improve decision-making, and unlock new value.

113 Topics
114 Replies

Subscribed members will receive emails when there is a new post in this community category.

113 Topics

Recently active

Most replies Most views Newest first

llakhwani17Community Member

posted in Data Analytics

Who is interested in this awesome opportunity to learn the basics of BigQuery?

Hello All,Great opportunity to learn the basics of BigQuery.Learn the basics of BigQuery, Google’s multicloud data warehouse, and get your questions answered live by experts in our no-cost June 18 training. This training will occur at both 9 am PT (Pacific Time) and 11:30 am SG (Singapore Time).shorturl.at/sS235

iliasC2C Team Member

posted in Data Analytics

ETL or ELT?

Most of the time people tend to do what their friends do.The same thing happens when you work with clients. I have heard the argument many times: "We will do it this way because my friend does the same with his company".They cannot understand that every company is a different case and they cannot understand the evolution of CS and Cloud technologies.In one of these cases, I had a client who looked at me as if I were a foreigner, an alien when I proposed to have an ELT solution for his company.Really glad to read this article from @antoine.castex and can’t wait for part 2!

aftabhafeezCommunity Member

posted in Data Analytics

Airflow Day on Google Open Source Live

This month’s Google Open Source Live will highlight data pipelining in open cloud along with multiple sessions presented by Airflow team members and the community.Join this event to learn about Google contribution in Apache Airflow, Airflow autoscaling in Google Cloud Composer, as well as logging and monitoring in Airflow and Cloud Composer.https://opensourcelive.withgoogle.com/events/airflowday

JimmyJigmoCommunity Member

posted in Data Analytics

Ready to learn all about data warehouses in Google Cloud?

Join Devoteam Cloud Services Head of Data, Huijie Wang at her workshop on the 2nd of June at 11:00 CET! 📅 Register for the whole event here: https://lnkd.in/e95uYev

iliasC2C Team Member

posted in Data Analytics

Datashare

Datashare for financial services, a new Google Cloud solution that brings together the entire capital markets ecosystem—data publishers, and data consumers—to exchange market data securely and easily.You can read more here

iliasC2C Team Member

posted in Data Analytics

Dataflow Prime

Dataflow Prime is a new platform based on a serverless, no-ops, auto-tuning architecture that is easy to onboard, use, and operate.It brings unparalleled resource utilization and radical operational simplicity to big data processing. It is built on Dataflow and brings new user benefits with innovations in resource utilization and distributed diagnostics. The new capabilities in Dataflow significantly reduce the time spent on infrastructure sizing and tuning tasks, as well as time spent diagnosing data freshness problems. Dataflow Prime enables you to get more done with less in the following ways: Eliminate the time you spend sizing resource needs Optimize resource usage and save costs Increase your productivity Vertical Autoscaling Right Fitting Job Visualizer Managed Pipeline Smart Recommendations Sign up to receive updates

tobisamCommunity Member

posted in Data Analytics

Datastream: New CDC replication service on GCP to compete with Fivetran

I just came across this new change data capture (CDC) service from Google that can really compete with Fivetran and similar 3rd party apps.Check it out here: Google Datastreamhttps://cloud.google.com/datastream/?hl=en_GB&_ga=2.132120585.-680420582.1613156617

iliasC2C Team Member

posted in Data Analytics

New Google Cloud Innovations to Unify your Data Cloud

Every company is on a journey to become more data-driven whether that’s providing great digital experiences to customers, or driving operational excellence through AI, or detecting hidden patterns in data to improve decision making. To help with this transformation, Google Cloud announced new products and services designed to fully unify your databases, analytics, and AI.Centrally manage, monitor, and govern your data across data lakes, data warehouses, and data marts, and make this data securely accessible to a variety of analytics and data science tools from a single view with Dataplex. Move and synchronize data between heterogeneous databases, storage, and applications reliably to support real-time analytics, database replication, and event-driven architectures with Datastream. Access and share valuable datasets and analytics assets across any organizational boundary with Analytics Hub. Speed up your rate of experimentation with AI projects and accelerate time to business value with

iliasC2C Team Member

posted in Data Analytics

Analytics Hub

Sharing and exchanging data with other organizations is a critical element of a customer’s analytics strategy, but it’s hamstrung by unreliable data and processes, and only getting harder with security threats and privacy regulations on the rise. Furthermore, traditional data sharing techniques use batch data pipelines that are expensive to run, create late-arriving data, and can break with any changes to the source data. They also create multiple copies of data, which brings unnecessary costs and can bypass data governance processes. These techniques do not offer features for data monetization, such as managing subscriptions and entitlements. Altogether, these challenges mean that organizations are unable to realize the full potential of transforming their business with shared data.Analytics Hub is here to address these limitations. It’s a new fully managed service (in preview), that helps us unlock the value of data sharing, leading to new insights and increased business value.It bui

iliasC2C Team Member

posted in Data Analytics

Datastream

Datastream is a serverless change data capture (CDC) and replication service. It allows enterprises to synchronize data across heterogeneous databases, storage systems, and applications reliably and with minimal latency to support real-time analytics, database replication, and event-driven architectures.You can now easily and seamlessly deliver change streams from Oracle and MySQL databases into Google Cloud services such as BigQuery, Cloud SQL, Google Cloud Storage, and Cloud Spanner, saving time and resources and ensuring your data is accurate and up-to-date.Check out the Datastream documentation.Watch the Introducing Datastream videoYou can read more on these two articles: Unlock the power of change data capture and replication with new, serverless Datastream Using Datastream to unify data for machine learning and analytics Real-time Change Data Capture for data replication into BigQuery Migrate from Oracle to PostgreSQL with minimal downtime with Datastream

iliasC2C Team Member

posted in Data Analytics

Dataplex

Google Cloud is partnering with industry leaders such as Accenture, Collibra, Confluent, Informatica, HCL, Starburst, NVIDIA, Trifacta, and others to build an open platform to power analytics at scale.Dataplex, an intelligent data fabric that provides a way to centrally manage, monitor, and govern your data across data lakes, data warehouses, and data marts, and make this data securely accessible to a variety of analytics and data science tools. You can read more hereWatch the recordingSign-up to request a preview Dataplex will be free to enterprises that are accepted into the preview program.

iliasC2C Team Member

posted in Data Analytics

PIVOT in BigQuery

Sometimes, you might want to reformat a table result so you have separate columns for each unique value. This is called a Pivot table.What does Pivot do? Pivot changes rows to columns.Read the article hereI love Lak’s articles!Have you used Pivot in BigQuery?

c2cgermanyC2C Team Member

posted in Data Analytics

Why Google Cloud’s Data Analytics Tops The Competition: Debanjan Saha

‘We have been in the business of organizing the world‘s information for a very long time,’ said Debanjan Saha, vice president and general manager of data analytics at Google Cloud (previously worked at AWS). ‘Data is in our DNA, and that’s what drives Google.’Read the full article: Why Google Cloud’s Data Analytics Tops The Competition: Debanjan Saha

iliasC2C Team Member

posted in Data Analytics

New this month: Data lakes, speed at scale, and SAP data

Google Cloud is all about its customers.Read about: the New York Times shared how their data analytics team went from staying up until three in the morning trying to keep their legacy system running to relaxing while eating ice cream after their migration over to Google Cloud. why Verizon Media picked BigQuery for scale, performance, and cost. how the Golden State Warriors transform on-court data into a competitive advantage, pulling raw data from AWS into Google Cloud for fast analytics and much more on this article.Image Source: Official Google Cloud BlogI love these kind of stories. Success stories!Would you like to share your story as well?

iliasC2C Team Member

posted in Data Analytics

Scheduling Cloud Bigtable Backups

Cloud Bigtable backups let you save a copy of a table's schema and data, then restore from the backup to a new table at a later time.In this tutorial, you'll learn how to create backups at regularly scheduled intervals (such as daily or weekly) using the Cloud Bigtable Scheduled Backups example.Image Source: Official Google Cloud BlogHave you used the Bigtable backup? Did you do it like this tutorial or did you do it another way?

iliasC2C Team Member

posted in Data Analytics

Databricks on Google Cloud is now generally available

Google Cloud and Databricks announced a new partnership to deliver Databricks at a global scale on Google Cloud.This partnership, which was announced in February, is fully available to the public from May the 4th (be with us!) 😀Enterprises can deploy or migrate Databricks Lakehouse to Google Cloud to combine the benefits of an open data cloud platform with greater analytics flexibility, unified infrastructure management, and optimized performance.Read it hereImage Source: Official Google Cloud BlogAwesome news, right?

iliasC2C Team Member

posted in Data Analytics

Why Spotify loves being locked into Google Cloud

Spotify began a migration to Google five years ago when Google's long-term commitment to cloud computing was something of a question.In a recent interview with Protocol, Tyson Singer, vice president of technology and platforms at Spotify, who oversees the technical infrastructure that serves Spotify's 356 million monthly active users, discussed the company's decision to marry its fortunes to Google Cloud, the pros and cons of using managed services and why "ML ops" is the next big thing on his radar.https://www.protocol.com/enterprise/spotify-google-cloud-platform They love BigQuery. What is your favorite Google Cloud technology?

iliasC2C Team Member

posted in Data Analytics

6 database trends to watch

In a data-driven, global, and always-on world, databases are the engines that power business innovation and transformation.Check out 6️⃣ database trends to put to work to handle your infrastructure needsRead the articleImage Source: Official Google Cloud Blog

iliasC2C Team Member

posted in Data Analytics

Database to Dashboard: Connecting to BigQuery and Analyzing Data with Looker

Data Analysts 👉 Learn how to model, analyze, and visualize your data in less than 30 minutes. In this demo, Product Demonstration Manager, Leigha Jarett, will walk you through setting up a connection between your BigQuery data warehouse and Looker.Once connected Leigha will show how Looker auto-generates a data model, which you can immediately explore, customize, and reuse. From there, you’ll learn how to build reports, dashboards, bring data into your workflows via alerts, integrations, and more.Register

posted in Data Analytics

Free Course "Google BigQuery & PostgreSQL: Big Query for Data Analysis"

The course enrollment is available for FREE for the next 24 hours. Be quick, grab it now, can study later :)https://www.udemy.com/course/google-bigquery-and-postgresql-sql-for-data-analysis/?couponCode=APRBQFRE

iliasC2C Team Member

posted in Data Analytics

Japan & Google Cloud

Today on the news are two articles for Japanese companies:7-Eleven Japan's built "Seven Central," a new platform for practical data use, to support the company’s future IT strategies and Digital Transformation initiatives. Learn how it leveraged #BigQuery and Apigee API management to support its data platform.https://cloud.google.com/blog/products/data-analytics/how-7-eleven-japan-built-its-new-data-platform Japan’s largest C2C marketplace, Mercari, allows 85+ million users to buy new and used items.Learn how Cloud Spanner helped the e-commerce giant launch a new mobile payment platform that is strong on scalability, availability, and performancehttps://cloud.google.com/blog/products/databases/mercari-chose-cloud-spanner-to-help-power-merpay How has Google Cloud helped your company? Share your story with us!

scottfeldmanCommunity Member

posted in Data Analytics

I Love My Database!

Do you love your database?Did you know that Cloud Spanner launched customer-managed encryption keys and Access Approval?Cloud Spanner is Google Cloud’s fully managed relational database that offers unlimited scale, high performance, strong consistency across regions and high availability (up to 99.999% availability SLA). In addition, enterprises trust Spanner because it provides security, transparency and complete data protection to its customers. To give enterprises greater control of how their data is secured, Spanner recently launched Customer-managed encryption keys (CMEK). CMEK enables customers to manage encryption keys in Cloud Key Management (KMS). Read the full blog posting here. Image from Google blog post

iliasC2C Team Member

posted in Data Analytics

Exploring hail reports with BigQuery and Data Studio

Have you used BigQuery’s new Geospatial capabilities? Have you exported them on Data Studio?Lak Lakshmanan, Data Analytics & AI @ Google Cloud, is showing how you can do it in his articleSource: @trolliYou can use BigQuery Sandbox (it’s free) and Data Studio (free product). Awesome, right?

iliasC2C Team Member

posted in Data Analytics

Bigtable vs. BigQuery: What’s the difference?

Many people wonder if they should use BigQuery or Bigtable. And the reason is the word “Big” that exists in both of them. It reminds me the Java and Javascript issue.While these two services have a number of similarities, including "Big" in their names, they support very different use cases in your big data ecosystem.https://cloud.google.com/blog/topics/developers-practitioners/bigtable-vs-bigquery-whats-differ

iliasC2C Team Member

posted in Data Analytics

Please BigQuery, can you accelerate my answers (and be cheaper)?

When I was talking about BigQuery, I always had three people in mind: Felipe, Jordan and Lak.The first two are no longer in the team that works with BigQuery. But Lac is. And does an amazing job of writing articles, making videos that you can watch live or on-demand from Cloud OnAir events and, of course, training courses in Coursera and PluralSight.From last week I will have in mind another person. Our @antoine.castex, core team member of the France Community Group at C2C.His way of approaching BigQuery and explaining it with such simplicity is truly amazing. In his article, he has a very good transmission capability.It's a 7 minute investment to read. @Content.Sabina we must have him on the panel and talk. @JBranham maybe we can have a 10 minutes video from experts like himhttps://beautytmr.com/please-bigquery-can-you-accelerate-my-answers-and-be-cheaper-d642d2227c33 Source: Antoine Castex’s article on Beauty Tomorrow Publication, Medium

1
2
3
4
5

Page 4 / 5

Recently Awarded Badges

malaminhas earned the badge Google Cloud Startups Community Builder - Gold Level
Dimitris Petrakishas earned the badge Germany Group Conversationalist - Bronze Level
yuvalhas earned the badge C2C Conversationalist - Silver Level
jstanbrihas earned the badge C2C Conversationalist - Bronze Level
C2C Community Teamhas earned the badge C2C Influencer - Platinum Level

Show all badges

Powered by inSided

Terms & Conditions

Sign up

Already have an account? Login

Social Login

Login With Your C2C Credentials

Login to the community

Social Login

Login With Your C2C Credentials

Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.

Username or e-mail

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK