Data Analytics

Configure highly available data and real-time analytics to optimize performance, improve decision-making, and unlock new value.

145 Topics
145 Replies

145 Topics

iliasC2C Team Member

posted in Data Analytics

Data Fusion

Data Fusion is Google’s cloud native, fully managed, scalable enterprise data integration platform.It offers a one-stop-shop for all enterprise data integration activities including ingestion, ETL, ELT and Streaming and with an execution engine optimized for SLAs and cost.Data Fusion supports a broad set of more than 200 connectors and formats, provides data wrangling capabilities to prepare data and provides capabilities to operationalize the data wrangling to improve business IT collaboration. Data Fusion builds confidence in business decision-making with advanced data consistency features and makes it easy to gain insights with metadata.Data Fusion is cloud-native and powered by CDAP, a 100% open-source framework for building on-premises and cloud data analytics applications. You can sign-up here for the CDAP Day on Google Open Source Live.Read more about Data Fusion.Image Source: Google Cloud Blog

2 years ago

Marissa

posted in Data Analytics

End of Week Wins for Data and Analytics (07/23)

Hello Data and Analytics Group! As people around the world are wrapping up their work week, let’s take a moment to celebrate the wins (both big and small). Feel free to share:Your personal victories this week Any company victories you would like to share out General achievements that this group can all get behind

2 years ago

QuantiphiPlatinum Partner

posted in Data Analytics

How to Achieve Customer Success with Data & Analytics

Unlocking the potential of customer data to drive faster innovations in advanced analytics, AI and Machine Learning has been a core focus for Google Cloud. We're talking Infrastructure Modernization, Database Migration, Business Intelligence on Looker, Marketing Analytics, Predictive Analytics and more! How has data played an important role at your organization? What has been the number one pain point or challenge your organization has faced where data and analytics became a key solution? Is there a topic within Data and Analytics you'd like to learn more about? Let us know in the comments below» As the newly announced Google Cloud Data Analytics Partner of the Year, Quantiphi continues to leverage Google's best-in-class technology to help organizations across industries embark on a data-driven digital transformation journey on Google Cloud. Read more.

2 years ago

iliasC2C Team Member

posted in Data Analytics

BigQuery - New SQL features

It is a fact that more and more traditional data warehouses are migrating to BigQuery.That’s why the BigQuery team wants to make our lives easier with these new user-friendly SQL features.These new capabilities come in three themes: Powerful Analytics Features, Flexible Columns, and Secure with SQL:Powerful Analytics FeaturesQUALIFY,PIVOT,UNPIVOT, Table function (Preview) Flexible Columns Parameterized Data Types (Preview) Flexible Data Type Casting and Formatting (GA) Change a column’s description (GA) Secure with SQL GRANT and REVOKE access to tables, datasets and views (GA) Review object privileges with INFORMATION_SCHEMA (Preview) So many new toys to play either on a live(?) project, a side project or for Free on BigQuery SandboxRead the article hereGoogle Cloud Blog

2 years ago

iliasC2C Team Member

posted in Data Analytics

AutoML Tables is now generally available in BigQuery ML

Google’s cloud data warehouse, BigQuery, has enabled organizations around the world to accelerate their digital transformation and empower their data analysts to unlock actionable insights from their data. Using BigQuery ML, data analysts are able to create sophisticated machine learning models with just SQL and uncover predictive insights from their data much faster.The AutoML Tables model type into the list of supported ML models within BigQuery ML and integrates directly and seamlessly with Vertex AI.Read the article hereGoogle Cloud Blog

2 years ago

iliasC2C Team Member

posted in Data Analytics

Google Cloud Dataprep by Trifacta cheat sheet

Data Preparation takes a lot of time. It doesn’t matter if you are a beginner or an experienced data analyst. You are going to spend a lot of time on Data Wrangling.You have the option to use your Jupyter Notebook or you can use Dataprep by Trifacta. And you can do everything without writing a single line of code. Awesome, right?In this article, Priyanka has created cheat sheet with her drawings

2 years ago

VickModerator

posted in Data Analytics

BigQuery row-level security enables more granular access to data

BigQuery row-level security is now generally available, giving customers a way to control access to subsets of data in the same table for different groups of users. Row-level security (RLS) extends the principle of least privilege access and enables fine-grained access control policies in BigQuery tables. BigQuery currently supports access controls at the project-, dataset-, table- and column-level. Adding RLS to the portfolio of access controls now enables customers to filter and define access to specific rows in a table based on qualifying user conditions—providing much needed peace of mind for data professionals. Read more here: https://cloud.google.com/blog/products/data analytics/bigquery-provides-tighter-controls-over-data-access

2 years ago

iliasC2C Team Member

posted in Data Analytics

Datastream and MongoDB

Accessing data in real time enables your company to analyze, plan and improve continuously, so you can make better strategic decisions and reduce your overall risk.But any system can move only as fast as its slowest bottleneck.Read here how with Google Cloud’s Datastream, a serverless change data capture and replication service, and MongoDB Atlas, you can set up a real-time analytics pipeline that continually streams data from legacy relational data stores (like Oracle and MySQL) into MongoDB Atlas. Do you want to learn more about Datastream? Sign-up for our eventImage Source: Google Cloud Blog

2 years ago

llakhwani17Trailblazer

posted in Data Analytics

Who is interested in this awesome opportunity to learn the basics of BigQuery?

Hello All,Great opportunity to learn the basics of BigQuery.Learn the basics of BigQuery, Google’s multicloud data warehouse, and get your questions answered live by experts in our no-cost June 18 training. This training will occur at both 9 am PT (Pacific Time) and 11:30 am SG (Singapore Time).shorturl.at/sS235

2 years ago

iliasC2C Team Member

posted in Data Analytics

ETL or ELT?

Most of the time people tend to do what their friends do.The same thing happens when you work with clients. I have heard the argument many times: "We will do it this way because my friend does the same with his company".They cannot understand that every company is a different case and they cannot understand the evolution of CS and Cloud technologies.In one of these cases, I had a client who looked at me as if I were a foreigner, an alien when I proposed to have an ELT solution for his company.Really glad to read this article from @antoine.castex and can’t wait for part 2!

2 years ago

aftabhafeezNewbie

posted in Data Analytics

Airflow Day on Google Open Source Live

This month’s Google Open Source Live will highlight data pipelining in open cloud along with multiple sessions presented by Airflow team members and the community.Join this event to learn about Google contribution in Apache Airflow, Airflow autoscaling in Google Cloud Composer, as well as logging and monitoring in Airflow and Cloud Composer.https://opensourcelive.withgoogle.com/events/airflowday

2 years ago

JimmyJigmoPlatinum Partner

posted in Data Analytics

Ready to learn all about data warehouses in Google Cloud?

Join Devoteam Cloud Services Head of Data, Huijie Wang at her workshop on the 2nd of June at 11:00 CET! 📅 Register for the whole event here: https://lnkd.in/e95uYev

2 years ago

iliasC2C Team Member

posted in Data Analytics

Dataflow Prime

Dataflow Prime is a new platform based on a serverless, no-ops, auto-tuning architecture that is easy to onboard, use, and operate.It brings unparalleled resource utilization and radical operational simplicity to big data processing. It is built on Dataflow and brings new user benefits with innovations in resource utilization and distributed diagnostics. The new capabilities in Dataflow significantly reduce the time spent on infrastructure sizing and tuning tasks, as well as time spent diagnosing data freshness problems. Dataflow Prime enables you to get more done with less in the following ways: Eliminate the time you spend sizing resource needs Optimize resource usage and save costs Increase your productivity Vertical Autoscaling Right Fitting Job Visualizer Managed Pipeline Smart Recommendations Sign up to receive updates

2 years ago

tobisamNewbie

posted in Data Analytics

Datastream: New CDC replication service on GCP to compete with Fivetran

I just came across this new change data capture (CDC) service from Google that can really compete with Fivetran and similar 3rd party apps.Check it out here: Google Datastreamhttps://cloud.google.com/datastream/?hl=en_GB&_ga=2.132120585.-680420582.1613156617

2 years ago

iliasC2C Team Member

posted in Data Analytics

New Google Cloud Innovations to Unify your Data Cloud

Every company is on a journey to become more data-driven whether that’s providing great digital experiences to customers, or driving operational excellence through AI, or detecting hidden patterns in data to improve decision making. To help with this transformation, Google Cloud announced new products and services designed to fully unify your databases, analytics, and AI.Centrally manage, monitor, and govern your data across data lakes, data warehouses, and data marts, and make this data securely accessible to a variety of analytics and data science tools from a single view with Dataplex. Move and synchronize data between heterogeneous databases, storage, and applications reliably to support real-time analytics, database replication, and event-driven architectures with Datastream. Access and share valuable datasets and analytics assets across any organizational boundary with Analytics Hub. Speed up your rate of experimentation with AI projects and accelerate time to business value with

2 years ago

iliasC2C Team Member

posted in Data Analytics

Analytics Hub

Sharing and exchanging data with other organizations is a critical element of a customer’s analytics strategy, but it’s hamstrung by unreliable data and processes, and only getting harder with security threats and privacy regulations on the rise. Furthermore, traditional data sharing techniques use batch data pipelines that are expensive to run, create late-arriving data, and can break with any changes to the source data. They also create multiple copies of data, which brings unnecessary costs and can bypass data governance processes. These techniques do not offer features for data monetization, such as managing subscriptions and entitlements. Altogether, these challenges mean that organizations are unable to realize the full potential of transforming their business with shared data.Analytics Hub is here to address these limitations. It’s a new fully managed service (in preview), that helps us unlock the value of data sharing, leading to new insights and increased business value.It bui

2 years ago

iliasC2C Team Member

posted in Data Analytics

Datastream

Datastream is a serverless change data capture (CDC) and replication service. It allows enterprises to synchronize data across heterogeneous databases, storage systems, and applications reliably and with minimal latency to support real-time analytics, database replication, and event-driven architectures.You can now easily and seamlessly deliver change streams from Oracle and MySQL databases into Google Cloud services such as BigQuery, Cloud SQL, Google Cloud Storage, and Cloud Spanner, saving time and resources and ensuring your data is accurate and up-to-date.Check out the Datastream documentation.Watch the Introducing Datastream videoYou can read more on these two articles: Unlock the power of change data capture and replication with new, serverless Datastream Using Datastream to unify data for machine learning and analytics Real-time Change Data Capture for data replication into BigQuery Migrate from Oracle to PostgreSQL with minimal downtime with Datastream

2 years ago

iliasC2C Team Member

posted in Data Analytics

Dataplex

Google Cloud is partnering with industry leaders such as Accenture, Collibra, Confluent, Informatica, HCL, Starburst, NVIDIA, Trifacta, and others to build an open platform to power analytics at scale.Dataplex, an intelligent data fabric that provides a way to centrally manage, monitor, and govern your data across data lakes, data warehouses, and data marts, and make this data securely accessible to a variety of analytics and data science tools. You can read more hereWatch the recordingSign-up to request a preview Dataplex will be free to enterprises that are accepted into the preview program.

2 years ago

iliasC2C Team Member

posted in Data Analytics

PIVOT in BigQuery

Sometimes, you might want to reformat a table result so you have separate columns for each unique value. This is called a Pivot table.What does Pivot do? Pivot changes rows to columns.Read the article hereI love Lak’s articles!Have you used Pivot in BigQuery?

2 years ago

c2cgermanyC2C Team Member

posted in Data Analytics

Why Google Cloud’s Data Analytics Tops The Competition: Debanjan Saha

‘We have been in the business of organizing the world‘s information for a very long time,’ said Debanjan Saha, vice president and general manager of data analytics at Google Cloud (previously worked at AWS). ‘Data is in our DNA, and that’s what drives Google.’Read the full article: Why Google Cloud’s Data Analytics Tops The Competition: Debanjan Saha

2 years ago