SlideShare a Scribd company logo
Google Cloud Platform
Big Data Unlimited
Sebastien Agnan, Solution Engineer
sagnan@google.com
#DataUnlimited - Google Big Data Unlimited
Building what’s next 3
Time to Understanding
Typical Big Data
Processing
Programming
Resource
provisioning
Performance
tuning
Monitoring
Reliability
Deployment &
configuration
Handling
growing scale
Utilization
improvements
Building what’s next 4
Time to Understanding
Big Data with Google:
Focus on insight,
not infrastructure.
Programming
StoreCapture Analyze
BigQuery
Big Data at Google
Process
DataflowCloud Storage
DatastoreCloud SQL
Hadoop/SparkKafka
Pub/Sub
Hadoop/Spark
• Publish and Subscription Service
• Simple
• Seamlessly Scalable
• Many-to-many or one-to-one
• Guaranteed Durable Delivery
• Push or Pull
• Secure and Encrypted
PUB / SUB : Real-time and reliable messaging
Building what’s next 7
Lorem Ipsum
Lorem Ipsum
Reliable and Flexible Storage
Performant and economical
Blob, Block, Key Value, SQL and NoSQL
Easy to use : API
High performance : 99.95% SLA and 24x7 phone
support
Strong ecosystem of partners
Data location (US,EU or APAC)
Building what’s next 8
Merges batch and stream processing
Data processing pipelines
Monitoring interface
Significantly lower cost
Google Cloud Dataflow
makes complex data analysis simple
#gcpug | #googlecloud
Google Cloud Dataflow
Optimize
Schedule
GCS GCS
User Code & SDK Monitoring UI
Life of a Pipeline
Building what’s next 10
Scales automatically
No setup or administration
Stream up to 100,000 rows p/sec
Easily integrates with third-party software
Google BigQuery
makes complex data analysis simple
#gcpug | #googlecloud
BigQuery Analytic Service in the Cloud
BigQuery
Analyze ExportImport
How to use BigQuery?
Google
AnalyticsETL tools
Connectors
Google Cloud
BI tools and
Visualization
Google Cloud
Spreadsheets, R,
Hadoop
Building what’s next 12
A more flexible App Engine
Complete Platform-as-a-Service.
Focus on Code. Not infrastructure.
Develop in your favorite language.
Deploy with a click.
Conclusion
StoreCapture Analyze
BigQuery
Big Data at Google - Easy, Inexpensive, and Fast
Process
DataflowCloud Storage
DatastoreCloud SQL
Hadoop/SparkKafka
Pub/Sub
Hadoop/Spark
NEXT PARIS 13 OCtobre
2015
https://goo.gl/wgKqhT
Google confidential │ Do not
distribute
Thank You
#gcpug | #googlecloud
Column Oriented Storage
Record Oriented Storage Column Oriented Storage
Less bandwidth, More compression

More Related Content

What's hot (20)

PPTX
TIAD : Automate everything with Google Cloud
The Incredible Automation Day
 
PPTX
MongoDB Days UK: Run MongoDB on Google Cloud Platform
MongoDB
 
PPTX
Introduction to Google Cloud Platform
dhruv_chaudhari
 
PDF
Google Cloud Dataflow
GirdhareeSaran
 
PDF
Google cloud platform introduction
Simon Su
 
PDF
Google Cloud Technologies Overview
Chris Schalk
 
PDF
 Introduction google cloud platform
marwa Ayad Mohamed
 
PDF
Scale with a smile with Google Cloud Platform At DevConTLV (June 2014)
Ido Green
 
PDF
Introduction to Google's Cloud Technologies
Chris Schalk
 
PPTX
Big Data Best Practices on GCP
AllCloud
 
PDF
Build with all of Google Cloud
wesley chun
 
PPTX
Google cloud platform
Piyumi Niwanthika Herath
 
PDF
How to Puppetize Google Cloud Platform - PuppetConf 2014
Puppet
 
PPTX
Google Cloud Platform (GCP)
Chetan Sharma
 
PDF
Tom Grey - Google Cloud Platform
Fondazione CUOA
 
PDF
Getting started with Google Cloud Training Material - 2018
JK Baseer
 
PDF
Google Cloud Platform for Data Science teams
Barton Rhodes
 
PPTX
Cloud computing by Google Cloud Platform - Presentation
TinarivosoaAbaniaina
 
PPTX
Introduction to GCP presentation
Mohit Kachhwani
 
PDF
A Tour of Google Cloud Platform
Colin Su
 
TIAD : Automate everything with Google Cloud
The Incredible Automation Day
 
MongoDB Days UK: Run MongoDB on Google Cloud Platform
MongoDB
 
Introduction to Google Cloud Platform
dhruv_chaudhari
 
Google Cloud Dataflow
GirdhareeSaran
 
Google cloud platform introduction
Simon Su
 
Google Cloud Technologies Overview
Chris Schalk
 
 Introduction google cloud platform
marwa Ayad Mohamed
 
Scale with a smile with Google Cloud Platform At DevConTLV (June 2014)
Ido Green
 
Introduction to Google's Cloud Technologies
Chris Schalk
 
Big Data Best Practices on GCP
AllCloud
 
Build with all of Google Cloud
wesley chun
 
Google cloud platform
Piyumi Niwanthika Herath
 
How to Puppetize Google Cloud Platform - PuppetConf 2014
Puppet
 
Google Cloud Platform (GCP)
Chetan Sharma
 
Tom Grey - Google Cloud Platform
Fondazione CUOA
 
Getting started with Google Cloud Training Material - 2018
JK Baseer
 
Google Cloud Platform for Data Science teams
Barton Rhodes
 
Cloud computing by Google Cloud Platform - Presentation
TinarivosoaAbaniaina
 
Introduction to GCP presentation
Mohit Kachhwani
 
A Tour of Google Cloud Platform
Colin Su
 

Similar to #DataUnlimited - Google Big Data Unlimited (20)

PDF
Integrating Google Cloud Dataproc with Alluxio for faster performance in the ...
Alluxio, Inc.
 
PDF
Google на конференции Big Data Russia
rusbase.vc
 
PPTX
Eric Andersen Keynote
Data Con LA
 
PDF
Solving enterprise challenges through scale out storage & big compute final
Avere Systems
 
PPTX
Accelerating workloads and bursting data with Google Dataproc & Alluxio
Big Data Aplications Meetup
 
PDF
Data Platform on GCP
Patrick Alexander
 
PDF
Slides: Success Stories for Data-to-Cloud
DATAVERSITY
 
PPTX
Turning Petabytes of Data into Profit with Hadoop for the World’s Biggest Ret...
Cloudera, Inc.
 
PDF
2022 Trends in Enterprise Analytics
DATAVERSITY
 
PDF
Navigating Your Data Landscape With Siddharth Desai and Elena Cuevas | Curren...
HostedbyConfluent
 
PDF
Hybrid data lake on google cloud with alluxio and dataproc
Alluxio, Inc.
 
PDF
Gab Genai Cloudera - Going Beyond Traditional Analytic
IntelAPAC
 
PDF
Google Cloud Platform
GeneXus
 
PPTX
ATAGTR2017 Performance Testing and Non-Functional Testing Strategy for Big Da...
Agile Testing Alliance
 
PPTX
Gimel and PayPal Notebooks @ TDWI Leadership Summit Orlando
Romit Mehta
 
PPTX
Actian Analytics Platform - Hadoop SQL Edition
Alessandro Salvatico
 
PDF
Hadoop as an Analytic Platform: Why Not?
Inside Analysis
 
PPTX
BigQuery - Snowflake compete deck _ Sales _ Y21.pptx
Erkan Çiftçi
 
PDF
Building what's next with google cloud's powerful infrastructure
MediaAgility
 
PPTX
Oracle GoldenGate Cloud Service Overview
Jinyu Wang
 
Integrating Google Cloud Dataproc with Alluxio for faster performance in the ...
Alluxio, Inc.
 
Google на конференции Big Data Russia
rusbase.vc
 
Eric Andersen Keynote
Data Con LA
 
Solving enterprise challenges through scale out storage & big compute final
Avere Systems
 
Accelerating workloads and bursting data with Google Dataproc & Alluxio
Big Data Aplications Meetup
 
Data Platform on GCP
Patrick Alexander
 
Slides: Success Stories for Data-to-Cloud
DATAVERSITY
 
Turning Petabytes of Data into Profit with Hadoop for the World’s Biggest Ret...
Cloudera, Inc.
 
2022 Trends in Enterprise Analytics
DATAVERSITY
 
Navigating Your Data Landscape With Siddharth Desai and Elena Cuevas | Curren...
HostedbyConfluent
 
Hybrid data lake on google cloud with alluxio and dataproc
Alluxio, Inc.
 
Gab Genai Cloudera - Going Beyond Traditional Analytic
IntelAPAC
 
Google Cloud Platform
GeneXus
 
ATAGTR2017 Performance Testing and Non-Functional Testing Strategy for Big Da...
Agile Testing Alliance
 
Gimel and PayPal Notebooks @ TDWI Leadership Summit Orlando
Romit Mehta
 
Actian Analytics Platform - Hadoop SQL Edition
Alessandro Salvatico
 
Hadoop as an Analytic Platform: Why Not?
Inside Analysis
 
BigQuery - Snowflake compete deck _ Sales _ Y21.pptx
Erkan Çiftçi
 
Building what's next with google cloud's powerful infrastructure
MediaAgility
 
Oracle GoldenGate Cloud Service Overview
Jinyu Wang
 
Ad

Recently uploaded (20)

PDF
Peak of Data & AI Encore - Real-Time Insights & Scalable Editing with ArcGIS
Safe Software
 
PDF
Per Axbom: The spectacular lies of maps
Nexer Digital
 
PPTX
Agile Chennai 18-19 July 2025 | Workshop - Enhancing Agile Collaboration with...
AgileNetwork
 
PDF
Presentation about Hardware and Software in Computer
snehamodhawadiya
 
PDF
How ETL Control Logic Keeps Your Pipelines Safe and Reliable.pdf
Stryv Solutions Pvt. Ltd.
 
PDF
Research-Fundamentals-and-Topic-Development.pdf
ayesha butalia
 
PPTX
Applied-Statistics-Mastering-Data-Driven-Decisions.pptx
parmaryashparmaryash
 
PDF
The Future of Mobile Is Context-Aware—Are You Ready?
iProgrammer Solutions Private Limited
 
PDF
The Future of Artificial Intelligence (AI)
Mukul
 
PPTX
What-is-the-World-Wide-Web -- Introduction
tonifi9488
 
PPTX
AI and Robotics for Human Well-being.pptx
JAYMIN SUTHAR
 
PDF
GDG Cloud Munich - Intro - Luiz Carneiro - #BuildWithAI - July - Abdel.pdf
Luiz Carneiro
 
PDF
Responsible AI and AI Ethics - By Sylvester Ebhonu
Sylvester Ebhonu
 
PDF
Brief History of Internet - Early Days of Internet
sutharharshit158
 
PDF
RAT Builders - How to Catch Them All [DeepSec 2024]
malmoeb
 
PDF
MASTERDECK GRAPHSUMMIT SYDNEY (Public).pdf
Neo4j
 
PDF
introduction to computer hardware and sofeware
chauhanshraddha2007
 
PPTX
AVL ( audio, visuals or led ), technology.
Rajeshwri Panchal
 
PDF
TrustArc Webinar - Navigating Data Privacy in LATAM: Laws, Trends, and Compli...
TrustArc
 
PPTX
Farrell_Programming Logic and Design slides_10e_ch02_PowerPoint.pptx
bashnahara11
 
Peak of Data & AI Encore - Real-Time Insights & Scalable Editing with ArcGIS
Safe Software
 
Per Axbom: The spectacular lies of maps
Nexer Digital
 
Agile Chennai 18-19 July 2025 | Workshop - Enhancing Agile Collaboration with...
AgileNetwork
 
Presentation about Hardware and Software in Computer
snehamodhawadiya
 
How ETL Control Logic Keeps Your Pipelines Safe and Reliable.pdf
Stryv Solutions Pvt. Ltd.
 
Research-Fundamentals-and-Topic-Development.pdf
ayesha butalia
 
Applied-Statistics-Mastering-Data-Driven-Decisions.pptx
parmaryashparmaryash
 
The Future of Mobile Is Context-Aware—Are You Ready?
iProgrammer Solutions Private Limited
 
The Future of Artificial Intelligence (AI)
Mukul
 
What-is-the-World-Wide-Web -- Introduction
tonifi9488
 
AI and Robotics for Human Well-being.pptx
JAYMIN SUTHAR
 
GDG Cloud Munich - Intro - Luiz Carneiro - #BuildWithAI - July - Abdel.pdf
Luiz Carneiro
 
Responsible AI and AI Ethics - By Sylvester Ebhonu
Sylvester Ebhonu
 
Brief History of Internet - Early Days of Internet
sutharharshit158
 
RAT Builders - How to Catch Them All [DeepSec 2024]
malmoeb
 
MASTERDECK GRAPHSUMMIT SYDNEY (Public).pdf
Neo4j
 
introduction to computer hardware and sofeware
chauhanshraddha2007
 
AVL ( audio, visuals or led ), technology.
Rajeshwri Panchal
 
TrustArc Webinar - Navigating Data Privacy in LATAM: Laws, Trends, and Compli...
TrustArc
 
Farrell_Programming Logic and Design slides_10e_ch02_PowerPoint.pptx
bashnahara11
 
Ad

#DataUnlimited - Google Big Data Unlimited

  • 1. Google Cloud Platform Big Data Unlimited Sebastien Agnan, Solution Engineer sagnan@google.com
  • 3. Building what’s next 3 Time to Understanding Typical Big Data Processing Programming Resource provisioning Performance tuning Monitoring Reliability Deployment & configuration Handling growing scale Utilization improvements
  • 4. Building what’s next 4 Time to Understanding Big Data with Google: Focus on insight, not infrastructure. Programming
  • 5. StoreCapture Analyze BigQuery Big Data at Google Process DataflowCloud Storage DatastoreCloud SQL Hadoop/SparkKafka Pub/Sub Hadoop/Spark
  • 6. • Publish and Subscription Service • Simple • Seamlessly Scalable • Many-to-many or one-to-one • Guaranteed Durable Delivery • Push or Pull • Secure and Encrypted PUB / SUB : Real-time and reliable messaging
  • 7. Building what’s next 7 Lorem Ipsum Lorem Ipsum Reliable and Flexible Storage Performant and economical Blob, Block, Key Value, SQL and NoSQL Easy to use : API High performance : 99.95% SLA and 24x7 phone support Strong ecosystem of partners Data location (US,EU or APAC)
  • 8. Building what’s next 8 Merges batch and stream processing Data processing pipelines Monitoring interface Significantly lower cost Google Cloud Dataflow makes complex data analysis simple
  • 9. #gcpug | #googlecloud Google Cloud Dataflow Optimize Schedule GCS GCS User Code & SDK Monitoring UI Life of a Pipeline
  • 10. Building what’s next 10 Scales automatically No setup or administration Stream up to 100,000 rows p/sec Easily integrates with third-party software Google BigQuery makes complex data analysis simple
  • 11. #gcpug | #googlecloud BigQuery Analytic Service in the Cloud BigQuery Analyze ExportImport How to use BigQuery? Google AnalyticsETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop
  • 12. Building what’s next 12 A more flexible App Engine Complete Platform-as-a-Service. Focus on Code. Not infrastructure. Develop in your favorite language. Deploy with a click.
  • 14. StoreCapture Analyze BigQuery Big Data at Google - Easy, Inexpensive, and Fast Process DataflowCloud Storage DatastoreCloud SQL Hadoop/SparkKafka Pub/Sub Hadoop/Spark
  • 15. NEXT PARIS 13 OCtobre 2015 https://goo.gl/wgKqhT
  • 16. Google confidential │ Do not distribute Thank You
  • 17. #gcpug | #googlecloud Column Oriented Storage Record Oriented Storage Column Oriented Storage Less bandwidth, More compression