BigQuery: Cloud Data Warehouse

Google Cloud Next ’20: OnAir | Learn what's new in BigQuery's roadmap, now available on demand. Watch session DA200 today.

Jump to

BigQuery

Serverless, highly scalable, and cost-effective multi-cloud data warehouse designed for business agility. Try BigQuery free ● Created with Sketch. Analyze petabytes of data using ANSI SQL at blazing-fast speeds, with zero operational overhead ● Created with Sketch. Run analytics at scale with 26%–34% lower three-year TCO than cloud data warehouse alternatives ● Created with Sketch. Democratize insights with a trusted, and more secure platform that scales with your needs ● Created with Sketch. Gain insights from data across clouds with a flexible, multi-cloud analytics solution Analyst logo

Forrester Research names Google Cloud a Leader in Data Management for Analytics

Gain insights with real-time and predictive analytics

Query streaming data in real time and get up-to-date information on all your business processes. Predict business outcomes easily with built-in machine learning and without the need to move data. Securely access and share analytical insights in your organization with a few clicks. Easily create stunning reports and dashboards using popular business intelligence tools, out of the box.

Protect your data and operate with trust

Rely on BigQuery’s robust security, governance and reliability controls that offer high availability and a 99.99% uptime SLA. Protect your data with encryption by default and customer-managed encryption keys. Key features

Key features

BigQuery Omni (private alpha)

BigQuery Omni is a flexible, multi-cloud analytics solution, powered by Anthos, that allows you to analyze data across clouds. Use standard SQL and BigQuery’s familiar interface to quickly answer questions and share results from a single pane of glass across your datasets. Complete this form to learn more.

Data QnA (private alpha)

Data QnA is a natural language interface for petabyte-scale analytics on BigQuery and federated data sources. It helps democratize insights for business users, improve the productivity of BI teams and increase access to data for anyone through its ability to be integrated into common tools like Sheets, chatbots, BI platforms and custom apps. Complete this form to learn more.

BigQuery ML

BigQuery ML enables data scientists and data analysts to build and operationalize ML models on planet-scale structured or semi-structured data, directly inside BigQuery, using simple SQL—in a fraction of the time. Export BigQuery ML models for online prediction into Cloud AI Platform or your own serving layer. Learn more about the models we currently support.

BigQuery BI Engine

BigQuery BI Engine is a blazing-fast in-memory analysis service for BigQuery that allows users to analyze large and complex datasets interactively with sub-second query response time and high concurrency. BigQuery BI Engine seamlessly integrates with familiar tools like Data Studio and will help accelerate data exploration and analysis for Looker, Sheets, and our BI partners in the coming months.

Connected Sheets

Connected Sheets allows users to analyze billions of rows of live BigQuery data in Google Sheets without requiring SQL knowledge. Users can apply familiar tools—like pivot tables, charts, and formulas—to easily derive insights from big data. Learn more about Connected Sheets and how to get started here. View all features Modern data warehousing with BigQuery (demo)

Modern data warehousing with BigQuery (demo)

7:31 VIDEO

Demo showcasing how to use advanced analytics in BigQuery to optimize operations

Customers

Data analysis platform with modeling and machine learning capability

02:21

UPS uses BigQuery to achieve precise package volume forecasting for the company.

Story highlights

More than 1 billion data points analyzed daily ML models help to maximize asset use & scale for the company Prescriptive analytics for supply-chain efficiency

Industry

Retail and consumer goods

Twitter modernizes ad engagement analytics platform and aggregates millions of metrics per second.

The Home Depot nails its customer service with timely data that helps keep 50K items stocked across 2K stores.

Dow Jones unlocks business value of 1.3 billion news articles and uncovers hidden relationships and insights. See all customers What's new

What's new

Sign up for Google Cloud newsletters to receive product updates, event information, special offers, and more. Read the blog: BigQuery Omni, now in private alpha

Read the blog: BigQuery Omni, now in private alpha

Blog post Bring multi-cloud analytics to your data with BigQuery Omni Read the blog Read the blog: Data QnA now in privaate alapha

Blog post Ask questions to BigQuery and get instant answers through Data QnA Read the blog BigQuery Flex logo

Blog post Purchase BigQuery flex slots for as little as 60 seconds at a time Read the blog Query data logo

Blog post Query data without a credit card: Learn how to get started with BigQuery sandbox Read the blog Looker logo

Report Better Together: BigQuery & Looker help make petabytes of data easily accessible Learn more BigQuery Weekly Data Challenge logo

Event Engage in the BigQuery Weekly Data Challenge for a chance to win $500 in credits Register now

Documentation

Quickstart

Quickstart using the web UI

Learn how to use the BigQuery web UI in the GCP Console as a visual interface to complete tasks like running queries, loading data, and exporting data. Learn more Quickstart

Quickstart using the BigQuery command-line tool

Learn how to use the BigQuery command-line tool to run queries, load data, and export data. Learn more Quickstart

Quickstart using client libraries

Learn how to use the BigQuery API in your favorite programming language using the Google Cloud client libraries. Learn more Tutorial

Creating and using tables

Learn how to create and use standard tables in BigQuery. Learn more Tutorial

Specifying a schema

Learn how to create and update a schema for your table. Learn more Tutorial

Protecting data with Cloud KMS keys

Learn how you can use customer-managed encryption keys (CMEK) for BigQuery. Learn more Tutorial

Controlling access to datasets

Learn how to control access to datasets in BigQuery. Learn more Google Cloud Basics

BigQuery resources

Find BigQuery pricing information along with current rate limits, slots, datasets, quotas, and more. Learn more Tutorial

Explore what you can build with BigQuery

Discover BigQuery technical resource guides to help manage your data. Learn more

Not seeing what you’re looking for?

View all product documentation

Explore more docs

Quickstarts Get a quick intro to using this product. How-to guides Learn to complete specific tasks with this product. Tutorials Browse walkthroughs of common uses and scenarios for this product. APIs & references View APIs, references, and other resources for this product. Release notes Read about the latest releases for BigQuery Use cases

Use cases

Use case Migrating data from Teradata Migrate your on-premises legacy data warehouse to an agile, cloud-based data warehouse solution. The combination of BigQuery Data Transfer Service (DTS) and a special on-premises migration agent lets you copy data to BigQuery, from a legacy warehouse such as Teradata. And you can monitor recurring data loads to BigQuery by using BigQuery DTS’s web UI. We also provide additional easy-to-use tools and a global partner support system. Learn more. BigQuery diagram

Google Cloud basics

Migrating data warehouses to BigQuery

Part one in a series that helps you transition from an on-premises data warehouse to BigQuery on Google Cloud. Learn more Tutorial

Migrating data from Teradata: Query translation

A proof-of-concept tutorial that shows you how to convert various non-standard Teradata SQL statements to standard SQL. Learn more Best practice

Teradata migration details and options

More details, options and beta features when using the BigQuery Data Transfer Service to migrate data from Teradata to BigQuery. Learn more Use case Migrating from Amazon Redshift to BigQuery The BigQuery Data Transfer Service allows you to copy your data from an Amazon Redshift data warehouse to BigQuery. The service will engage migration agents in Google Kubernetes Engine and trigger an unload operation from Amazon Redshift to a staging area in an Amazon S3 bucket. Then the BigQuery Data Transfer Service transfers your data from the Amazon S3 bucket to BigQuery. BigQuery diagram

Google Cloud basics

Introduction to BigQuery Data Transfer Service

Overview of the BigQuery Data Transfer Service that automates data movement into BigQuery on a scheduled, managed basis. Learn more Tutorial

Migrating data from Amazon Redshift

A step-by-step process of setting up a data migration from Amazon Redshift to BigQuery. Learn more Architecture

Migrating data warehouses to BigQuery: Data pipelines

Explore how to migrate your upstream data pipelines by discussing data pipelines: what they are and what to think about when migrating them. Learn more View all technical guides All features

All features

Serverless	With serverless data warehousing, Google does all resource provisioning behind the scenes, so you can focus on data and analysis rather than worrying about upgrading, securing, or managing the infrastructure.
Multi-cloud capabilities	BigQuery Omni allows you to analyze data across clouds using standard SQL and without leaving BigQuery’s familiar interface. Its infrastructure is powered by Anthos, a modern application platform, allowing your data analysts or data scientists to have a completely seamless data analysis experience.
Natural language processing	Data QnA makes it easy for anyone to access the data insights they need through NLP – all while maintaining your governance and security controls. Based on Analyza (Google Research), Data QnA enables you to analyze petabytes of data via BigQuery, and can be embedded where users work; chatbots, spreadsheets, BI platforms like Looker, or custom-built UIs. Complete this form to learn more.
Real-time analytics	BigQuery’s high-speed streaming insertion API provides a powerful foundation for real-time analytics, making your latest business data immediately available for analysis. You can also leverage Pub/Sub and Dataflow to stream data into BigQuery.
Automatic high availability	BigQuery transparently and automatically provides highly durable, replicated storage in multiple locations and high availability with no extra charge and no additional setup.
Standard SQL	BigQuery supports a standard SQL dialect that is ANSI:2011 compliant, which reduces the need for code rewrites. BigQuery also provides ODBC and JDBC drivers at no cost to ensure your current applications can interact with its powerful engine.
Federated query and logical data warehousing	Through powerful federated queries, BigQuery can process external data sources in object storage (Cloud Storage) for Parquet and ORC open source file formats, transactional databases (Bigtable, Cloud SQL), or spreadsheets in Drive. All this can be done without moving the data.
Convergence of data warehouse and data lake	Run open source data science workloads (Spark, TensorFlow, Dataflow and Apache Beam, MapReduce, Pandas and scikit-learn) directly on BigQuery using the Storage API. The Storage API provides a much simpler architecture and less data movement, and doesn't need to have multiple copies of the same data.
Materialized Views	Accelerate query performance and reduce costs within your environment with BigQuery Materialized Views. It is easy to set up, effortless to use, and best of all it's real time, allowing you to quickly get answers to your questions.
Storage and compute separation	With BigQuery’s separated storage and compute, you have the option to choose the storage and processing solutions that make sense for your business and control access and costs for each.
Automatic backup and easy restore	BigQuery automatically replicates data and keeps a seven-day history of changes, allowing you to easily restore and compare data from different times.
Geospatial data types and functions	BigQuery GIS uniquely combines the serverless architecture of BigQuery with native support for geospatial analysis, so you can augment your analytics workflows with location intelligence. Simplify your analyses, see spatial data in fresh ways, and unlock entirely new lines of business with support for arbitrary points, lines, polygons, and multi-polygons in common geospatial data formats.
BigQuery data transfer service	The BigQuery Data Transfer Service automatically transfers data from external data sources, like Google Marketing Platform, Google Ads, YouTube, and partner SaaS applications to BigQuery on a scheduled and fully managed basis. Users can also easily transfer data from Teradata and Amazon S3 to BigQuery.
Big data ecosystem integration	With Dataproc and Dataflow, BigQuery provides integration with the Apache big data ecosystem, allowing existing Hadoop/Spark and Beam workloads to read or write data directly from BigQuery using the Storage API.
Petabyte scale	Get great performance on your data, while knowing you can scale seamlessly to store and analyze petabytes to exabytes of data with ease.
Flexible pricing models	On-demand pricing lets you pay only for the storage and compute that you use. Flat-rate pricing with Reservations enables high-volume users or enterprises to choose price predictability and workload management seamlessly. For more information, see BigQuery pricingorcost controls.
Data governance and security	BigQuery provides strong security and governance controls with fine-grained controls through integration with Identity and Access Management. Rest assured knowing your data is encrypted at rest and in transit by default.
Geo-expansion	BigQuery gives you the option of geographic data control (in US, Asia, and European locations), without the headaches of setting up and managing clusters and other computing resources in-region.
Foundation for AI	Besides bringing ML to your data with BigQuery ML, integrations with AI Platform Prediction and TensorFlow enable you to train powerful models on structured data in minutes with just SQL.
Foundation for BI	BigQuery forms the data warehousing backbone for modern BI solutions and enables seamless data integration, transformation, analysis, visualization, and reporting with tools from Google and our technology partners.
Flexible data ingestion	Automatically move data from hundreds of popular business SaaS applications into BigQuery for free with Data Transfer Service (DTS) or leverage data integration tools like Cloud Data Fusion, Informatica, Talend, and more. Load and transform data at any scale from hybrid and multi-cloud applications.
Programmatic interaction	BigQuery provides a REST API for easy programmatic access and application integration. Client libraries are available in Java, Python, Node.js, C#, Go, Ruby, and PHP. Business users can use Google Apps Script to access BigQuery from Sheets.
Rich monitoring and logging	BigQuery provides rich monitoring, logging, and alerting through Cloud Audit Logs and it can serve as a repository for logs from any application or service using Cloud Logging.
Public datasets	Google Cloud Public Datasets offer a powerful data repository of more than 100 high-demand public datasets from different industries. Google provides free storage for all public datasets, and customers can query up to 1 TB of data per month at no cost.

Pricing

BigQuery charges for data storage, streaming inserts, and querying data, but loading and exporting data are free of charge. For detailed pricing information, please view the pricing guide.

Item	Price
Storage	$0.02 per GB, per month $0.01 per GB, per month for long-term storage
Streaming Inserts	$0.01 per 200 MB
Loading, copying, or exporting data; metadata operations	Free

If you pay in a currency other than USD, the prices listed in your currency on Google Cloud SKUs apply.

Subscription type	Price
Pay-as-you-go	$5 per TB First terabyte (1 TB) per month is free*
Flat-rate pricing	Starts at $1,700/month for a dedicated reservation of 100 slots. $4 per hour for 100 Flex slots. For more information, see flat-rate pricing.

Additional details: BigQuery ML pricing Non-USD prices listed on Google Cloud SKUs * The first 1 TB of data processed with BigQuery each month is free BigQuery’s quota policy applies for these operations View pricing details Partners

Partners

From data integration to analytics, Google Cloud partners have integrated their industry-leading tools with BigQuery for loading, transforming, and visualizing data.

Data integration

BI and data visualization

Consulting partners

Connectors and developer tools

A product or feature listed on this page is in alpha. For more information on our product launch stages, see here.

Take the next step

Start building on Google Cloud with $300 in free credits and 20+ always free products. Try BigQuery free Need help getting started? Contact sales Work with a trusted partner Find a partner Continue browsing See all products ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● Sign up for the Google Cloud newsletter

Aug	SEP	Oct
	16
2019	2020	2021