GCP Storage Options: Technical Details

Cloud Datastore Bigtable Cloud Storage Cloud SQL Cloud Spanner BigQuery Cloud Memorystore
Key features
  • Fully-managed document NoSQL database
  • Semi-structured / hierarchical data
  • Online on-demand scaling
  • Transactions on up to 500 documents
  • Strong consistency across regions
  • 1,000,000 concurrent real-time connections
  • Fully managed wide-column NoSQL DB
  • Row-level atomic operations
  • Single digit millisecond reads and writes with linear scale
  • Replication is eventually consistent
  • HBase client compatible
  • Fully managed object storage service
  • Storage tiers to optimize cost (standard, nearline, coldline)
  • Single API and fast access to data
  • Default encryption
  • Strong consistency for listings
  • Fully managed relational databases
  • Off-the-shelf binaries
  • Eliminate mundane management tasks
  • High availability, automatic backups, security updates
  • Fully managed relational database
  • Distributed ACID transactions
  • Built-in HA (up to 99.999%)
  • No planned downtime for anything
  • Online elastic compute scaling
  • Storage autoscales
  • Serverless fully managed data warehouse
  • Partitioned columnar storage
  • Streaming inserts
  • Supports MERGEs, UPDATEs, DELETEs
  • Declarative machine learning in SQL
  • Fully Managed Redis
  • Application cache for sub-millisecond data access
Type NoSQL document NoSQL wide column Blobstore Relational SQL for OLTP Relational SQL for OLTP Relational SQL for OLAP key-value store
Transactions Yes Single-row No Yes Yes No Yes
Complex queries No No No Yes Yes Yes n/a
Capacity Terabytes+ Petabytes+ Petabytes++ Terabytes+ Petabytes++ Petabytes++ 1 TB
Unit size 1 MB/entity ~10 MB/cell ~100 MB/row 5 TB/object Determined by DB engine 10,240 MIB/row 10 MB/row 16 DB/instance
Best for Semi-structured application data,durable key-value data "Flat" data,Heavy read/write,events,analytical data Structured and unstructured binary or object data Web frameworks, existing applications Large-scale database apllications (> ~2TB) Interactive querying, offline analytics Caching Strings, hashes, list, set, map
Data Distribution Regional or global Regional or global n/a zonal Regional or global n/a zonal
Replica Consistency strong eventual strong strong strong n/a eventual
Key verticals
  • Media
  • Mobile
  • Financial Services
  • Games
  • loT
  • Ad-Tech,MarTech
  • Financial Services
  • Internet of Things(IoT)
  • Media
  • Retail
  • Media
  • Mobile
  • Financial Services
  • Games
  • loT
  • SaaS platforms
  • Retail & ecommerce
  • Mobile
  • Saas
  • Retail
  • Financial Services
  • Healthcare
  • Gaming
  • Retail
  • Advertising
  • IoT
  • Gaming
  • Financial Services
  • Gaming
  • Mobile
  • Retail
Key workloads
  • User profiles
  • User messaging
  • Product catalogs
  • Game state
  • Offline edge/data
  • Real-time analytics
  • Personalization,recommendations
  • Monitoring (time-series)
  • Geospatial datasets
  • Graphs
  • Content storage & delivery: music,video,images
  • Data lake analytics,Ml and large compute
  • Data protection: offsite backups/archival(cold storage)
  • Websites,blog,content management systems(CMS)
  • Business Intelligence (BI) applications
  • ERP,CRM and ecommerce applications
  • Inventory management
  • Financial transactions
  • Lots of real-time data
  • Global meta-data
  • Interactive report on large data
  • Data Science and advanced analyses
  • Big Data/ML processing using SQL
  • Caching for large websites
  • Gaming, both mobile and web
  • Mobile workloads
Ballpark P95 latency <50ms Single digit ms <50ms Single digit ms Single digit ms for tuned consistency with stateless else <30ms <100ms <1ms