Google Cloud | What is Bigtable

How BIG Is Cloud Bigtable?

“Building an application that needs low latency and high throughput?—You need a database that can scale for a large number of reads and writes. Cloud Bigtable is designed to handle just that. 

Cloud Bigtable is a fully managed wide-column NoSQL database that scales to petabyte-scale. It’s optimized for low latency, large numbers of reads and writes, and maintaining performance at scale. It offers really low latency of the order of single-digit milliseconds. It is an ideal data source for time series and MapReduce-style operations. Bigtable supports the open-source HBase API standard to easily integrate with the Apache ecosystem including HBase, Beam, Hadoop and Spark. It also integrates with Google Cloud ecosystem including Memorystore, BigQuery, Dataproc, Dataflow and more. 

Google Cloud | What is Bigtable

Some Cloud Bigtable Features

  • Data is by default encrypted with Google managed encryption keys but, for specific compliance and regulatory requirements if customers need to manage their own keys, customer managed encryption keys (CMEK) are also supported.
  • Bigtable backups let you save a copy of a table’s schema and data, then restore from the backup to a new table at a later time. Backups can help you recover from application-level data corruption or from operator errors such as accidentally deleting a table.

Scale and High Availability (HA)

How BIG is Bigtable? Bigtable has nearly 10 Exabytes of data under management. 

It delivers highly predictable performance that is linearly scalable. Throughput can be adjusted by adding/removing nodes — each node provides up to 10,000 operations per second (read and write). You can use Bigtable as the storage engine for large-scale, low-latency applications as well as throughput-intensive data processing and analytics. It offers high availability with an SLA of 99.9% for zonal instances. It’s strongly consistent in a single cluster; replication between clusters adds eventual consistency. If you leverage Bigtable’s multi cluster routing across two clusters, the  SLA increases to 99.99% and if that routing policy is utilized across clusters in 3 different regions you get a 99.999% uptime SLA.

Replication for Cloud Bigtable enables you to increase the availability and durability of your data by copying it across multiple regions or multiple zones within the same region. To use replication in a Bigtable instance, just create an instance with more than 1 cluster or add clusters to an existing instance. Bigtable supports up to 4 replicated clusters located in Google Cloud zones where Bigtable is available. Placing clusters in different zones or regions enables you to access your data even if one zone or region becomes unavailable. Bigtable treats each cluster in your instance as a primary cluster, so you can perform reads and writes in each cluster. You can also set up your instance so that requests from different types of applications are routed to different clusters. The data and changes to data are synchronized automatically across clusters. 

How does it optimize throughput

Through separation of processing and storage, Cloud Bigtable is able to automatically configure throughput by adjusting the association of nodes and data. In the rebalancing example, if Node A is experiencing a heavy load, the routing layer can move some of the traffic to a less heavily loaded node, improving overall performance. Resizing comes into play when a node is added to again ensure a balanced load across nodes, ensuring best overall throughput.

Click to enlarge

Choice of app profile and traffic routing can also affect performance. An app profile with multi-cluster routing automatically routes requests to the closest cluster in an instance from the perspective of the application, and the writes are then replicated to the other clusters in the instance. This automatic choice of the shortest distance results in the lowest possible latency. An app profile that uses single-cluster routing can be optimal for certain use cases, like separating workloads or to have read-after-write semantics on a single cluster, but it will not reduce latency in the way multi-cluster routing does.

Replication can improve read throughput, especially when you use multi-cluster routing. And it can reduce read latency by placing your data geographically closer to your users.  Write throughput does not increase with replication because write to one cluster must be replicated to all other clusters in the instance. Resulting in each cluster spending the CPU resources to pull changes from the other clusters.

Conclusion

Bigtable is a database of choice for use cases that require a specific amount of  scale or throughput with strict latency requirements, such as IoT, AdTech, FinTech, gaming and ML based personalizations. You can ingest 100s of thousands of events per second from websites or IoT devices through Pub/Sub, process them in Dataflow and send them to Cloud Bigtable. For a more in-depth look into Cloud Bigtable check out the documentation or join the upcoming webinar with our experts Build high-throughput, low-latency apps with Cloud Bigtable.

For more #GCPSketchnote, follow the GitHub repo. For similar cloud content follow me on Twitter @pvergadia and keep an eye out on thecloudgirl.dev.

By: Priyanka Vergadia (Developer Advocate, Google)
Source: Google Cloud Blog



For enquiries, product placements, sponsorships, and collaborations, connect with us at hello@globalcloudplatforms.com. We'd love to hear from you!


Our humans need coffee too! Your support is highly appreciated, thank you!

Total
0
Shares
Previous Article
Google Cloud | Cloud Web Publishing | Clouds

Google Cloud VMware Engine Now HIPAA Compliant

Next Article
Google Cloud | AI ML

New Research Reveals What’s Needed For AI Acceleration In Manufacturing

Related Posts

IBM Delivers Its Highest Quantum Volume to Date, Expanding the Computational Power of its IBM Cloud-Accessible Quantum Computers

YORKTOWN HEIGHTS, N.Y., Aug. 20, 2020 /PRNewswire/ -- Today, IBM has unveiled a new milestone on its quantum computing road map, achieving the company's highest Quantum Volume to date. Combining a series of new software and hardware techniques to improve overall performance, IBM has upgraded one of its newest 27-qubit client-deployed systems to achieve a Quantum Volume 64. The company has made a total of 28 quantum computers available over the last four years through IBM Quantum Experience.  In order to achieve a Quantum Advantage, the point where certain information processing tasks can be performed more efficiently or cost effectively on a quantum computer, versus a classical one, it will require improved quantum circuits, the building blocks of quantum applications. Quantum Volume measures the length and complexity of circuits – the higher the Quantum Volume, the higher the potential for exploring solutions to real world problems across industry, government, and research. To achieve this milestone, the company focused on a new set of techniques and improvements that used knowledge of the hardware to optimally run the Quantum Volume circuits. These hardware-aware methods are extensible and will improve any quantum circuit run on any IBM Quantum system, resulting in improvements to the experiments and applications which users can explore. These techniques will be available in upcoming releases and improvements to the IBM Cloud software services and the cross-platform open source software development kit (SDK) Qiskit.  "We are always finding new ways to push the limits of our systems so that we can run larger, more complex quantum circuits and more quickly achieve a Quantum Advantage," said Jay Gambetta, IBM Fellow and Vice President, IBM Quantum. "IBM's full-stack approach gives an innovative avenue to develop hardware-aware applications, algorithms and circuits, all running on the most extensive and powerful quantum hardware fleet in the industry."  The IBM Quantum team has shared details on the technical improvements made across the full stack to reach Quantum Volume 64 in a preprint released on arXiv, today. IBM Quantum Highlights IBM has reached Quantum Volume 64 on a 27-qubit system deployed within the IBM Q Network [https://www.ibm.com/quantum-computing/network/overview/] 28 quantum computing systems deployed on the IBM Cloud over the last four years with eight systems boasting a Quantum Volume of 32 The IBM Q Network has 115 client, government, startup, partner, and university members 250,000+ registered users of the IBM Quantum Experience [https://www.ibm.com/quantum-computing/technology/experience/] Users routinely execute more than 1 Billion hardware circuits per day on IBM Quantum systems on the IBM Cloud  Researchers have published 250+ papers based on work on IBM Quantum systems About IBM Quantum IBM Quantum is an industry-first initiative to build quantum systems for business and science applications. For more information about IBM's quantum computing efforts, please visit www.ibm.com/ibmq.  For more information about the IBM Q Network, as well as a full list of all partners, members, and hubs, visit https://www.research.ibm.com/ibm-q/network/ Chris NayExternal CommunicationsIBM Researchcnay@us.ibm.com SOURCE IBM

Santa Casa da Misericórdia de Lisboa Delivering Telehealth Services on IBM Cloud

Patients can now schedule appointments and receive remote medical care through a mobile teleconsultation solution ARMONK, N.Y., Oct. 15, 2020 /PRNewswire/ -- IBM and Santa Casa da Misericórdia de Lisboa (SCML), a Portuguese institution of public utility recognized for its social, health and education work in the community, announced today they have worked together with IBM Garage and IBM Services to develop a teleconsultation solution running on IBM public cloud. The solution was designed to help people prioritize their health during the COVID-19 pandemic. IBM helped SCML develop a platform running on IBM public cloud that allows their patients to schedule and access teleconsultation services and remote medical care directly on their mobile phones. In addition to helping patients stay up-to-date with regular medical checkups, the platform is designed to reduce the need for patients to travel to a medical office or hospital and therefore, can help patients reduce exposure to COVID-19 when seeking medical care. The platform is designed so that patients can easily communicate with their medical providers and psychologists to get the assistance they need, quickly and from home. After the medical appointment is requested, the patient receives a notification by email or SMS with date and time information and the access link. Using a smartphone, the patient has to click on the link to start the teleconsultation. To date, SCML patients have used the platform to schedule nearly 300 medical appointments. For medical providers, the platform will enable them to initiate sessions through a phone call, video call or chat. Data and content only visible to the participants for the duration of the call, can build confidence for patients that their files are exchanged in a security rich, managed environment. Additionally, once the video call begins, it is kept between the doctor and patient without any third-party service or entity involved.   The IBM public cloud is the industry's most secure and open cloud for business, offering its  commercially-available state-of-art cryptographic technology for the cloud called "Keep Your Own Key."1 This gives enterprises the ability to retain control of their own encryption keys -- and the hardware security modules that protect them -- so customers are the only ones who can control access to their data. For clients in regulated industries like SCML, this need to protect client data is critical. Working together with a group of IBMers from the IBM Garage and IBM Services teams, SCML was able to develop this teleconsultation solution specifically tailored to its needs. As part of IBM's commitment to help organizations tap into the power of our many services and applications so they can maintain productivity in remote work environments during COVID, SCML was able to access a set of IBM services via the IBM public cloud at no cost for three months. Since most of SCML's patients will access the platform from a smartphone, the first adaption was to move from a computer-based telehealth solution that needed an email address for ID validation, to a solution that could be used on a mobile phone through SMS, audio calls and/or video calls. Running on IBM public cloud, the solution benefits from various features and functionalities supported by a robust containerized platform, able to scale according to demand. Additional foundational services were used for solution monitoring, access logging and user authentication. This solution assumes even more relevance as traditional methods have to be adapted as the world fights against COVID-19.  Portugal continues to face hundreds of new confirmed cases per day in the fall of 2020, mainly in the Metropolitan Area of Lisboa affirming this importance. Francisco Pessoa e Costa, Digital Transformation Manager of Santa Casa da Misericórdia de Lisboa adds, "We expect that this project will have great impact providing health care services in this pandemic period, especially among elderly, vulnerable and disadvantaged populations that we serve. In the middle of the pandemic situation in which we are living and all the instability and uncertainty that it brings, we are trying to do the best we can to protect those who need us. The entire SCML team is very proud and deeply involved in making this project a success and expanding its use among our users." "Challenges such as reimagining traditional operations during the COVID-19 pandemic give us an opportunity to apply cloud technology to make a real difference where it matters the most," said Gonçalo Costa Andrade, Enterprise Sales Manager, IBM Portugal. "This platform we helped build with SCML will enable its users to securely and conveniently access important medical, nutrition and psychology services." [1] Based on IBM Hyper Protect Crypto Service, the only service in the industry built on FIPS 140-2 Level 4-certified hardware. FIPS 140-2 Security Level 4 provides the highest level of security defined in this standard. At this security level, the physical security mechanisms provide a comprehensive envelope of protection around the cryptographic module with the intent of detecting and responding to all unauthorized attempts at physical access. About SCML SCML has more than five centuries of existence and a strong role in the Social Area. It's also developing important work in the Health, Education and Training, Culture, Research and Innovation areas, as well as in the area of Social Economy of Entrepreneurship. SCML guides its actions with the community by defending fundamental social values, in a perspective of proximity, respect and advocacy for good causes. About IBM Cloud For further information visit: www.ibm.com/cloud/ CONTACT:Kate GazzilloIBM Communicationskate.gazzillo@ibm.com  SOURCE IBM