How To

Best Practices for Deploying Confluent Kafka, Spring Boot & Distributed SQL Based Streaming Apps on Kubernetes

June 12, 2019

Distributed SQL How To Kafka Kubernetes Spring

Best Practices for Deploying Confluent Kafka, Spring Boot & Distributed SQL Based Streaming Apps on Kubernetes

In our previous post “Develop IoT Apps with Confluent Kafka, KSQL, Spring Boot & Distributed SQL”, we highlighted how Confluent Kafka, KSQL, Spring Boot and YugabyteDB can be integrated to develop an application responsible for managing Internet-of-Things (IoT) sensor data. In this post, we will review the challenges and best practices associated with deploying such a stateful streaming application on Kubernetes.

Challenges of Streaming Apps

Streaming apps are inherently stateful in nature given the large volume of data managed and that too continuously.

…

Spring Data REST Services Powered By Distributed SQL – A Hands-on Lab

May 30, 2019

By Sid Choudhury

Distributed SQL How To Pivotal Container Service (PKS)Spring

Spring Data REST Services Powered By Distributed SQL – A Hands-on Lab

The Spring application development framework is arguably the most popular framework among Java developers. However, given its extensive breadth and depth, it can be difficult to learn for new users. As the name suggests, Spring Boot makes it easy to `boot up` with the Spring framework. It shortens development time by taking an opinionated view of the framework and the associated third-party libraries. Annotation configuration and default codes are two examples of such a view.

…

Develop IoT Apps with Confluent Kafka, KSQL, Spring Boot & Distributed SQL

May 23, 2019

By Sid Choudhury

Distributed SQL How To Kafka Spring

Develop IoT Apps with Confluent Kafka, KSQL, Spring Boot & Distributed SQL

In our previous post “5 Reasons Why Apache Kafka Needs a Distributed SQL Database”, we highlighted why Kafka-based data services need a distributed SQL database like YugabyteDB as their highly scalable, long-term persistent data store. In this post, we show how Confluent Kafka, KSQL, Spring Boot and YugabyteDB can be integrated to develop an application for managing Internet-of-Things (IoT) sensor data.

The Scenario – IoT-Enabled Fleet Management

A trucking company wants to track its fleet of IoT-enabled vehicles that are delivering shipments across the country.

…

Distributed SQL on Google Kubernetes Engine (GKE) with YugabyteDB’s Helm Chart

April 10, 2019

By Sid Choudhury

Distributed SQL Google Cloud Platform How To Kubernetes

Distributed SQL on Google Kubernetes Engine (GKE) with YugabyteDB’s Helm Chart

The glory days of the heavy-weight hypervisor are slowly fading away, and in the last few years, containerization of applications and services is the new reality. With containerization, enterprises can prototype, deploy, and meet scale demands more quickly. To systematically and efficiently manage these large-scale deployments, enterprises have bet on technologies like Kubernetes (aka k8s), a powerful container orchestrator, to get the job done. Kubernetes was originally developed by Google, but it has been open sourced since 2014 and is today developed by a large community of contributors.

…

How to Achieve High Availability, Low Latency and GDPR Compliance in a Distributed SQL Database

April 3, 2019

By Sid Choudhury

Distributed SQL How It Works How To MongoDB PostgreSQL

How to Achieve High Availability, Low Latency and GDPR Compliance in a Distributed SQL Database

YugabyteDB is purpose built for geo-distributed applications that require high availability, high performance and regulatory compliance. In this blog, we are going to “look under the hood,” to explore exactly how YugabyteDB distributes data across multiple clouds, regions and availability zones.

How to Monitor YugabyteDB with Prometheus on Docker?

February 12, 2019

By Sid Choudhury

Docker How To Kubernetes

How to Monitor YugabyteDB with Prometheus on Docker?

Observability is absolutely vital to operating business-critical data infrastructure at scale. This is why observability is not an afterthought in the YugabyteDB architecture. Every layer of YugabyteDB exposes metrics in the Prometheus format at the /prometheus-metrics endpoint. Given that Prometheus is essentially the de-facto standard for build-your-own infrastructure monitoring and alerting, you can get started with monitoring YugabyteDB in almost no time.

This post details how to install and configure both YugabyteDB and Prometheus on Docker so that you can run simple queries on the Prometheus UI.

…

How to Migrate Data from Cassandra or MySQL to YugabyteDB?

January 23, 2019

By Jimmy Guerrero

Apache Cassandra Database Migration How To

How to Migrate Data from Cassandra or MySQL to YugabyteDB?

If you work with databases, at some point you are going to need to get data in and out them using a format that can be consumed by a completely different system. YugabyteDB makes use of CSV files to make this as easy as possible. The CSV format is arguably the most universally portable way to get data migrations accomplished.

TL;DR – YugabyteDB makes use of Cassandra’s COPY FROM command and a forked version of Cassandra’s Bulk Loader to get data into the system.

…

YugaByte Database Engineering Update – Nov 27, 2018

November 27, 2018

By Karthik Ranganathan

Apache Cassandra Community News How It Works How To Performance Benchmarks

YugaByte Database Engineering Update – Nov 27, 2018

Lots has happened since our last engineering update about 3 months ago. Below are some of the highlights.

PostgreSQL API Updates & PostgresConf Silicon Valley Wrap-Up

We have made a lot of progress on YSQL, the PostgreSQL compatible distributed SQL API for YugabyteDB! You can also read about YSQL architecture which covers how distributed SQL is implemented in YugabyteDB.

We were at the first ever PostgresConf Silicon Valley in October 2018.

…

Distributed Backups in Multi-Region YugabyteDB Clusters

November 19, 2018

By Alan Caldera

How It Works How To Performance Benchmarks YugabyteDB

Distributed Backups in Multi-Region YugabyteDB Clusters

Our post Getting Started with Distributed Backups in YugabyteDB details the core architecture powering distributed backups in YugabyteDB. It also highlights a few backup/restore operations in a single region, multi-AZ cluster. In this post, we perform distributed backups in a multi-region YugabyteDB cluster and verify that we achieve performance characteristics similar to those observed in a single region cluster.

We configured a 9 node cluster with 3 availability zones across 2 regions and repeated the benchmark introduced in the post.

…

Getting Started with Distributed Backups in YugabyteDB

November 19, 2018

By Kannan Muthukkaruppan

How It Works How To Performance Benchmarks YugabyteDB

Getting Started with Distributed Backups in YugabyteDB

YugabyteDB is a distributed database with a Google Spanner-inspired strongly consistent replication architecture that is purpose-built for high availability and high performance. This architecture allows administrators to place replicas in independent fault domains, which can be either availability zones or racks in a single region or different regions altogether. These types of multi-AZ or multi-region deployments have the immediate advantage of guaranteeing organizations a higher order of resilience in the event of a zone or region failure.

…

How To

Challenges of Streaming Apps

The Scenario – IoT-Enabled Fleet Management

PostgreSQL API Updates & PostgresConf Silicon Valley Wrap-Up

Explore Distributed SQL and YugabyteDB in Depth