The Distributed SQL Blog

May 28, 2019

How to Handle Runaway Queries in a Distributed SQL Database

Runaway queries are queries that scan through a large set of data. Such queries consume vast amounts of I/O and CPU resources of the database in the background, even if the results appear as harmless timeouts to the end user or the client application. How do runaway queries get executed in the first place, anyway? Everyone who uses databases has at some point or another entered SELECT * from some_large_table, only to realize they forgot to add a LIMIT n clause.

…

Develop IoT Apps with Confluent Kafka, KSQL, Spring Boot & Distributed SQL

May 23, 2019

By Sid Choudhury

Distributed SQL How To Kafka Spring

Develop IoT Apps with Confluent Kafka, KSQL, Spring Boot & Distributed SQL

In our previous post “5 Reasons Why Apache Kafka Needs a Distributed SQL Database”, we highlighted why Kafka-based data services need a distributed SQL database like YugabyteDB as their highly scalable, long-term persistent data store. In this post, we show how Confluent Kafka, KSQL, Spring Boot and YugabyteDB can be integrated to develop an application for managing Internet-of-Things (IoT) sensor data.

The Scenario – IoT-Enabled Fleet Management

A trucking company wants to track its fleet of IoT-enabled vehicles that are delivering shipments across the country.

…

My Experience as a YugabyteDB Engineering Intern

May 22, 2019

By Harshith Depa

Community News

My Experience as a YugabyteDB Engineering Intern

I recently finished my winter 2019 term as a software engineering intern at YugaByte and it was a fantastic experience! I found the opportunity through their posting on the University of Waterloo internal job board and it was also the first time I had heard of YugabyteDB. I had previously completed two other internships at much larger companies and I was a little skeptical of startups. The fact that a friend’s internship at a startup had ended halfway due to the startup folding did not help allay my concerns.

…

5 Reasons Why Apache Kafka Needs a Distributed SQL Database

May 21, 2019

By Sid Choudhury

Distributed SQL How It Works Kafka

5 Reasons Why Apache Kafka Needs a Distributed SQL Database

Modern enterprise applications must be super-elastic, adaptable, and running 24/7. However, traditional request-driven architectures entail a tight coupling of applications. For example, App 1 asks for some information from App 2 and waits. App 2 then sends the requested information to App 1. This sort of app-to-app coupling hinders development agility and blocks rapid scaling.

In event-driven architectures, applications publish events to a message broker asynchronously. They trust the broker to route the message to the right application,

…

Achieving Fast Failovers After Network Partitions in a Distributed SQL Database

May 15, 2019

By Timur Yusupov

Distributed SQL Google Spanner How It Works Jepsen Tests

Achieving Fast Failovers After Network Partitions in a Distributed SQL Database

In February of this year, Kyle Kingsbury of Jepsen.io was conducting formal testing of YugabyteDB for correctness under extreme and unorthodox conditions. Obviously, simulating all manner of network partitions is part of his testing methodology. As a result, during his testing he spotted the fact that although nodes would reliably come back after a failure, the recovery itself was taking roughly 25 seconds to occur. We certainly didn’t like the sound of that!

…

YugabyteDB 2.0: A Distributed SQL Roadmap

May 13, 2019

By Sid Choudhury

Community News Company News Distributed SQL

YugabyteDB 2.0: A Distributed SQL Roadmap

The YugabyteDB community is eagerly looking forward to v2.0, the next major release expected in Summer 2019. Needless to say, we are very excited about the depth and breadth of features in this release. Here’s an overview of the various areas we expect the new release to cover.

Distributed SQL

YSQL is YugabyteDB’s PostgreSQL wire-compatible distributed SQL API. Thanks to our design decision to use the existing PostgreSQL query layer as a starting point,

…

May 9, 2019

By Bryn Llewellyn

Community News

Why I Moved from Oracle to YugaByte

I’m thrilled at the prospect of what lies ahead of me in my new job at YugaByte. I’ve just started in the role of Developer Advocate for YugabyteDB. This is an open source, cloud native, distributed SQL database—in other words, a database for the modern world. There’s an excellent brief description here.

I made this move a couple of weeks ago after almost thirty years at Oracle. I started with Oracle in the UK,

…

Wrapping Up: Jepsen Test Results for YugabyteDB 1.2 Webinar

May 2, 2019

By Jimmy Guerrero

Community News Jepsen Tests YugabyteDB

Wrapping Up: Jepsen Test Results for YugabyteDB 1.2 Webinar

If you missed the April 30 webinar with Kyle Kingsbury, the creator of Jepsen and Karthik Ranganathan, CTO at YugaByte, you can check out the playback here and download the slides here.

Kyle did a great deep-dive into his testing approach, research methodology and what he found when applied to YugabyteDB. If you are looking for an unvarnished and honest assessment of YugabyteDB’s consistency and transactional claims,

…

Why Distributed SQL Beats Polyglot Persistence for Building Microservices?

May 2, 2019

By Sid Choudhury

Amazon Web Services Distributed SQL Kubernetes

Why Distributed SQL Beats Polyglot Persistence for Building Microservices?

Today’s microservices rely on data with different models and read/write access patterns. Polyglot persistence, first introduced in 2008, states that each such data model should be powered by an independent database that is purpose-built for that model. This post highlights the loss of agility that microservices development and operations suffer when adopting polyglot persistence. We review how distributed SQL serves as an alternative approach that doesn’t compromise this agility.

E-Commerce Example

Polyglot Persistence in Action at an E-Commerce App (Source: Martin Fowler)

Breaking down monolithic applications into smaller,

…

6 Technical Challenges Developing a Distributed SQL Database

April 26, 2019

By Karthik Ranganathan

Amazon Aurora Distributed SQL Google Spanner How It Works Jepsen Tests

6 Technical Challenges Developing a Distributed SQL Database

You can join the discussion on HackerNews here.

We crossed the three year mark of developing the YugabyteDB database in February of 2019. It has been a thrilling journey thus far, but not without its fair share of technical challenges. There were times when we had to go back to the drawing board and even sift through academic research to find a better solution than what we had at hand.

…

The Distributed SQL Blog

The Scenario – IoT-Enabled Fleet Management

Distributed SQL

E-Commerce Example

Explore Distributed SQL and YugabyteDB in Depth