Start Now

The Distributed SQL Blog

Thoughts on distributed databases, open source, and cloud native

Change Data Capture (CDC) Using a Spring Data Processing Pipeline

Change Data Capture (CDC) is a technique to capture changes in a source database system in real-time. The goal is to stream those changes as events through a data processing pipeline for further processing.

CDC enables many use cases, especially in modern microservices-based architecture that involves a lot of bounded services. It is the de-facto choice for use cases such as search indexes, in-memory data cache, real-time notifications, data sync between sources,

Read more

How YugabyteDB Scales Temenos’ Cloud Platform to 100K Business Transactions Per Second

Last week, Temenos made a major announcement – the Temenos Banking Cloud is achieving 100,000 transactions per second and running on a greener and more scalable platform.

Specifically, this has been a three-month project with multiple vendors, and YugabyteDB has had a significant role in the project’s success.

So, what does their benchmark of 100 million customers and 200 million deposit accounts with 100,000 transactions per second and 61 transactions per second per core mean for the database and business users?

Read more

Streaming Changes From YugabyteDB to Downstream Databases

In this blog post, we will stream data to downstream databases leveraging YugabyteDB’s Change Data Capture (CDC) feature introduced in YugabyteDB 2.13. This will publish the changes to Kafka and then stream those changes to databases like MySQL, PostgreSQL, and Elasticsearch.

YugabyteDB CDC Downstream Databases Topology

The diagram below represents how data will flow from YugabyteDB to Kafka and then further to the sink databases. 

Specifically,

Read more

Change Data Capture (CDC) From YugabyteDB to Elasticsearch

This post walks through how to send data from YugabyteDB to Elasticsearch using YugabyteDB’s Change Data Capture (CDC) feature.

Background

YugabyteDB CDC is a pull-based approach to CDC introduced in YugabyteDB 2.13 that reports changes from the database’s write-ahead-log (WAL). More specifically, the detailed CDC architecture is mentioned in YugabyteDB’s documentation.

Elasticsearch is a search engine based on the Lucene library. It also provides a distributed,

Read more

Celebrating Significant Growth Milestones in YugabyteDB’s Community!

The YugabyteDB community is at the heart of everything we do at Yugabyte. The worldwide community of open source enthusiasts, application builders, and database aficionados has been a fountain of inspiration, knowledge, and belonging for us. Here are some community highlights we’d love to call out.

Over 5K Users in YugabyteDB Community Slack

We planned to celebrate when we reached 5,000 YugabyteDB Community Slack members. But then we blinked and realized we were already over 5,500!

Read more

Change Data Capture (CDC) from YugabyteDB CDC to ClickHouse

This post describes how we can send data from YugabyteDB to ClickHouse through YugabyteDB’s Change Data Capture (CDC) feature.

Background

YugabyteDB CDC is a pull-based approach to CDC introduced in YugabyteDB 2.13 that reports changes from the database’s write-ahead-log (WAL). Additionally, the detailed CDC architecture is mentioned in YugabyteDB’s documentation.

ClickHouse is an open source column-oriented Online Analytical Processing (OLAP) database mainly used for analytical workloads.

Read more

Using GORM with YugabyteDB

GORM is an Object Relational Mapping (ORM) library for Golang. ORM converts data between incompatible type systems using object-oriented programming languages. An ORM library is a library that implements this technique and provides an object-oriented layer between relational databases and object-oriented programming languages.

In this blog post, we’ll show you how to:

  • Start a YugabyteDB cluster on your local Engine.
  • Download GORM and configure the sample project.
  • Create a simple Go application to run GORM with YugabyteDB.

Read more

The Power of a Modern Database: YugabyteDB and VMware Tanzu

As global companies engage in app modernization initiatives, their developers find it increasingly difficult to match those efforts with a strong data layer. These developers continue to work with costly monolithic databases like Oracle or DB2 and NoSQL databases that forgo strong data consistency and important relational features. But it’s clear a modern database is required to match the ambition of app modernization.

That’s where the YugabyteDB and VMware Tanzu story comes in.

Read more

YugabyteDB Managed – The Monthly Scoop (May 2022)

At Yugabyte, we are always on the lookout for ways to make your experience better. We are quite jazzed to announce a number of updates to YugabyteDB Managed that will make your life easier and help you reduce costs.

Before jumping into the feature updates, in case you missed it we announced an update to our naming: Yugabyte Cloud is now called YugabyteDB Managed!

Here are some exciting new features in YugabyteDB Managed:

Pause and Resume clusters

Your YugabyteDB Managed clusters can now take a nap!

Read more

Three Insights Gained as an Intern at DSS Asia 2022

Hey Everybody! It’s Lakshmi, reporting again from the APJ team!

I recently received valuable first-hand experience helping to run one of the team’s flagship events: the second annual Distributed SQL Summit (DSS) Asia!

This event brought together developers, architects, and business leaders from all over Asia and beyond. Vish Phaneendra’s roundup post provides a great recap. It was exciting to reach close to 1,000 unique attendees and watch 20+ different talks from thought leaders,

Read more

Get started in any cloud, container or data center