Articles by Shiv Iyer

About Shiv Iyer

Open Source Database Systems Engineer with a deep understanding of Optimizer Internals, Performance Engineering, Scalability and Data SRE. Shiv currently is the Founder, Investor, Board Member and CEO of multiple Database Systems Infrastructure Operations companies in the Transaction Processing Computing and ColumnStores ecosystem. He is also a frequent speaker in open source software conferences globally.

PostgreSQL Locks, Latches, Enqueues and Mutex

PostgreSQL can be tuned for concurrency and performance by adjusting various configuration parameters that affect the behavior of the database system. Here are some recommended steps for tuning PostgreSQL for concurrency and performance: How to […]

How to implement optimally recursive queries and hierarchical data in PostgreSQL?

To implement recursive queries and hierarchical data optimally in PostgreSQL, you can follow these steps: This query selects all the nodes in the hierarchy, along with their name and level. By following these steps, you […]

What are dynamic disks in ClickHouse 23.2 and how they influence performance

Dynamic disks in ClickHouse 23.2 refer to a feature that allows for more efficient use of disk space and improved performance when working with large amounts of data. Traditionally, ClickHouse used a file-based storage system […]

How to tune TRACK_ACTIVITY_QUERY_SIZE in PostgreSQL.conf?

In PostgreSQL, the track_activity_query_size parameter determines the maximum size of the SQL query that can be recorded in the pg_stat_activity view. By default, this parameter is set to 1024 bytes, which means that only the […]

How to reduce WAL by increasing checkpoint distance in PostgreSQL?

In PostgreSQL, the WAL (Write-Ahead Logging) is a critical component of the database system that ensures durability and consistency of data. However, frequent WAL writes can impact the performance of the database, especially if the […]

How to implement “as of” queries in PostgreSQL?

In PostgreSQL, you can implement “as of” queries using the SQL standard’s temporal query features, which allow you to query a table as it existed at a specific point in time. There are two main […]

How to compute cost of slow query in PostgreSQL?

The cost of a slow query in PostgreSQL can be estimated by the Query Planner, which uses statistics about the data in the tables being queried to make predictions about the query execution time. The […]

How does Optimizer Plan Stability work in PostgreSQL?

In PostgreSQL, optimizer plan stability is a feature that allows the query planner to reuse a previously cached query plan for a SQL statement instead of generating a new plan. This can improve query performance […]

How are Global Indexes implemented in PostgreSQL?

In PostgreSQL, global indexes are implemented using a shared-nothing architecture, which means that the index data is partitioned and distributed across multiple physical nodes or “shards.” This allows for parallel query processing and improved performance […]

How do Bloom Filters Work in MyRocks?

Bloom filters are probabilistic data structures that are used for membership tests. They are particularly useful in databases as they allow faster and more efficient querying of data. In MyRocks, a storage engine based on […]

The Data Transformation Company

Data Architecture, Engineering and Operations for SQL, NoSQL, NewSQL, Cloud Native Data Platforms, Analytics and AI