Articles by Shiv Iyer

About Shiv Iyer

Open Source Database Systems Engineer with a deep understanding of Optimizer Internals, Performance Engineering, Scalability and Data SRE. Shiv currently is the Founder, Investor, Board Member and CEO of multiple Database Systems Infrastructure Operations companies in the Transaction Processing Computing and ColumnStores ecosystem. He is also a frequent speaker in open source software conferences globally.

Speed Up Your PostgreSQL 16 Backups with Improved pg_dump

Example: When using pg_dump in PostgreSQL 16, you can specify the compression method: Here, -F c specifies custom-format output, -Z specifies the compression level (1 for LZ4, 3 for ZSTD), and -f specifies the output [...]

Installing and Configuring pgvector in PostgreSQL: A Step-by-Step Guide

Introduction - pgvector in PostgreSQL pgvectorin PostgreSQL is an open-source extension designed to efficiently handle vector data within the database. It's particularly useful for machine learning and similar applications where working with vector data is [...]

Step-by-Step Guide to Migrating from PostgreSQL 11 to 15 Using pg_upgrade

Discover a comprehensive guide on how to seamlessly migrate from PostgreSQL 11 to 15 using the pg_upgrade tool. Our step-by-step tutorial ensures a smooth and efficient database upgrade process with minimal disruption, covering installation, preparation, execution, and post-upgrade steps. Perfect for database administrators looking to upgrade to PostgreSQL 15 with confidence. [...]

Enhancing MySQL 8 on Modern Hardware: A Guide to Tuning InnoDB I/O Threads for Optimal Performance

In this comprehensive guide, we delve into the advanced tuning of `innodb_read_io_threads` and `innodb_write_io_threads` in MySQL 8, specifically tailored for modern hardware infrastructures. We cover essential strategies for incrementally adjusting these settings to harness the full capabilities of SSDs and multi-core processors, ensuring a balanced and efficient use of resources. The guide also emphasizes the importance of monitoring performance metrics to gauge the impact of tuning efforts, while highlighting the need to maintain a balance between read and write operations for optimal database performance. Whether you're dealing with read-intensive or write-heavy workloads, this guide provides actionable insights for optimizing MySQL 8 on the latest hardware technologies. [...]

Troubleshooting PostgreSQL JOIN Performance: A Guide for Query Optimization

PostgreSQL environment is unique, so these guidelines should be adapted and tested according to your specific context. Regular monitoring and a thorough understanding of your data and query patterns are key to maintaining optimal JOIN performance. [...]

Troubleshooting PostgreSQL Error 53300: TOO_MANY_CONNECTIONS

When you encounter the 53300: TOO_MANY_CONNECTIONS error in PostgreSQL, it indicates that your database has reached its maximum configured limit for simultaneous connections. This can happen due to high traffic, inefficient application design, or insufficient configuration settings. [...]

Advanced Troubleshooting of MySQL Query Latency and Index Usage with eBPF

Using eBPF (extended Berkeley Packet Filter) for troubleshooting MySQL query latency and index usage is a sophisticated technique that leverages Linux's advanced tracing capabilities. eBPF allows you to trace system and application-level metrics without significant performance overhead [...]

How to implement GDPR-Compliant Data Obfuscation in PostgreSQL

Implementing data obfuscation in PostgreSQL to comply with the General Data Protection Regulation (GDPR) involves transforming sensitive data into a less sensitive form, a process that helps protect personal data while maintaining its usability. [...]

Step-by-Step Guide for Optimizing PostgreSQL Queries with Partial Indexes

Implementing partial indexes in PostgreSQL is an efficient way to optimize your database performance, especially when dealing with large tables with specific query patterns. Partial indexes are indexes built over a subset of a table, defined by a condition. [...]

Mastering Row Locks in PostgreSQL: Ensuring Data Integrity and Performance

Mastering Row Locks in PostgreSQL: Ensuring Data Integrity and Performance […]

The WebScale Database Infrastructure Architecture, Engineering and Operations Company

Full-Stack Database Engineering & Cloud DBaaS Solutions for PostgreSQL, MySQL, MongoDB & More | Performance, Scalability, High Availability, Security & Analytics Experts