Jul 20, 2023

Columnar store for analytics with PostgreSQL

Cstore_fdw is a extension of PostgreSQL. This extension uses the Optimized Row Columnar ORC format for its data layout. ORC improves upon the RCFile format developed at Facebook, and brings the following benefits - Compression Reduces in-memory and on-disk data size by 2-4x. Can be extended to support different codecs. - Column projections Only reads column data relevant to the query. Improves performance for I/O bound queries. - Skip indexes Stores min/max statistics for row groups, and uses them to skip over unrelated rows. Further, cstore_fdw used the Postgres foreign data wrapper APIs and type representations with this extension. This brings - Support for 40+ Postgres data types. The user can also create new types and use them. - Statistics collection. PostgreSQL’s query optimizer uses these stats to evaluate different query plans and pick the best one. - Simple setup. Create foreign table and copy data. Run SQL.

Checkout these related ports:
  • Zodb3 - Z - Object Database for python
  • Zodb - Python object-oriented database
  • Zabbix22-libzbxpgsql - Zabbix agent module for comprehensive monitoring of PostgreSQL servers
  • Xtrabackup8 - Open-source backup tool for InnoDB and XtraDB
  • Xtrabackup - OpenSource version of InnoDB backup with support of Percona extensions
  • Xrootd - Framework for fast, low latency, scalable data access
  • Xls2txt - Utilities to convert spreadsheet files to text and csv formats
  • Xapian-core12 - Probabilistic text search database engine
  • Xapian-core10 - Probabilistic text search database engine
  • Xapian-core - Probabilistic text search database engine
  • Xapian-bindings12 - Bindings allowing Xapian to be used from various programming languages
  • Xapian-bindings - Bindings allowing Xapian to be used from various programming languages
  • Wfb2sql - CIA World Fact Book to SQL Conversion Utility
  • Webdis - HTTP interface for Redis
  • Vsqlite - Well designed and portable SQLite3 Wrapper for C++