Federal Inquiry

Federated queries are to access external data sources through YMatrix, including MySQL, PostgreSQL and other databases. The reading and writing process is like accessing YMatrix internal data tables.

Federal queries are implemented using Foreign Data Wrapper (FDW). FDW is a Postgres implementation developed by SQL standard SQL/MED (SQL Management of External Data). FDW provides a unified series of common interfaces, allowing extensions to easily integrate deeply in core parts such as optimization, execution, scanning, update and statistics, and Postgres, allowing direct query and manipulation of external data sources with SQL statements. For example, FDW for MySQL, users can directly query, sort, group, filter, join, and even insert and update MySQL data like operating local tables. There are already many FDW extensions in the community, including commonly used databases, and access to local files, HDFS, etc.

This document will introduce readers to how to use FDW to access PostgreSQL, MySQL, MongoDB, and how to use PXF to access HDFS, Hive ORC, and more.