Expand System Catalogs

After executing redistribution, the following system catalogs (including system tables and views) are automatically generated and stored in the matrixmgr_internal schema of the matrixmgr database:

  • expand_status_summary
  • expand_status_detail
  • expand_expansion_progress

1.1 expand_status_summary

This table records timestamp information for each phase of data redistribution, with the following columns:

Column Type Description
status text Tracks the status of an expansion operation. Valid values are:
SCHEDULED START — the scheduled start time for redistribution
SETUP — the time when collection of database table metadata begins
SETUP DONE — the time when metadata collection completes
EXPANSION STARTED — the time when actual data redistribution starts
COMPLETED — the time when all redistribution tasks finish
LAST SCHEDULED START — after completion, the value of SCHEDULED START is saved here and SCHEDULED START is cleared
updated_at timestamp with time zone Timestamp of the last status change

1.2 expand_status_detail

This table contains status information for tables involved in expansion. Querying this table allows you to determine the current status of a table being redistributed or view start and end times for completed tables. If this table has no records, no redistribution is required.

It also stores table-related metadata such as OID.

Column Type Description
dbname text Name of the database to which the table belongs
db_oid oid Oid of the database to which the table belongs
fq_name text Fully qualified name of the table
table_oid oid OID of the table
root_partition_name text For partitioned tables, the name of the root partition; otherwise None
rank int Determines the order in which tables are processed during expansion. The expansion tool sorts by rank, with lower numbers processed earlier
external_writable boolean Indicates whether the table is an external writable table. (External writable tables require different syntax for expansion.)
status text Current expansion status of the table. Valid values are:
NOT STARTED
IN PROGRESS
PENDING
RETRYING
COMPLETED
FAILED
expansion_started_at timestamp with time zone Timestamp when expansion of this table started
expansion_finished_at timestamp with time zone Timestamp when expansion of this table finished. This field is also updated if expansion fails
source_bytes numeric Amount of data not yet redistributed. Due to table bloat in HEAP tables and changes in the number of Segments after expansion, the post-expansion size may differ from the original. This column provides progress tracking and helps estimate total expansion duration
failed_times integer Number of retry attempts. Default value is 5

1.3 expand_expansion_progress

This system catalog is a view that provides information about the overall expansion status, including estimated redistribution speed and remaining time to complete all data redistribution.

Column Type Description
name text Names of metrics describing the expansion process. Possible values include:
Bytes Pending
Bytes in Progress
Bytes Done
Bytes Failed
Estimated Expansion Rate
Estimated Remaining Time
Done Tables Number
Pending Tables Number
In Progress Tables Number
Failed Tables Number
value text Value of the corresponding metric. Example: Bytes Pending: 100023434