The VMware Tanzu Greenplum platform extension framework for Red Hat Enterprise Linux, CentOS, and Oracle Enterprise Linux is updated and distributed independently of Greenplum Database.

You must download and install the PXF package to obtain the most recent version of this component.

Supported Platforms

The independent PXF distribution is compatible with these operating system platform versions and Greenplum Database versions:

PXF is compatible with these Java and Hadoop component versions:

Upgrading to Version 7.x

If you are currently using PXF with Greenplum Database, you may be required to perform upgrade actions for this release. Review Upgrading from Version 6 or Upgrading from an Earlier Version 7 Release to plan your upgrade to PXF version 7.x.

Release 7.0.0-beta.1

Release Date: September 20, 2024

New and Changed Features

PXF 7.0.0-beta.1 includes these new and changed features:

Architecture and Bundled Libraries

• PXF 7.0.0-beta.1 introduces external PXF clusters:
  • PXF services can either run collocated on Greenplum hosts, or can run on non-Greenplum (external) hosts.
  • PXF 7.0.0-beta.1 only supports a configuration consisting of a single PXF Cluster named ‘default’ and a signgle PXF Service Group named ‘default’. For more information, see the About the PXF Deployment Topology page.
• PXF 7 bundles the postgresql-42.7.2.jar PostgreSQL driver JAR file.
• PXF library dependencies have changed with new, updated, and removed libraries.
• PXF 7 C extension dispatches Greenplum queries to PXF Services on Greenplum or non-Greenplum (external) hosts according to the PXF cluster configuration.

Files, Configuration, and Commands

• The pxf [cluster] commands can be used to manage PXF services on non-Greenplum (external) hosts.
• PXF 7 introduces the --verbose flag to the pxf [cluster] commands.
• The pxf [cluster] register command now also sets the Greenplum configuration parameter pxf.pxf_base to be equal to your $PXF_BASE environment variable.
• PXF 7 introduces a new installation file layout as well as a new runtime configuration directory layout. For more information, see the About the PXF Installation and Configuration Directories page.
  • Using the pxf cluster migrate command, PXF 7.0.0-beta.1 moves configuration files from $PXF_BASE to $PXF_BASE/clusters/default which is the location for the default PXF cluster configuration in PXF 7.

• PXF 7 includes new and changed configuration files; see About the PXF Configuration Files for more information:

  • PXF 7.0.0-beta.1 introduces new configuration files to manage the default PXF cluster and introduces basic validation for the new files.

    New configuration file	Description
    $PXF_BASE/clusters/default/conf/cluster.txt	Configuration file containing configurations for the default PXF cluster.
    $PXF_BASE/clusters/default/conf/hosts.txt	Configuration file containing the list of external hosts in the default PXF cluster.

  • PXF 7 C extension can now read configuration files located in $PXF_BASE via the pxf.pxf_base Greenplum Database configuration parameter.

  • PXF 7 introduces new template files and moves existing template files as below:

    Template files	Location
    PXF Service configuration files: pxf-application.properties, pxf-env.sh, pxf-log4j2.xml, and pxf-profiles.xml	$PXF_HOME/templates/conf
    PXF cluster configuration files: cluster.txt	$PXF_HOME/templates/clusters
    Server configuration files: hdfs-site.xml, hive-site.xml, abfss-site.xml, pxf-site.xml, etc.	$PXF_HOME/templates/servers

    • PXF template server configuration files were previously located in the $PXF_HOME/templates directory.

  • PXF 7 renames the following configuration properties:

    Previous pxf-env.sh Property Name	New pxf-env Property Name
    PXF_LOGDIR	PXF_LOG_DIR
    PXF_RUNDIR	PXF_RUN_DIR

• PXF 7 changes the default listening address to 0.0.0.0 to allow for incoming network from PXF external hosts; it was previously set to localhost.

Profiles

• PXF 7.0.0-beta.1 adds support for Azure Data Lake Storage Gen 2 via the new abfss profile.
• The PXF JDBC Connector now supports the timestamptz datatype.

Removed Features

PXF 7.0.0-beta.1 removes these features:

• Support for Azure Data Lake Storage Gen 1 and the adl profile (removed since PXF version 7.0.0-beta.1); use abfss profile instead.
• Support with Greenplum Database 5.x (removed since PXF version 7.0.0-beta.1).
• Support with RHEL 7 (removed since PXF version 7.0.0-beta.1).
• PXF_PORT and PXF_HOST environment variables (removed since PXF version 7.0.0-beta.1); use configuration properties inside $PXF_BASE/clusters/default/conf/cluster.txt instead.
• The PXF_FRAGMENTER_CACHE configuration property (deprecated since PXF version 6.0.0).
• The pxf [cluster] init and pxf [cluster] reset commands (deprecated since PXF version 6.0.0).

Resolved Issues

PXF 7.0.0-beta.1 resolves these issues:

Deprecated Features

Deprecated features may be removed in a future major release of PXF. Currently, PXF 7.x does not have any deprecated features.

Known Issues and Limitations

PXF 7.x has these known issues and limitations: