PXF 3.0 Release plan

[ostinru]

Hi, cloudberry-pxf team!

I have created this issue to collect requirements for cloudberry-pxf 3.0. Major version opens a window to introduce backward-incompatible changes. In release 2.2 (#113) I suggested postpone following for 3.0:

• Upgrade Spring Boot to 3.x or even 4.x
• Update hadoop libs to 3.3/3.4
• Upgrade to java 17 in cloudberry-pxf 3.0

I would like to add following 'best-effort' changes:

• Fix portion of tests from pxf_regress is broken need fix it #86
• upgrade ORC/Parquet libs
• compare iceberg implementations greengagedb/pxf and Add Iceberg lake-table DDL: CREATE ICEBERG TABLE, FOREIGN CATALOG, FOREIGN VOLUME (kernel scaffolding) cloudberry#1842

Do you have any plans / ideas on what should be included in cloudberry-pxf-3.0?

@tuhaihe, what it deadline for PXF 3.0?

[tuhaihe]

1. For PXF 3.0, any chance to include this proposal: Proposal: Cherry-pick pxf-iceberg feature from GreengageDB/pxf to Apache Cloudberry PXF #126?
2. There is no obvious timeline for the 3.0 release now. I think we should wait until all FIXMEs have been resolved in the Cloudberry main branch before starting the 3.0 release discussion. It may still take 1-2 months.

[ostinru]

1. For PXF 3.0, any chance to include this proposal: Proposal: Cherry-pick pxf-iceberg feature from GreengageDB/pxf to Apache Cloudberry PXF #126?

I think that it is good idea to compare greengageDB/pxf and apache/cloudberry#1842 . I am pretty sure that C-lang version will win for two reasons - it is better integrated with cloudberry and there are more C-lang developers in the community.

Will add it to 'best effort'.