Skip to content

Conversation

dervoeti
Copy link
Member

Description

Fixes #1227

This changes the Airflow and Superset build processes to use patchable and build the products from source. Airflow 2 is built differently than Airflow 3.

I also moved the adding of statsd_exporter and git-sync into the final stage.

I tested this by creating temporary patchfiles for Airflow 2.10.5, Airflow 3.0.6 and Superset 4.1.4 for both the backend and the frontend code and checked if the changes were present in the application. I also ran the smoke tests for these versions.

Definition of Done Checklist

Note

Not all of these items are applicable to all PRs, the author should update this template to only leave the boxes in that are relevant.

Please make sure all these things are done and tick the boxes

  • Changes are OpenShift compatible
  • All added packages (via microdnf or otherwise) have a comment on why they are added
  • Things not downloaded from Red Hat repositories should be mirrored in the Stackable repository and downloaded from there
  • All packages should have (if available) signatures/hashes verified
  • Add an entry to the CHANGELOG.md file
  • Integration tests ran successfully
TIP: Running integration tests with a new product image

The image can be built and uploaded to the kind cluster with the following commands:

boil build <IMAGE> --image-version <RELEASE_VERSION> --strip-architecture --load
kind load docker-image <MANIFEST_URI> --name=<name-of-your-test-cluster>

See the output of boil to retrieve the image manifest URI for <MANIFEST_URI>.

@dervoeti dervoeti self-assigned this Oct 13, 2025
@adwk67 adwk67 self-requested a review October 14, 2025 07:05
adwk67
adwk67 previously approved these changes Oct 14, 2025
Copy link
Member

@adwk67 adwk67 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just one small nit (which I'll leave up to you): built all images and tested UIs with the airflow/superset smoke test. All good - LGTM!

Copy link
Member

@adwk67 adwk67 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@dervoeti dervoeti added this pull request to the merge queue Oct 14, 2025
Merged via the queue into main with commit 82f2db9 Oct 14, 2025
3 checks passed
@dervoeti dervoeti deleted the spike/airflow-from-source branch October 14, 2025 12:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Build Airflow/Superset from source

2 participants