Status of testing Providers that were prepared on April 10, 2025

[eladkal]

Body

I have a kind request for all the contributors to the latest provider distributions release.
Could you please help us to test the RC versions of the providers?

The guidelines on how to test providers can be found in

Verify providers by contributors

Let us know in the comments, whether the issue is addressed.

These are providers that require testing as there were some substantial changes introduced:

Provider amazon: 9.6.0rc1

• Add Bedrock Batch Inference Operator and accompanying parts (#48468): @ferruzzi
• Update ECS executor to support Task SDK (#48513): @o-nikolas
• Handle NoCredentialsError in waiter_with_logging.py (#48946): @nrobinson-intelycare
• Bedrock Batch Inference - Trying to stop a completed job is a successful result (#48964): @ferruzzi
• remove error response for inactivity period in key (#48782): @nakamura1878
• Rename list_jobs method to describe_jobs in GlueJobHook (#48904): @james5418
  Linked issues:
  • Linked Issue #47046: @rawwar
• Fix typo in docstring for MwaaHook (#48980): @ramitkataria
• Update Amazon RDS Operators and Sensors to inherit AWS Base classes (#48872): @ellisms
  Linked issues:
  • Linked Issue #35278: @Taragolis
• Change provider-specific dependencies to refer to providers (#48843): @potiuk

Provider apache.hdfs: 4.8.0rc1

• HdfsTaskHandler structlog rework (#48788): @james5418
  Linked issues:
  • Linked Issue #48685: @eladkal

Provider apache.livy: 4.3.1rc1

• Remove sqlite provider from preinstalled and use aiosqlite as core dep (#48966): @potiuk

Provider apache.spark: 5.2.0rc1

• Add openlineage as Extra dep for Spark provider (#48972): @kaxil
• Make @task import from airflow.sdk (#48896): @kaxil

Provider celery: 3.10.6rc1

• Bring back serve_logs to be in the core (#49031): @potiuk
  Linked issues:
  • Linked Issue #48457: @vincbeck
  • Linked Issue #49028: @ashb
• Remove fab from preinstalled providers (#48457): @vincbeck

Provider cncf.kubernetes: 10.4.2rc1

• Make @task import from airflow.sdk (#48896): @kaxil
• Update ECS executor to support Task SDK (#48513): @o-nikolas

Provider common.io: 1.5.3rc1

• Move ObjectStoragePath and attach to Task SDK (#48906): @uranusjr
  Linked issues:
  • Linked Issue #45425: @kaxil

Provider common.messaging: 1.0.0rc2

• Draft Common Message Queue (#46694): @vikramkoka

Provider databricks: 7.3.1rc1

• Fix Databricks provider tests (#48877): @kaxil
• fix for databricks repair buttons not overriding the template parameters (#46704): @gpadavala
  Linked issues:
  • Linked Issue #45462: @a-baturin

Provider discord: 3.9.5rc1

• Fix discord and slack provider icon url (#48680): @RulerChen
  Linked issues:
  • Linked Issue #48619: @obarisk

Provider docker: 4.3.1rc1

• Make @task import from airflow.sdk (#48896): @kaxil

Provider fab: 2.0.0rc4

• Prepare FAB provider to set next version as major version (#43939): @vincbeck
• Remove deprecations from fab provider (#44198): @vincbeck
• Set up JWT token authentication in Fast APIs (#42634): @vincbeck
• AIP-79 Support Airflow 2.x plugins in fast api (#44464): @vincbeck
• AIP-81 Move CLI Commands to directories according to Hybrid, Local and Remote (#44538): @bugraoz93
  Linked issues:
  • Linked Issue #44204: @bugraoz93
• (Re)move old dependencies from the old FAB UI (#48007): @ashb
• AIP 84 - Add auth for asset alias (#47241): @rawwar
• AIP-38 Fix safari login loop for non ssl (#47859): @pierrejeambrun
• AIP-38 Move token handling to axios interceptor (#47562): @pierrejeambrun
• AIP-72: Handle Custom XCom Backend on Task SDK (#47339): @amoghrajesh
  Linked issues:
  • Linked Issue #45481: @kaxil
• AIP-79 Generate assets for Flask application in FAB provider (#44744) (#45060): @vincbeck
  Linked issues:
  • Linked Issue #44744: @vincbeck
  • Linked Issue #45057: @jscheffl
• AIP-81 | AIP-84 | Include Token Generation Endpoints in FAB (#47043): @bugraoz93
  Linked issues:
  • Linked Issue #46916: @bugraoz93
  • Linked Issue #47055: @pierrejeambrun
• AIP-81: Flatten core CLI commands (#48224): @jedcunningham
• AIP-83 amendment: Add logic for generating run_id when logical date is None. (#46616): @sunank200
• AIP-84 Add Auth for DAG Versioning (#47553): @vatsrahul1001
• AIP-84 Add Auth for backfill (#47482): @vatsrahul1001
• Add get_menu_items in auth manager interface to extend the menu (#47468): @vincbeck
  Linked issues:
  • Linked Issue #47457: @bbovenzi
• Add logout method in auth manager interface (#47573): @vincbeck
  Linked issues:
  • Linked Issue #47559: @pierrejeambrun
• Add AWS SageMaker Unified Studio Workflow Operator (#45726): @agupta01
• Add authentication section in FAB auth manager API documentation (#48455): @vincbeck
• Add back get_url_logout in auth managers but make it optional (#47729): @vincbeck
  Linked issues:
  • Linked Issue #47725: @pierrejeambrun
• Add legacy namespace packages to airflow.providers (#47064): @potiuk
• Add missing methods in fab provider's AirflowAppBuilder class (#45611): @utkarsharma2
• Add option in auth manager interface to define FastAPI api (#45009): @vincbeck
  Linked issues:
  • Linked Issue #44882: @pierrejeambrun
  • Linked Issue #44847: @vincbeck
• Add option in auth managers to specify DB manager (#48196): @vincbeck
• Add run_after column to DagRun model (#45732): @uranusjr
• Add some typing and require kwargs for auth manager (#47455): @jedcunningham
• Avoid imports from "providers" (#46801): @potiuk
• Bump dompurify from 3.2.2 to 3.2.4 in /providers/fab/src/airflow/providers/fab/www (#46798): @dependabot[bot]
• Bump eslint from 8.57.1 to 9.23.0 in /providers/fab/src/airflow/providers/fab/www (#48143): @dependabot[bot]
• Bump eslint-config-prettier from 8.10.0 to 10.1.1 in /providers/fab/src/airflow/providers/fab/www (#48206): @dependabot[bot]
• Bump serialize-javascript, copy-webpack-plugin and terser-webpack-plugin in /providers/fab/src/airflow/providers/fab/www (#46698): @dependabot[bo
• Bump the fab-ui-package-updates group across 1 directory with 21 updates (#48414): @dependabot[bot]
• Bump various providers in preparation for Airflow 3.0.0b4 (#48013): @kaxil
• Call init from auth managers only once (#47869): @vincbeck
• Clean Leftovers of RemovedInAirflow3Warning (#47264): @jscheffl
• Clean up simple auth and fab provider package json files (#47516): @bbovenzi
• Cleanup leftovers from api connexion (#47490): @jscheffl
  Linked issues:
  • Linked Issue #47171: @jscheffl
• Convert exceptions raised in Flask application to fastapi exceptions (#45625): @vincbeck
• Cookies in non TLS mode (#48453): @pierrejeambrun
• Disable Flask-SQLAlchemy modification tracking in FAB provider (#46249): @jedcunningham
• Do not use FAB auth manager methods in views (#47747): @vincbeck
• Do not use core Airflow Flask related resources in FAB provider (#45441): @vincbeck
• Do not use core Airflow Flask related resources in FAB provider (package api_connexion) (#45473): @vincbeck
  Linked issues:
  • Linked Issue #45441: @vincbeck
• Do not use core Airflow Flask related resources in FAB provider (package security) (#45471): @vincbeck
  Linked issues:
  • Linked Issue #45441: @vincbeck
• Expose security views in Flask application in FAB provider (#46203): @vincbeck
• FAB login. Fix asset URLs and missing alert (#47586): @vincbeck
  Linked issues:
  • Linked Issue #47565: @ashb
• Fix conf.get_boolean("api", "ssl_cert") (#48465): @vincbeck
• Fix get_menu_items in FAB auth manager (#47688): @vincbeck
  Linked issues:
  • Linked Issue #47662: @jason810496
• Fix sync-perm CLI command (#47626): @vincbeck
• Fix FAB static asset (#46727): @jedcunningham
  Linked issues:
  • Linked Issue #45060: @vincbeck
• Fix and simplify get_permitted_dag_ids in auth manager (#47458): @vincbeck
• Fix new UI when running outside of breeze (#46991): @jedcunningham
• Fix section for base_url in FAB auth manager (#47173): @jedcunningham
• Handle user deletion while being logged in in FAB auth manager (#48754): @vincbeck
  Linked issues:
  • Linked Issue #48724: @tirkarthi
• Implement simple_auth_manager_all_admins in simple auth manager with new auth flow (#47514): @vincbeck
• Improve documentation for updating provider dependencies (#47203): @potiuk
• Introduce filter_authorized_menu_items to filter menu items based on permissions (#47681): @vincbeck
• Make FAB auth manager login process compatible with Airflow 3 UI (#45765): @vincbeck
• Make parameter user mandatory for all methods in the auth manager interface (#45986): @vincbeck
• Marking fab and common messaging as not ready (#47581): @eladkal
• Move "create db from orm" to be a public method in db manager interface (#48000): @Prab-27
  Linked issues:
  • Linked Issue #47975: @jedcunningham
• Move airflow/api_fastapi/auth/managers/utils/fab to FAB provider (#47571): @vincbeck
• Move FAB session table creation to FAB provider (#47969): @jedcunningham
• Move Literal alias into TYPE_CHECKING block (#45345): @uranusjr
• Move airflow sources to airflow-core package (#47798): @potiuk
• Move fab provider to new structure (#46144): @josix
  Linked issues:
  • Linked Issue #42523: @vincbeck
  • Linked Issue #46045: @potiuk
• Move flask-based tests of providers manager to FAB provider tests (#48113): @potiuk
• Move provider_tests to unit folder in provider tests (#46800): @potiuk
• Move tests_common package to devel-common project (#47281): @potiuk
• Moving EmptyOperator to standard provider (#46231): @amoghrajesh
• Prepare fab ad-hoc release December 2024 (#45218): @eladkal
• Re-work JWT Validation and Generation to use public/private key and official claims (#46981): @ashb
  Linked issues:
  • Linked Issue #45107: @kaxil
• Rebuild FAB assets (#48116): @potiuk
• Remove airflow.www module (#47318): @vincbeck
• Remove is_in_fab in FAB auth manager (#47465): @vincbeck
• Remove auth backends from core Airflow (#47399): @vincbeck
• Remove links to x/twitter.com (#47801): @ashb
• Remove old provider references and replace "new" with just providers (#46810): @potiuk
• Remove references of "airflow.www" in FAB provider (#46914): @vincbeck
  Linked issues:
  • Linked Issue #46871: @bbovenzi
• Remove unused code in Fab provider (#47510): @vincbeck
• Remove unused methods from auth managers (#47316): @vincbeck
• Remove unused webserver configs (#48066): @jedcunningham
• Removed the unused provider's package (#46608): @potiuk
• Rename get_permitted_dag_ids and filter_permitted_dag_ids to get_authorized_dag_ids and filter_authorized_dag_ids (#47640): @vincbeck
• Set JWT token to localStorage from cookies (#47432): @gopidesupavan
• Set simple auth manager as default (#47691): @vincbeck
• Simplify tooling by switching completely to uv (#48223): @potiuk
• Stop reserializing DAGs during db migration (#45362): @jedcunningham
  Linked issues:
  • Linked Issue #45361: @jedcunningham
• Update FAB auth manager get_url_login method to handle Flask and Fastapi (#46527): @vincbeck
• Update FAB provider documentation (#48247): @vincbeck
• Update create token apis in simple auth manager (#48498): @vincbeck
• Update docstring for users param in auth managers (#47334): @jedcunningham
• Update fast-api generated code after Pydantic upgrade (#48484): @potiuk
• Update simple auth manager documentation to include token API (#48454): @vincbeck
• Upgrade copy-webpack-plugin to latest version in FAB provider (#48399): @vincbeck
  Linked issues:
  • Linked Issue #48365: @dependabot[bot]
• Upgrade providers flit build requirements to 3.12.0 (#48362): @potiuk
• Upgrade ruff to latest version (#48553): @potiuk
• Upgrade to FAB 4.5.3 (#45874): @potiuk
• Use SimpleAuthManager for standalone (#48036): @jedcunningham
• Use a single http tag to report the server's location to front end, not two (#47572): @ashb
• Use different default algorithms for different werkzeug versions (#46384): @potiuk
• feat(AIP-84): add auth to /ui/backfills (#47657): @Lee-W
• forward port fab 1.5.2 to main branch (#45377): @eladkal
• Move standard, alibaba and common.sql provider to the new structure (#45964): @potiuk
• Bring back serve_logs to be in the core (#49031): @potiuk
  Linked issues:
  • Linked Issue #48457: @vincbeck
  • Linked Issue #49028: @ashb
• Force use of symetric JWT algorithm for internal logs server (#49029): @ashb
  Linked issues:
  • Linked Issue #48759: @ianbuss
• Move FAB related configs to FAB provider (#49017): @vincbeck
• Add back methods needed by Flask in AirflowAppBuilder (#48968): @vincbeck
• [Bump webpack from 5.99.3 to 5.99.5 in /providers/fab/src/airflow/providers/fab/www in the fab-ui-package-updates group across 1 directory (Bump webpack from 5.99.3 to 5.99.5 in /providers/fab/src/airflow/providers/fab/www in the fab-ui-package-updates group across 1 directory #49016)](Bump webpack from 5.99.3 to 5.99.5 in /providers/fab/src/airflow/providers/fab/www in the fab-ui-package-updates group across 1 directory #49016
• Add ability to configure PERMANENT_SESSION_LIFETIME in fab for session logout. (#48827): @tirkarthi
• Move wtforms/Werkzeug dependencies to FAB provider (#48970): @potiuk
• [Bump webpack from 5.99.0 to 5.99.3 in /providers/fab/src/airflow/providers/fab/www in the fab-ui-package-updates group across 1 directory (Bump webpack from 5.99.0 to 5.99.3 in /providers/fab/src/airflow/providers/fab/www in the fab-ui-package-updates group across 1 directory #48959)](Bump webpack from 5.99.0 to 5.99.3 in /providers/fab/src/airflow/providers/fab/www in the fab-ui-package-updates group across 1 directory #48959
• Remove unnecessary entries in get_provider_info and update the schema (#48849): @potiuk
• Apply configuration defined in webserver_config.py to Flask config (#48898): @vincbeck
• Bump the fab-ui-package-updates group across 1 directory with 3 updates (#48893): @dependabot[bot]
• Remove fab from preinstalled providers (#48457): @vincbeck
• Add single endpoint to retrieve menu information (#48762): @vincbeck
  Linked issues:
  • Linked Issue #47412: @bbovenzi

Provider git: 0.0.1rc1

• Move GitDagBundle to providers (#47636): @ephraimbuddy

Provider google: 15.0.1rc1

• Remove Life Science operators from system tests and documentation (#48862): @VladaZakharova
• Add missing license comment (#48985): @bugraoz93

Provider mysql: 6.2.1rc1

• fix: overwrite get-uri for MySQL (#48706): @guan404ming
  Linked issues:
  • Linked Issue #38195: @Taragolis

Provider openlineage: 2.1.3rc1

• Move ObjectStoragePath and attach to Task SDK (#48906): @uranusjr
  Linked issues:
  • Linked Issue #45425: @kaxil
• Make @task import from airflow.sdk (#48896): @kaxil

Provider sftp: 5.2.0rc1

• Implement concurrent directory transfer in SFTPOperator (#47533): @Dawnpool
• Make @task import from airflow.sdk (#48896): @kaxil

Provider slack: 9.0.4rc1

• Fix discord and slack provider icon url (#48680): @RulerChen
  Linked issues:
  • Linked Issue #48619: @obarisk

Provider snowflake: 6.2.1rc1

• Make @task import from airflow.sdk (#48896): @kaxil

Provider sqlite: 4.0.2rc1

• Remove sqlite provider from preinstalled and use aiosqlite as core dep (#48966): @potiuk

Provider standard: 0.4.0rc1

• Make default as time.now() for TriggerDagRunOperator (#48969): @vatsrahul1001
• Fix WorkflowTrigger to work with TaskSDK (#48819): @gopidesupavan
  Linked issues:
  • Linked Issue #48425: @gopidesupavan
• Get LatestOnlyOperator working with Task SDK (#48945): @kaxil
• Fix dagstate trigger to work with TaskSDK (#48747): @gopidesupavan
  Linked issues:
  • Linked Issue #47949: @kaxil
• Make @task import from airflow.sdk (#48896): @kaxil

All users involved in the PRs:
@agupta01 @ramitkataria @tirkarthi @ephraimbuddy @VladaZakharova @o-nikolas @RulerChen @guan404ming @Dawnpool @ashb @kaxil @gpadavala @potiuk @amoghrajesh @sunank200 @ferruzzi @eladkal @josix @gopidesup

Committer

• I acknowledge that I am a maintainer/committer of the Apache Airflow project.

[obarisk]

#48619 fixed. Thank you. @eladkal @RulerChen

[nrobinson-intelycare]

#48946 works!

[amoghrajesh]

FAB changes were a part of the xcom move, no actual changes there.

#46231 is the only change from me, works as expected and backcompat works too.

[bugraoz93]

Checked my changes. They look good. Thanks, Elad!

[potiuk]

Checked my changes. look good.

[eladkal]

Thank you everyone. Providers are released.

I invite everyone to help improve providers for the next release, a list of open issues can be found here.