pandas cannit be upgraded because of databricks-sql-connector

[potiuk]

[eladkal]

From what I see #52071 fixed it

[potiuk]

Not fully:

Seems that databricks-sql-connection is holding upgrade to latest version:

[eladkal]

cc @mwojtyczka @moomindani
any idea when databricks will allow newer pandas version (version 3). Restriction comes from:
https://github.com/databricks/databricks-sql-python/blob/main/pyproject.toml#L14-L17

[moomindani]

For tracking: I've opened databricks/databricks-sql-python#768 to relax the pandas version constraint in databricks-sql-connector from <2.4.0 to <4.0.0. All existing unit tests pass on both pandas 2.x and 3.x.

Once that's merged and released, the pandas version constraint from the Databricks side should be unblocked.