Skip to content

Ensure all Expr instance can be pickled (not cloudpickle)#810

Closed
fjetter wants to merge 1 commit into
dask:mainfrom
fjetter:ensure_all_expressions_pickleable
Closed

Ensure all Expr instance can be pickled (not cloudpickle)#810
fjetter wants to merge 1 commit into
dask:mainfrom
fjetter:ensure_all_expressions_pickleable

Conversation

@fjetter
Copy link
Copy Markdown
Member

@fjetter fjetter commented Jan 26, 2024

#331 added a check to assert_eq that would ensure that all expressions are serializable. There was some funny business going on, see #323

There was already a debate about this in teh PR over there #331 (comment) where the main reason for allowing cloudpickle was the use of lamdbas in the test base. This PR actually fixes all of those occurences and enables pickle by default. There was just one edge case of an Expr that would require cloudpickle but I would like that this stays this way.

The cost for this check would be to not be allowed to use lambdas when writing tests that involve assert_eq. Are we fine with this?

@fjetter fjetter changed the title Ensure all Expr instance can be pickled Ensure all Expr instance can be pickled (not cloudpickle) Jan 26, 2024
@fjetter fjetter closed this Feb 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant