Extend simulatability and change some visualizations (5)#151
Draft
AntoninPoche wants to merge 48 commits into
Draft
Extend simulatability and change some visualizations (5)#151AntoninPoche wants to merge 48 commits into
AntoninPoche wants to merge 48 commits into
Conversation
for classification, selecting after the pooler give (n, d) activations and not (n, l, d). We now consider this as valid
useful when there are too many classes. Furthermore, this commit removes the global concepts description from the top
user_llm was aid to be optional but was not
when consim is this function is called on different seeds, it gains a lot of time
we remove ep explanations because they should not be used. And the alternance between samples, labels, and explanations is much easier to process.
We plan to add attribution simulatability and rationale simulatability, so we divide the simulatability only elements and the ones related to concepts. At the same time, we will change the evaluation system from predicting on a batch of samples (much more complicated) to predicting for one element at a time. This also allows us to use reasoning models.
this is much more efficient and it changes the client class, thus we cannot have both
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Related Issue
Type of Change
Checklist
CODE_OF_CONDUCT.mddocument.CONTRIBUTING.mdguide.make lint.make test.