merge from main. #18
Merged
merge from main. #18
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
added 30 commits
November 23, 2023 09:22
The reason of removing the model_map is the following: - The schema of the model map is very much focussed for the summac model and other keys of the schema is not been used by other models. - Since, we do not have a general schema for all of the models, so it is just introducing un-necessary complication in the structure. We can have a dedicated config where we can store different configurations later. But for now, we can remove to keep things simple.
…side summac model. Since, the SummaC model is been inspired from the implementation of https://github.com/tingofurro/summac and that implemenattion only requires the specific strucutre of the model_map. So, keeping those function and dict just there.
Since, the reason of removing of model_map is explained in previous commits, so removed those dependecies inside hallucination_model too.
…erent answer_relevancy models.
This new metric, is deriving from answer_relevancy_model classes.
…a aquired implementation
…ed around DeepEvalBaseModel
Fix detoxify dependency
fix ragas score calculation
Hotfix/evaluatefile
Moved tracing to new dir
added check module
Added ragas score breakdown
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.