Code

merge from main.#18

Code

Merged

Anindyadeep merged 93 commits intoAnindyadeep:mainAnindyadeep/deepeval:mainfrom confident-ai:mainconfident-ai/deepeval:mainCopy head branch name to clipboardDec 8, 2023

+2,137-1,196

Commits

Commits on Nov 23, 2023

• Removed: model_map

  Show description for af2e203
  

  Anindyadeep

  committed
  af2e203

  Copy full SHA for af2e203

• Refactor: Introduced the model_map and it's corresponding function inside summac model.

  Show description for 8a91d4e
  

  Anindyadeep

  committed
  8a91d4e

  Copy full SHA for 8a91d4e

• Refactor: removed model_map and it's imports.

  Show description for e401a25
  

  Anindyadeep

  committed
  e401a25

  Copy full SHA for e401a25

Commits on Nov 26, 2023

• Refactor: Python file that contains the logics to load and score different answer_relevancy models.

  

  Anindyadeep

  committed
  bc6ca32

  Copy full SHA for bc6ca32

• Feat: Add a Base model class, such that each model implementation will be uniform

  

  Anindyadeep

  committed
  4d29ad0

  Copy full SHA for 4d29ad0

• added answer_relevancy Classes inside __init__.py

  

  Anindyadeep

  committed
  97762bc

  Copy full SHA for 97762bc

• Feat: New metric, answer_relevancy_score.

  Show description for 11f13bb
  

  Anindyadeep

  committed
  11f13bb

  Copy full SHA for 11f13bb

• Refactor: AnswerRelevancyMetric now uses scorer to measure

  

  Anindyadeep

  committed
  3256aeb

  Copy full SHA for 3256aeb

• fix: typo in vectera model name

  

  Anindyadeep

  committed
  e699b25

  Copy full SHA for e699b25

• added SummaCModels inside __init__ file for easier import

  

  Anindyadeep

  committed
  cd75dcd

  Copy full SHA for cd75dcd

• added *args and **kwargs in __init__ of BaseModel

  

  Anindyadeep

  committed
  e1578fe

  Copy full SHA for e1578fe

• Made the actual implementation of SummaC models private, since it is a aquired implementation

  

  Anindyadeep

  committed
  36bf250

  Copy full SHA for 36bf250

• SummaC modl is now wrapped around DeepEvalBaseModel class

  

  Anindyadeep

  committed
  b486742

  Copy full SHA for b486742

• Using the new SummaCModels inside scorer implementation

  

  Anindyadeep

  committed
  8aaa859

  Copy full SHA for 8aaa859

• removed redundant softmax implementation

  

  Anindyadeep

  committed
  7af59c4

  Copy full SHA for 7af59c4

• chore: added additional args inside summac model class.

  

  Anindyadeep

  committed
  604db8a

  Copy full SHA for 604db8a

• refactor: moved the factual consistency models inside model and wrapped around DeepEvalBaseModel

  

  Anindyadeep

  committed
  7d9fd6a

  Copy full SHA for 7d9fd6a

• added factual_consistency_model in __init__

  

  Anindyadeep

  committed
  4a78708

  Copy full SHA for 4a78708

• using the scorer function to compute the score for factual consistency

  

  Anindyadeep

  committed
  850334f

  Copy full SHA for 850334f

• implemented scoring function for factual consistency inside scorer

  

  Anindyadeep

  committed
  0779e33

  Copy full SHA for 0779e33

• toxicity models is now wrapped under DeepEvalBaseModel class

  

  Anindyadeep

  committed
  584bb37

  Copy full SHA for 584bb37

• DetoxifyModel can be added inside __init__

  

  Anindyadeep

  committed
  6d2e165

  Copy full SHA for 6d2e165

• refactor: removed and replaced scoring logic by using Detoxify model under models

  

  Anindyadeep

  committed
  396b03a

  Copy full SHA for 396b03a

• refactor: removed and replaced model with scorer function

  

  Anindyadeep

  committed
  5f9b9f9

  Copy full SHA for 5f9b9f9

• Introduced dbias model inside DeepEval base model class

  

  Anindyadeep

  committed
  621bf15

  Copy full SHA for 621bf15

• added the neural bias scoring logic inside scorer

  

  Anindyadeep

  committed
  0c0725b

  Copy full SHA for 0c0725b

• refactor: replaced implementation of Dbias with scorer.

  

  Anindyadeep

  committed
  3112dbe

  Copy full SHA for 3112dbe

Commits on Nov 27, 2023

• removed softmax import from deepeval utils and undo the previous implementation

  

  Anindyadeep

  committed
  d49adaf

  Copy full SHA for d49adaf

Commits on Nov 28, 2023

• fix the tyoing issue for subscripted generics

  

  Anindyadeep

  committed
  4bf3ae9

  Copy full SHA for 4bf3ae9

• fix the model being None probelm

  

  Anindyadeep

  committed
  d35ac7a

  Copy full SHA for d35ac7a

• linting

  

  Anindyadeep

  committed
  e999114

  Copy full SHA for e999114

Commits on Nov 29, 2023

• Merge pull request #305 from Anindyadeep/anindya/refactor-scorer

  Show description for 2459f0a
  penguine-ip

  authored
  2459f0a

  Copy full SHA for 2459f0a

Commits on Nov 30, 2023

• Added event tracking

  penguine-ip

  committed
  7a45465

  Copy full SHA for 7a45465

• Merge pull request #317 from confident-ai/features/eventtracking

  Show description for 0e7a02e
  penguine-ip

  authored
  0e7a02e

  Copy full SHA for 0e7a02e

Commits on Dec 1, 2023

• Updated docs

  penguine-ip

  committed
  64aad29

  Copy full SHA for 64aad29

• .

  penguine-ip

  committed
  47cccdc

  Copy full SHA for 47cccdc

Commits on Dec 2, 2023

• .

  penguine-ip

  committed
  d5aac44

  Copy full SHA for d5aac44

• Support for dataset push pull

  penguine-ip

  committed
  869722d

  Copy full SHA for 869722d

• .

  penguine-ip

  committed
  ec6f297

  Copy full SHA for ec6f297

• .

  penguine-ip

  committed
  fe31b03

  Copy full SHA for fe31b03

• fix test

  penguine-ip

  committed
  8ead0ab

  Copy full SHA for 8ead0ab

• Merge pull request #318 from confident-ai/feature/datasetpushpull

  Show description for e24e09c
  penguine-ip

  authored
  e24e09c

  Copy full SHA for e24e09c

• Updated docs

  penguine-ip

  committed
  c06ebfe

  Copy full SHA for c06ebfe

• Updated docs

  penguine-ip

  committed
  c808f72

  Copy full SHA for c808f72

• Handle dataset overwrite

  penguine-ip

  committed
  99198d9

  Copy full SHA for 99198d9

• reformat

  penguine-ip

  committed
  e0e2e2b

  Copy full SHA for e0e2e2b

• Merge pull request #319 from confident-ai/feature/datasetoverwrite

  Show description for ac19cf1
  penguine-ip

  authored
  ac19cf1

  Copy full SHA for ac19cf1

• New Release

  penguine-ip

  committed
  bb8072d

  Copy full SHA for bb8072d

• Merge pull request #320 from confident-ai/release-v0.20.25

  Show description for 8544523
  penguine-ip

  authored
  8544523

  Copy full SHA for 8544523

Commits on Dec 3, 2023

• Bump up protobuf version from 3.20.5 to 4.21.6

  pomcho555

  committed
  dc221f2

  Copy full SHA for dc221f2

Commits on Dec 4, 2023

• Update README.md

  penguine-ip

  authored
  ca219ba

  Copy full SHA for ca219ba

• Update README.md

  penguine-ip

  authored
  2181149

  Copy full SHA for 2181149

• Update README.md

  penguine-ip

  authored
  efc721b

  Copy full SHA for efc721b

• Update README.md

  penguine-ip

  authored
  1d01145

  Copy full SHA for 1d01145

• Update README.md

  penguine-ip

  authored
  07cdb13

  Copy full SHA for 07cdb13

• fix tracing docs

  penguine-ip

  committed
  c5b1d79

  Copy full SHA for c5b1d79

• ..

  penguine-ip

  committed
  0c940ee

  Copy full SHA for 0c940ee

• Update README.md

  penguine-ip

  authored
  43d49a4

  Copy full SHA for 43d49a4

• Update README.md

  penguine-ip

  authored
  856d42e

  Copy full SHA for 856d42e

• Merge pull request #323 from confident-ai/hotfix/removetracing

  Show description for 78a032e
  penguine-ip

  authored
  78a032e

  Copy full SHA for 78a032e

• Merge pull request #322 from pomcho555/fix-protobuf-dependency

  Show description for 368ad47
  penguine-ip

  authored
  368ad47

  Copy full SHA for 368ad47

• fix protobuf poetry version

  penguine-ip

  committed
  5132632

  Copy full SHA for 5132632

• Merge pull request #324 from confident-ai/fix/poetryversions

  Show description for 30032ca
  penguine-ip

  authored
  30032ca

  Copy full SHA for 30032ca

• New release

  penguine-ip

  committed
  6fc1563

  Copy full SHA for 6fc1563

• Merge pull request #325 from confident-ai/release-v0.20.26

  Show description for 64f3b51
  penguine-ip

  authored
  64f3b51

  Copy full SHA for 64f3b51

• Fix detoxify dependency

  penguine-ip

  committed
  f7689df

  Copy full SHA for f7689df

• .

  penguine-ip

  committed
  78d47fe

  Copy full SHA for 78d47fe

• Merge pull request #326 from confident-ai/hotfix/detoxifydependency

  Show description for a652124
  penguine-ip

  authored
  a652124

  Copy full SHA for a652124

• new release

  penguine-ip

  committed
  75bb4c8

  Copy full SHA for 75bb4c8

• Merge pull request #327 from confident-ai/release-v0.20.27

  Show description for 8bbc114
  penguine-ip

  authored
  8bbc114

  Copy full SHA for 8bbc114

• updated docs

  penguine-ip

  committed
  182ebdd

  Copy full SHA for 182ebdd

• updated docs

  penguine-ip

  committed
  e53ae5d

  Copy full SHA for e53ae5d

Commits on Dec 6, 2023

• fix ragas score calculation

  penguine-ip

  committed
  76e9b98

  Copy full SHA for 76e9b98

• Renamed evaluator file

  penguine-ip

  committed
  627bd47

  Copy full SHA for 627bd47

• reformat

  penguine-ip

  committed
  181be29

  Copy full SHA for 181be29

• Merge pull request #328 from confident-ai/hotfix/ragas

  Show description for 9b78292
  penguine-ip

  authored
  9b78292

  Copy full SHA for 9b78292

• fix import

  penguine-ip

  committed
  bc7d093

  Copy full SHA for bc7d093

• Merge pull request #329 from confident-ai/hotfix/evaluatefile

  Show description for 4d79430
  penguine-ip

  authored
  4d79430

  Copy full SHA for 4d79430

• new release

  penguine-ip

  committed
  6f5d62b

  Copy full SHA for 6f5d62b

• Merge pull request #330 from confident-ai/release-v0.20.28

  Show description for f670a29
  penguine-ip

  authored
  f670a29

  Copy full SHA for f670a29

• Moved tracing to new dir

  penguine-ip

  committed
  6b5a071

  Copy full SHA for 6b5a071

• Merge pull request #331 from confident-ai/hotfix/tracingfile

  Show description for 25bd7c2
  penguine-ip

  authored
  25bd7c2

  Copy full SHA for 25bd7c2

• added check module

  penguine-ip

  committed
  8ce07dd

  Copy full SHA for 8ce07dd

• reformat

  penguine-ip

  committed
  f8ef290

  Copy full SHA for f8ef290

• .

  penguine-ip

  committed
  1b28cd3

  Copy full SHA for 1b28cd3

• Merge pull request #334 from confident-ai/feature/check

  Show description for cda200f
  penguine-ip

  authored
  cda200f

  Copy full SHA for cda200f

• Updated docs

  penguine-ip

  committed
  a3e23f4

  Copy full SHA for a3e23f4

• update docs

  penguine-ip

  committed
  153fad8

  Copy full SHA for 153fad8

Commits on Dec 7, 2023

• Added ragas score breakdown

  penguine-ip

  committed
  78c7db1

  Copy full SHA for 78c7db1

• Merge pull request #336 from confident-ai/hotfix/ragasprint

  Show description for e8d2c76
  penguine-ip

  authored
  e8d2c76

  Copy full SHA for e8d2c76

• new release

  penguine-ip

  committed
  ab8db53

  Copy full SHA for ab8db53

• Merge pull request #337 from confident-ai/release-0.20.29

  Show description for 1ad070c
  penguine-ip

  authored
  1ad070c

  Copy full SHA for 1ad070c

• updated docs

  penguine-ip

  committed
  a285970

  Copy full SHA for a285970