Code

Merge from main#30

Code

Merged

Anindyadeep merged 101 commits intoAnindyadeep:mainAnindyadeep/deepeval:mainfrom confident-ai:mainconfident-ai/deepeval:mainCopy head branch name to clipboardFeb 4, 2024

+1,793-426

Commits

Commits on Dec 17, 2023

• FEAT: Adding callbacks functionality

  Pratyush-exe

  committed
  e5da502

  Copy full SHA for e5da502

Commits on Dec 21, 2023

• CHORE: Structure change

  Show description for b87c5eb
  Pratyush-exe

  committed
  b87c5eb

  Copy full SHA for b87c5eb

Commits on Dec 22, 2023

• CHORE: Created some methods for on_epoch_end, 'DeepEvalCallback'

  Pratyush-exe

  committed
  73962f1

  Copy full SHA for 73962f1

Commits on Dec 24, 2023

• FEAT: Added custom metrics table for CLI

  Pratyush-exe

  committed
  77af0cc

  Copy full SHA for 77af0cc

Commits on Dec 25, 2023

• FIX: fixed issues with progress table and added progress bar

  Pratyush-exe

  committed
  08eb920

  Copy full SHA for 08eb920

Commits on Dec 27, 2023

• FEAT: Added calc metric every x epoch and fixed some issues

  Pratyush-exe

  committed
  410b268

  Copy full SHA for 410b268

• CHORE: added progress_context while evaluation

  Pratyush-exe

  committed
  1dcdc8d

  Copy full SHA for 1dcdc8d

Commits on Jan 16, 2024

• FIX: fixed overlapping of progress-bars with tables

  Pratyush-exe

  committed
  004ef1c

  Copy full SHA for 004ef1c

• FIX: fixed flikering of inital progress bars and order of columns

  Pratyush-exe

  committed
  46b4004

  Copy full SHA for 46b4004

• CHORE: code reformat

  Pratyush-exe

  committed
  a1b8431

  Copy full SHA for a1b8431

• FEAT: Added test_callback script for testing

  Pratyush-exe

  committed
  210df2e

  Copy full SHA for 210df2e

Commits on Jan 17, 2024

• FEAT: Added test_callback script for testing

  Pratyush-exe

  committed
  d0afde7

  Copy full SHA for d0afde7

• CHORE: code lint

  Pratyush-exe

  committed
  c213f9b

  Copy full SHA for c213f9b

• Merge branch 'main' of https://github.com/Pratyush-exe/deepeval into feature/callbacks

  Pratyush-exe

  committed
  eb59e3d

  Copy full SHA for eb59e3d

• CHORE: made callbacks compatible with latest pull

  Pratyush-exe

  committed
  3b27e05

  Copy full SHA for 3b27e05

Commits on Jan 20, 2024

• FEAT: Added list of Goldens as an optional parameter to EvaluationDataset

  Pratyush-exe

  committed
  8b7e3bc

  Copy full SHA for 8b7e3bc

• FEAT: Added 'retrieval_context' as param for Golden

  Pratyush-exe

  committed
  d0771b1

  Copy full SHA for d0771b1

• FEAT: Added support for Golden

  Pratyush-exe

  committed
  f09d531

  Copy full SHA for f09d531

Commits on Jan 21, 2024

• CHORE: Separated callback and rich code for better readability

  Pratyush-exe

  committed
  c06871a

  Copy full SHA for c06871a

• CHORE: Added docstrings to deepeval.callbacks.huggingface.utils

  Pratyush-exe

  committed
  bf81870

  Copy full SHA for bf81870

• CHORE: Spell corrections

  Pratyush-exe

  committed
  ff2b3a7

  Copy full SHA for ff2b3a7

• Rename bias and toxicity

  penguine-ip

  committed
  ea46dd6

  Copy full SHA for ea46dd6

• fix docs

  penguine-ip

  committed
  a1d2a67

  Copy full SHA for a1d2a67

• fix docs

  penguine-ip

  committed
  4a4e8d1

  Copy full SHA for 4a4e8d1

• Merge pull request #423 from confident-ai/hotfix/rename-bias-and-toxicity

  Show description for c8e230d
  penguine-ip

  authored
  c8e230d

  Copy full SHA for c8e230d

• new release

  penguine-ip

  committed
  50958f5

  Copy full SHA for 50958f5

• Merge pull request #424 from confident-ai/release-v0.20.50

  Show description for a880ea5
  penguine-ip

  authored
  a880ea5

  Copy full SHA for a880ea5

• CHORE: Added new test code

  Show description for 5cd7c13
  Pratyush-exe

  committed
  5cd7c13

  Copy full SHA for 5cd7c13

Commits on Jan 23, 2024

• Fixed assertion on actual output

  penguine-ip

  committed
  591e268

  Copy full SHA for 591e268

• Merge pull request #426 from confident-ai/hotfix/bias-and-toxic-check

  Show description for d22ebd1
  penguine-ip

  authored
  d22ebd1

  Copy full SHA for d22ebd1

• new release

  penguine-ip

  committed
  0d67204

  Copy full SHA for 0d67204

• Merge pull request #427 from confident-ai/release-v0.20.51

  Show description for 09ad27b
  penguine-ip

  authored
  09ad27b

  Copy full SHA for 09ad27b

• FIX: Fixed sample_size code inside create_deepeval_dataset function

  Pratyush-exe

  committed
  03fd6c4

  Copy full SHA for 03fd6c4

• Merge pull request #368 from Pratyush-exe/feature/callbacks

  Show description for b1d6cb7
  penguine-ip

  authored
  b1d6cb7

  Copy full SHA for b1d6cb7

• Added default to golden

  penguine-ip

  committed
  3415c19

  Copy full SHA for 3415c19

• Merge pull request #428 from confident-ai/hotfix/datasetscreation

  Show description for a91f2b6
  penguine-ip

  authored
  a91f2b6

  Copy full SHA for a91f2b6

• added deployment option

  penguine-ip

  committed
  eeb79b1

  Copy full SHA for eeb79b1

• fix test

  penguine-ip

  committed
  b9274be

  Copy full SHA for b9274be

• reformat

  penguine-ip

  committed
  5d449cc

  Copy full SHA for 5d449cc

• Add pytest deployment flag

  penguine-ip

  committed
  334a233

  Copy full SHA for 334a233

• .

  penguine-ip

  committed
  cd1df87

  Copy full SHA for cd1df87

• .

  penguine-ip

  committed
  e082fe6

  Copy full SHA for e082fe6

• Merge pull request #429 from confident-ai/feature/deployment

  Show description for 66e350e
  penguine-ip

  authored
  66e350e

  Copy full SHA for 66e350e

• Fix global mutable defaults in EvaluationDataset

  Show description for 2f55255
  jschomay

  authored
  2f55255

  Copy full SHA for 2f55255

• Merge pull request #431 from jeffometer/main

  Show description for a7c78ea
  penguine-ip

  authored
  a7c78ea

  Copy full SHA for a7c78ea

• .

  penguine-ip

  committed
  1b50b98

  Copy full SHA for 1b50b98

• Merge pull request #432 from confident-ai/release-v0.20.52

  Show description for 57f6c5d
  penguine-ip

  authored
  57f6c5d

  Copy full SHA for 57f6c5d

Commits on Jan 24, 2024

• Added docsearch

  penguine-ip

  committed
  10bf854

  Copy full SHA for 10bf854

Commits on Jan 25, 2024

• delete redundant "Toxicity"

  nicholasburka

  authored
  2e46802

  Copy full SHA for 2e46802

• New integrations

  penguine-ip

  committed
  8322dba

  Copy full SHA for 8322dba

• fix tests

  penguine-ip

  committed
  c040b5a

  Copy full SHA for c040b5a

• lint

  penguine-ip

  committed
  14e33fd

  Copy full SHA for 14e33fd

• Merge pull request #434 from nicholasburka/patch-1

  Show description for 46a9ae4
  penguine-ip

  authored
  46a9ae4

  Copy full SHA for 46a9ae4

• Merge pull request #435 from confident-ai/features/integrations

  Show description for d7a4b93
  penguine-ip

  authored
  d7a4b93

  Copy full SHA for d7a4b93

• Llamaindex docs and integration

  penguine-ip

  committed
  94e5457

  Copy full SHA for 94e5457

• Merge pull request #436 from confident-ai/features/llamaindex

  Show description for 5a1cfda
  penguine-ip

  authored
  5a1cfda

  Copy full SHA for 5a1cfda

• Updated docs

  penguine-ip

  committed
  a88314a

  Copy full SHA for a88314a

• .

  penguine-ip

  committed
  20d854b

  Copy full SHA for 20d854b

• new release

  penguine-ip

  committed
  aac5834

  Copy full SHA for aac5834

• Merge pull request #437 from confident-ai/release-v0.20.53

  Show description for 1dfa192
  penguine-ip

  authored
  1dfa192

  Copy full SHA for 1dfa192

• Update docs

  penguine-ip

  committed
  f1c7a6e

  Copy full SHA for f1c7a6e

• Conditional import

  penguine-ip

  committed
  da2f799

  Copy full SHA for da2f799

• Merge pull request #438 from confident-ai/features/lazy-import

  Show description for 8d23b80
  penguine-ip

  authored
  8d23b80

  Copy full SHA for 8d23b80

• added deployment flag

  penguine-ip

  committed
  e107c40

  Copy full SHA for e107c40

• Merge pull request #439 from confident-ai/feature/cicd

  Show description for e53cbdd
  penguine-ip

  authored
  e53cbdd

  Copy full SHA for e53cbdd

Commits on Jan 26, 2024

• Added retrieval Context

  penguine-ip

  committed
  ddf5735

  Copy full SHA for ddf5735

Commits on Jan 27, 2024

• Merge pull request #440 from confident-ai/features/deployment-github

  Show description for 861f3cd
  penguine-ip

  authored
  861f3cd

  Copy full SHA for 861f3cd

• Added deployment configs

  penguine-ip

  committed
  58993da

  Copy full SHA for 58993da

• Added deployment key

  penguine-ip

  committed
  bcbe21e

  Copy full SHA for bcbe21e

• Debug

  penguine-ip

  committed
  7c3e546

  Copy full SHA for 7c3e546

• debug

  penguine-ip

  committed
  ebe574c

  Copy full SHA for ebe574c

• debug

  penguine-ip

  committed
  6550f51

  Copy full SHA for 6550f51

• .

  penguine-ip

  committed
  ffa3ffc

  Copy full SHA for ffa3ffc

• .

  penguine-ip

  committed
  9ca77f6

  Copy full SHA for 9ca77f6

• Merge pull request #442 from confident-ai/features/deploymentgithub

  Show description for 3eedb7d
  penguine-ip

  authored
  3eedb7d

  Copy full SHA for 3eedb7d

Commits on Jan 28, 2024

• Added basic docs

  Pratyush-exe

  committed
  c8942cb

  Copy full SHA for c8942cb

• Merge pull request #444 from Pratyush-exe/callbacks-docs

  Show description for c43f3aa
  penguine-ip

  authored
  c43f3aa

  Copy full SHA for c43f3aa

Commits on Jan 29, 2024

• Added custom model

  penguine-ip

  committed
  9e463bb

  Copy full SHA for 9e463bb

• Merge pull request #445 from confident-ai/features/custommodelagain

  Show description for 970ffa9
  penguine-ip

  authored
  970ffa9

  Copy full SHA for 970ffa9

• new release

  penguine-ip

  committed
  b287283

  Copy full SHA for b287283

• Merge pull request #446 from confident-ai/release-v0.20.54

  Show description for fca2c1c
  penguine-ip

  authored
  fca2c1c

  Copy full SHA for fca2c1c

• Fix package setup

  nictuku

  committed
  45d64f3

  Copy full SHA for 45d64f3

• Merge pull request #447 from nictuku/integrations-fix

  Show description for 8505e1f
  penguine-ip

  authored
  8505e1f

  Copy full SHA for 8505e1f

• FIx evaluate

  penguine-ip

  committed
  4c3076b

  Copy full SHA for 4c3076b

• new release

  penguine-ip

  committed
  995103a

  Copy full SHA for 995103a

• Merge pull request #448 from confident-ai/release-v0.20.55

  Show description for e7eec73
  penguine-ip

  authored
  e7eec73

  Copy full SHA for e7eec73

Commits on Jan 30, 2024

• Added confident cost latency logging

  penguine-ip

  committed
  6566679

  Copy full SHA for 6566679

• Merge pull request #449 from confident-ai/features/latency-and-cost

  Show description for 6f4618c
  penguine-ip

  authored
  6f4618c

  Copy full SHA for 6f4618c

• Added dataset alias for confidnet

  penguine-ip

  committed
  ab08118

  Copy full SHA for ab08118

• Merge pull request #450 from confident-ai/features/dataset-integration

  Show description for 27090fc
  penguine-ip

  authored
  27090fc

  Copy full SHA for 27090fc

• Fix convert goldens

  penguine-ip

  committed
  4c64ed8

  Copy full SHA for 4c64ed8

• Fix cost and latency thresholds

  penguine-ip

  committed
  73e9eb3

  Copy full SHA for 73e9eb3

• updated docs

  penguine-ip

  committed
  6c9d056

  Copy full SHA for 6c9d056

• Merge pull request #451 from confident-ai/hotfix/costandlatency

  Show description for 3a5a555
  penguine-ip

  authored
  3a5a555

  Copy full SHA for 3a5a555

• .

  penguine-ip

  committed
  c7ccd87

  Copy full SHA for c7ccd87

• Merge pull request #452 from confident-ai/release-v0.20.56

  Show description for 08c11b9
  penguine-ip

  authored
  08c11b9

  Copy full SHA for 08c11b9

• Added docs

  penguine-ip

  committed
  bead5c0

  Copy full SHA for bead5c0

Commits on Jan 31, 2024

• Updated docs

  penguine-ip

  committed
  d3939c9

  Copy full SHA for d3939c9

Commits on Feb 1, 2024

• udpated docs

  penguine-ip

  committed
  8c99c56

  Copy full SHA for 8c99c56

Commits on Feb 3, 2024

• updated docs

  penguine-ip

  committed
  49b165b

  Copy full SHA for 49b165b

• Fixed docs

  penguine-ip

  committed
  0728b19

  Copy full SHA for 0728b19