Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Benchmark V2 #2107

Draft
wants to merge 17 commits into
base: main
Choose a base branch
from
Draft

Benchmark V2 #2107

wants to merge 17 commits into from

Commits on Oct 27, 2024

  1. chore: Add unit tests for GoogleVertexAICompletonService

    @dividedmind
    dividedmind committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    1fb7cc5 View commit details
    Browse the repository at this point in the history

  2. chore: Update jest in navie, dedupe

    @dividedmind
    dividedmind committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    7adbba3 View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2024

  1. fix: Retry JSON queries on Vertex AI

    @dividedmind
    dividedmind committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    dc23335 View commit details
    Browse the repository at this point in the history

  2. fix: Instruct the LLM to be briefer in the vector terms 

    I noticed sometimes the LLM tries to put a lot in the `instructions`
part of the vector terms response; this part is only meant to direct
reasoning and we're ultimately throwing it out, so it doesn't make
sense to be very verbose. It also appears to hit against some limits,
at least on Gemini.
    @dividedmind
    dividedmind committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    b66c64b View commit details
    Browse the repository at this point in the history

  3. Raise temperature in Vertex AI when retrying 

    This might help avoid recitation errors on retry.
    @dividedmind
    dividedmind committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    39240be View commit details
    Browse the repository at this point in the history

  4. chore: Force whatwg-url dependency to a recent version 

    The old version dropped deprecation warnings for punycode module.
    @dividedmind
    dividedmind committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    14d8191 View commit details
    Browse the repository at this point in the history

  5. fix: Adjust the first line of a patch when it has 0 indent 

    Fixes #2095
    @kgilpin
    kgilpin committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    62ab2fa View commit details
    Browse the repository at this point in the history

Commits on Oct 29, 2024

  1. feat: @appland/search package

    @kgilpin
    kgilpin committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    0222ddb View commit details
    Browse the repository at this point in the history

  2. feat: Refactor fulltext search to use @appland/search

    @kgilpin
    kgilpin committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    489bfdf View commit details
    Browse the repository at this point in the history

  3. chore: Update eslint rules

    @dustinbyrne @kgilpin
    dustinbyrne authored and kgilpin committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    7d509e8 View commit details
    Browse the repository at this point in the history

  4. chore: Update eslint rules

    @kgilpin
    kgilpin committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    e16a545 View commit details
    Browse the repository at this point in the history

  5. chore: Upgrade dependencies 

    Also drop unused dependencies
    @dustinbyrne @kgilpin
    dustinbyrne authored and kgilpin committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    a792c12 View commit details
    Browse the repository at this point in the history

  6. refactor: Fix up eslint errors

    @dustinbyrne @kgilpin
    dustinbyrne authored and kgilpin committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    3604ea8 View commit details
    Browse the repository at this point in the history

  7. chore: Upgrade better-sqlite3 to v11.5.0

    @dustinbyrne @kgilpin
    dustinbyrne authored and kgilpin committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    7dccc28 View commit details
    Browse the repository at this point in the history

  8. fixup! feat: Refactor fulltext search to use @appland/search

    @kgilpin
    kgilpin committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    b97c3c6 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2024

  1. Merge branch 'feat/adjust-patch-first-line' into benchmark-v2

    @kgilpin
    kgilpin committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    fd8fead View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/fix/vertex-json-retry' into benc… 

    …hmark-v2
    @kgilpin
    kgilpin committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    e2f4cc3 View commit details
    Browse the repository at this point in the history