Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GPT OCR followup #148

Merged
merged 16 commits into from
Oct 27, 2024
Merged

GPT OCR followup #148

merged 16 commits into from
Oct 27, 2024

Commits on Oct 27, 2024

  1. clean GPT OCR in ingest.py

    @danvk
    danvk committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    8aaa661 View commit details
    Browse the repository at this point in the history

  2. split interior whitespace

    @danvk
    danvk committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    ff3d3d5 View commit details
    Browse the repository at this point in the history

  3. normalize more interior whitespace

    @danvk
    danvk committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    7eeac9a View commit details
    Browse the repository at this point in the history

  4. pipeline-style

    @danvk
    danvk committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    a3df2de View commit details
    Browse the repository at this point in the history

  5. try being much more lax about is_negative

    @danvk
    danvk committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    6eba892 View commit details
    Browse the repository at this point in the history

  6. 2/426 false positives

    @danvk
    danvk committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    dddda1a View commit details
    Browse the repository at this point in the history

  7. this is pretty good

    @danvk
    danvk committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    77ea822 View commit details
    Browse the repository at this point in the history

  8. images.ndjson diff script

    @danvk
    danvk committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    596de3f View commit details
    Browse the repository at this point in the history

  9. split up (1), (2), (3) etc on single one; 180 matches, 2 false positives

    @danvk
    danvk committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    9857cd8 View commit details
    Browse the repository at this point in the history

  10. remove F. S. LINCOLN stamps

    @danvk
    danvk committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    2919b9c View commit details
    Browse the repository at this point in the history

  11. strip NEW YORK PUBLIC LIBRARY stamp (108)

    @danvk
    danvk committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    4bb8815 View commit details
    Browse the repository at this point in the history

  12. Drop "President Borough of Manhattan" (862!)

    @danvk
    danvk committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    16ed45c View commit details
    Browse the repository at this point in the history

  13. update keep-ids with new cleaner

    @danvk
    danvk committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    2d48b06 View commit details
    Browse the repository at this point in the history

  14. add another manual list

    @danvk
    danvk committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    53feee9 View commit details
    Browse the repository at this point in the history

  15. run cleaner on old site OCR, too

    @danvk
    danvk committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    318a8bf View commit details
    Browse the repository at this point in the history

  16. squash excessive newlines

    @danvk
    danvk committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    bc211db View commit details
    Browse the repository at this point in the history