Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Census #72

Open
wants to merge 25 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
853019a
refactor: plaintext for paths, tests failing
spool Oct 13, 2023
71548ed
fix(plaintext): add extraction call in edge case of `self._extract_al…
spool Oct 29, 2023
8be5b99
refactor(plaintext): harmonize with `lwmdb.FullText`
spool Oct 29, 2023
2966486
feat(plaintext): expand update export fields, including `text_compres…
spool Oct 29, 2023
24ea6e8
feat(plaintext): add `include_text_fixture_paths` option as default
spool Oct 29, 2023
e9dbe75
feat(cli): add a summary print if `plaintext` compression used
spool Oct 30, 2023
7556f56
feat(cli): add progress and improved formatting to `plaintext`
spool Oct 30, 2023
29811f7
feat(cli): print absolute config paths for `plaintext`
spool Oct 30, 2023
757e7ba
feat(cli): add `--dry-run` for `plaintext` and improve `rename`
spool Oct 31, 2023
0516743
fix(newspaper): change codes 'bl_hmd' -> 'bl-hmd', 'bl_lwm' -> 'bl-lwm'
spool Nov 4, 2023
6422a0d
feat: expand `cli` for `metadata` and `adjacent_tables`
spool Nov 20, 2023
e142919
feat(census): add census module for generating a DataFrame
spool Feb 18, 2024
7ccd047
feat(ci): add census branch into CI
spool Feb 18, 2024
9ef271b
feat(ci): harmonise with `main`
spool Feb 18, 2024
f83a5cb
fix(ci): fix doctest import
spool Feb 18, 2024
69bc24a
fix(ci): tweak `doctests` for linux
spool Feb 18, 2024
df49b29
fix(test): add ci_error test marker
spool Feb 18, 2024
b11941d
fix(test): fix `DataSource` doctest
spool Feb 18, 2024
37456cc
fix(ci): fix pytest flags in GitHub deploy
spool Feb 18, 2024
645ee12
fix(test): fix doctest in utils and plaintex
spool Feb 19, 2024
83a83fb
fix(ci): comment out windows in CI config
spool Feb 19, 2024
b708ba6
fix(ci): upgrade mkdocs-include-markdown-plugin
spool Feb 19, 2024
b6a5149
test: add `tests/test_plaintext.py`
spool Mar 11, 2024
8761dbd
feat: add `alto2txt2fixture/census.py`
spool Mar 11, 2024
c3c2aad
fix(test): address `census_adjacent_fixtures` path issues
spool Mar 11, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 5 additions & 4 deletions .github/workflows/ci.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -5,9 +5,9 @@ name: CI

on:
push:
branches: [main]
branches: [main, census]
pull_request:
branches: [main]
branches: [main, census]

permissions:
contents: write
Expand All @@ -19,7 +19,8 @@ jobs:
fail-fast: true
matrix:
python-version: ["3.11"]
os: [ubuntu-latest, windows-latest, macos-latest]
os: [ubuntu-latest, macos-latest]
# os: [ubuntu-latest, windows-latest, macos-latest]

steps:
- uses: actions/checkout@v4
Expand All @@ -34,7 +35,7 @@ jobs:
- name: Run pre-commit
uses: pre-commit/action@main
- name: Run pytest
run: poetry run pytest -n auto -m "not download"
run: poetry run pytest -n auto -m "not download and not ci_error"
- name: Archive coverage svg
uses: actions/upload-artifact@v3
with:
Expand Down
5 changes: 2 additions & 3 deletions .pre-commit-config.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -38,11 +38,10 @@ repos:
rev: "1.6.0" # add version here
hooks:
- id: poetry-check
- id: poetry-lock
args: ["--check", "--no-update"]
args: ["--lock"]

- repo: https://github.com/hadialqattan/pycln
rev: v2.3.0
rev: v2.4.0
hooks:
- id: pycln
args: [--config=pyproject.toml]
Expand Down
Loading
Loading