Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a test that descriptions have a minimum length #393

Closed
ttusing opened this issue Nov 15, 2023 · 2 comments
Closed

Add a test that descriptions have a minimum length #393

ttusing opened this issue Nov 15, 2023 · 2 comments
Labels
enhancement New feature or request

Comments

@ttusing
Copy link
Contributor

ttusing commented Nov 15, 2023

Describe the feature

The current fct_documentation_coverage test accepts any description. Sometimes, descriptions are as good as empty, such as "TODO", "model_name", " ". I propose either adding one or more optional parameters, such as minimum description character length, to fct_documentation_coverage to count short descriptions as not descriptions, or adding another model/test that tests for "good descriptions", with optional configuration parameters to apply to any of models, seeds, sources, snapshots, exposures.

The test would fail descriptions in these circumstances:

  • the description is less than X characters (tunable) (and if set to 0, disable this test. maybe 0 is the default, maybe 10).
  • if the model name is found in the description, remove that substring from character count
  • Remove spaces and special characters from description string before counting

Describe alternatives you've considered

  • Accepting bad descriptions and that no enforcement will encourage people to write thoughtful descriptions XD

Additional context

Unsure if string replacement is consistent across databases/adapters, may need to exclude from feature.

Who will this benefit?

People who want better documentation in their project

Are you interested in contributing this feature?

Yes! I can add this no problem.

@ttusing ttusing added the enhancement New feature or request label Nov 15, 2023
@b-per
Copy link
Collaborator

b-per commented Dec 4, 2023

Hi @ttusing !

My first feeling is that this looks a bit too "specific" to be a generic test that many people would want to implement.

In that case I think that it would make more sense for you to build your own fct + test with your own company logic. What do you think? And in that case, do you know how to create those on your side or would you like some guidance?

@ttusing
Copy link
Contributor Author

ttusing commented Dec 4, 2023

Hi @ttusing !

My first feeling is that this looks a bit too "specific" to be a generic test that many people would want to implement.

In that case I think that it would make more sense for you to build your own fct + test with your own company logic. What do you think? And in that case, do you know how to create those on your side or would you like some guidance?

I can totally do that~. Might open source some of our tests in a package and include this :)

@b-per b-per closed this as not planned Won't fix, can't repro, duplicate, stale Dec 12, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants