Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add ability to specify a specific file to write results to too #67

Merged
merged 1 commit into from
Apr 5, 2024

Conversation

pes10k
Copy link
Collaborator

@pes10k pes10k commented Apr 5, 2024

fixes #66

@pes10k pes10k requested a review from ShivanKaul as a code owner April 5, 2024 03:02
@pes10k
Copy link
Collaborator Author

pes10k commented Apr 5, 2024

i think these warnings can be safely ignored. All these uses are with arguments provided by the user, when using this as a command line too

@pes10k pes10k self-assigned this Apr 5, 2024
@ShivanKaul
Copy link
Collaborator

I think you actually want to make the changes in run.ts, and then the build will auto-generate run.js etc. We only want to change .ts files, and we should keep ignoring built/

@pes10k
Copy link
Collaborator Author

pes10k commented Apr 5, 2024

im not sure i understand, the changes i made are in validate.ts and crawl.ts.

The reason i checked in built is so that folks can use the code w/o having to download the typescript chain. But if you'd prefer i pull it back out i can

@ShivanKaul
Copy link
Collaborator

Ah, do you not need any changes in run.ts? I got confused by the fact that run.js is now being built and checked in.

Yeah, I think it would be best to not check in the built JS files.

@ShivanKaul
Copy link
Collaborator

Everything else LGTM, just please amend the -o help text to account for this new functionality: https://github.com/brave/pagegraph-crawl/blob/main/src/run.ts#L25

@pes10k pes10k force-pushed the add-ability-to-choose-file branch from 15c4403 to 2557de4 Compare April 5, 2024 21:42
@pes10k
Copy link
Collaborator Author

pes10k commented Apr 5, 2024

run.js is being checked in bc all the *.js files are checked in, but i didnt make any changes to run.ts. and okie.

Just pushed a change that keeps built out

@pes10k pes10k force-pushed the add-ability-to-choose-file branch from 2557de4 to cd935a5 Compare April 5, 2024 21:45
@pes10k
Copy link
Collaborator Author

pes10k commented Apr 5, 2024

okie pushed an update that also describes the new -o behavior

Copy link
Collaborator

@ShivanKaul ShivanKaul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great!

@pes10k pes10k force-pushed the add-ability-to-choose-file branch from cd935a5 to f71f95a Compare April 5, 2024 22:24
@pes10k pes10k force-pushed the add-ability-to-choose-file branch from f71f95a to 8196d31 Compare April 5, 2024 22:25
Copy link

github-actions bot commented Apr 5, 2024

The following commits were not verified:
8196d31 (unknown_key)

@pes10k pes10k merged commit 1dcacc3 into main Apr 5, 2024
5 checks passed
@pes10k pes10k deleted the add-ability-to-choose-file branch April 5, 2024 22:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

would be nice to be able to specify a specific path to write results to
4 participants