Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Output only URLs #57

Open
raphaelsander opened this issue Oct 15, 2022 · 4 comments
Open

Output only URLs #57

raphaelsander opened this issue Oct 15, 2022 · 4 comments

Comments

@raphaelsander
Copy link

Hi,

At first, congratulations for this project.
I am have an issue, maybe by my mistake, but I'd want to send to stdout only URLs, without flags like [url] and [code-200].
Is it possible?

gospider

@random-robbie
Copy link

2nd for this please :)

@lachokds
Copy link

It's a third from me. I've been getting this even when using the --json flag:

{"input":"https://twitter.com","source":"body","type":"form","output":"https://twitter.com/search/realtime?lang=zh-Hant","status":
0,"length":0}
{"input":"https://twitter.com","source":"body","type":"form","output":"https://twitter.com/search/realtime","status":0,"length":0}
{"input":"https://twitter.com","source":"body","type":"url","output":"https://twitter.com/?lang=sk","status":200,"length":151}
[url] - [code-200] - https://abs.twimg.com/responsive-web/client-web-legacy/main.6de340c9.js
{"input":"https://twitter.com","source":"body","type":"form","output":"https://twitter.com/*?lang=en-GB","status":0,"length":0}
{"input":"https://twitter.com","source":"body","type":"form","output":"https://twitter.com/*?lang=zh-Hant","status":0,"length":0}
{"input":"https://twitter.com","source":"body","type":"form","output":"https://twitter.com/*?ref_src=","status":0,"length":0}
{"input":"https://twitter.com","source":"body","type":"url","output":"https://twitter.com/?lang=pt","status":400,"length":83}
{"input":"https://twitter.com","source":"body","type":"url","output":"https://twitter.com/?lang=sv","status":200,"length":151}

Thanks!

@AncientAutumn
Copy link

You can try to pipe them into grep -Eo "(http|https)://[a-zA-Z0-9./?=_%:-]*"

@vrechson
Copy link
Contributor

vrechson commented Mar 8, 2024

I submitted this PR to fix this issue for both json and quiet flags: #69

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants