Do you want to update Github Pages automatically, and use Travis CI? You've come to the right place.
Both versions:
Here's a few things, which when combined, cause a problem.
- Checking in generated files is considered poor practice.
- Often, web pages aren't in HTML directly: they're generated from some other file.
master
is the default branch ofgit
repositories.gh-pages
is the default branch for Github Pages.
Our source files end up on one branch, but we need to move the generated files to another branch. And of course, we don't want to just do this on every build, but on successful CI builds of master. Whew!
This repository follows its own advice. You can see it here, here, and here.
Follow these steps:
You want to make sure your branch already exists.
$ git checkout master
$ git checkout -b gh-pages
$ git push origin -u gh-pages
$ git checkout master
Easy enough.
Click this link to generate a new Personal access token. You might need to re-enter your password.
You'll need to check some boxes. Check these ones:
That's right, just repo
. If your repository is public, you can set
public_repo
instead.
GitHub will create the token, and show you a flash with the value.
THIS IS THE ONLY TIME YOU GET TO SEE THIS SO DON'T CLICK AWAY IMMEDIATELY!
You'll need to copy this token into someplace you trust. I wrote mine down, so I could just light the paper on fire afterward. 😉. It'll never be shown to you after this time, so it's important to double-check your work.
Check out this page on encryption with Travis. Here's the TL;DR:
$ gem install travis # install Ruby first if you need to! This might need `sudo`
$ travis encrypt GH_TOKEN=$MY_ACCESS_TOKEN
Where $MY_ACCESS_TOKEN
is the token you wrote down. Note that I put some
spaces before travs
. If you have bash
configured in this common way,
this makes sure the command doesn't end up in your Bash History. Can't
be too safe with those tokens.
(You'll need to have enabled travis for your repo before this, and may need
to pass an argument -r username/reponame
if it can't work out the repo
itself.)
This will spit out something like this:
secure: "oFD/tic8JAwpMXuMDBZXV4ot6w1NLWvHQnrDKmUHSMQJC1cbbrR1p5q8XayfjtmdqQdFQmIfM6YHEKeHw//ypgObWjYS8q00OaaMDXPTdmgr1Ee4nhgkkDihT+kVij0rn96W/QvyAVoaV5hJoyUr3Nhk+mnHEYm3M+Q3LAQglRg="
You need to put this in your .travis.yml
!
Here's what this should look like:
language: something
script:
- make check
- make generate
after_success:
- test $TRAVIS_PULL_REQUEST == "false" && test $TRAVIS_BRANCH == "master" && bash deploy.sh
env:
global:
- secure: "oFD/tic8JAwpMXuMDBZXV4ot6w1NLWvHQnrDKmUHSMQJC1cbbrR1p5q8XayfjtmdqQdFQmIfM6YHEKeHw//ypgObWjYS8q00OaaMDXPTdmgr1Ee4nhgkkDihT+kVij0rn96W/QvyAVoaV5hJoyUr3Nhk+mnHEYm3M+Q3LAQglRg="
Let's go over this, line by line:
language: something
This should be set to whatever the language is of your project. What happens
if your project's build tool is different than your project itself? You
may need to add an install
line to install the other tool.
As an example, if you have a JavaScript project that uses gitbook, you might have this:
language: node_js
install: npm install gitbook
Next, our actual build:
script:
- make check
- make generate
This changes based on whatever your build actually is. I show this section because you will generally want two commands: one to build your project, and one to build the actual documentation.
after_success:
- test $TRAVIS_PULL_REQUEST == "false" && test $TRAVIS_BRANCH == "master" && bash deploy.sh
If we have a successful build, we want to check out where we are. We only want
to update Github Pages if we're building the master branch of the original
repository, so we have to check $TRAVIS_PULL_REQUEST
and $TRAVIS_BRANCH
.
If we are, we run bash deploy.sh
. What's the contents of deploy.sh
?
We'll talk about that in a moment. We have one more line to cover:
env:
global:
- secure: "oFD/tic8JAwpMXuMDBZXV4ot6w1NLWvHQnrDKmUHSMQJC1cbbrR1p5q8XayfjtmdqQdFQmIfM6YHEKeHw//ypgObWjYS8q00OaaMDXPTdmgr1Ee4nhgkkDihT+kVij0rn96W/QvyAVoaV5hJoyUr3Nhk+mnHEYm3M+Q3LAQglRg="
This, of course, should use the value from travis encrypt
from before.
Remember how we encrypted GH_TOKEN=...
before? This will ensure that
our GH_TOKEN
variable is set to the unencrypted value. That sounds scary,
but Travis will not set this on forks or pull requests, so that someone
can't just submit a PR that echo
es the value out.
Okay, next, we need to add a deploy.sh
to our repository. You'll
need to tweak this slightly for your setup, but here's the basic
idea:
#!/bin/bash
set -o errexit -o nounset
rev=$(git rev-parse --short HEAD)
cd stage/_book
git init
git config user.name "Steve Klabnik"
git config user.email "[email protected]"
git remote add upstream "https://$GH_TOKEN@github.com/rust-lang/rust-by-example.git"
git fetch upstream
git reset upstream/gh-pages
echo "rustbyexample.com" > CNAME
touch .
git add -A .
git commit -m "rebuild pages at ${rev}"
git push -q upstream HEAD:gh-pages
Let's do it, paragraph by paragraph:
#!/bin/bash
The standard shebang line. We don't really need to set this, as we execute it
with bash deploy.sh
, but I like to put it in anyway.
set -o errexit -o nounset
This sets two options for the shell to make the script more reliable:
errexit
: stop executing if any errors occur, by default bash will just continue past any errors to run the next commandnounset
: stop executing if an unset variable is encountered, by default bash will use an empty string for the value of such variables.
rev=$(git rev-parse --short HEAD)
This sets a variable, rev
, with the short hash of HEAD
. We'll use
this later in a commit message.
cd _book
We need to cd
into wherever our website built. With Gitbook, that's _book
,
with Jekyll, it's _site
. But do whatever.
git init
git config user.name "Steve Klabnik"
git config user.email "[email protected]"
First, we initialize a new git
repository. Yes, a new one. You'll see.
We then set our user name and user email. This person will have done the
commits that go to gh-pages
. It's not a default branch, so don't worry,
GitHub doesn't count these commits as contributions for your graph.
git remote add upstream "https://$GH_TOKEN@github.com/me/project.git"
git fetch upstream
git reset upstream/gh-pages
Next, we add a remote, named upstream
, and we set it to our project. But
we also interpolate that $GH_TOKEN
variable, which will allow us to push
to this repository later.
We then fetch
it and reset
to the gh-pages
branch. Now, git
sees this new repository as just some files that change your upstream
gh-pages
branch.
echo "myproject.com" > CNAME
Sometimes, you'll need some extra files. A CNAME
is common, which sets
a custom domain up. You'll need to run whatever commands generate those
files for you.
touch .
We then touch
everything, so that git
considers all of our local copies
fresh.
git add -A .
git commit -m "rebuild pages at ${rev}"
git push -q upstream HEAD:gh-pages
We then add all changes, commit them, using our rev
from earlier, and
then push to upstream
. The -q
keeps this a bit more quiet, and you
can control the noisiness of all these different git
commands with a
judicious sprinkling of -q
.
That's it! Commit this all, and push. Travis should now do its magic, and everything will update!
One drawback of this is that if you have a build matrix that builds your project with multiple versions of your platform, you'll end up with the same number of pages builds. Which seems redundant.
I think I could take advantage of Travis' "deploy" feature to fix this, but I'm not sure how.
I'd love to know if there's a better way to do any of this. In particular, I'd
love to add the local git repo rather than the one from GitHub when fetching
the upstream
, but since Travis checks out a bare repository, it doesn't seem
possible. Please open an issue or PR to show me how to do it better!