Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade to Airflow 2.2.5 #17

Open
kijewskimateusz opened this issue Apr 29, 2022 · 3 comments
Open

Upgrade to Airflow 2.2.5 #17

kijewskimateusz opened this issue Apr 29, 2022 · 3 comments

Comments

@kijewskimateusz
Copy link

Hello!

Lately, I've been trying to kickstart with my personal Airflow instance using your template, but had to upgrade it to 2.2.5. Successfully, I've succeeded doing so by modifying Dockerfile, that I'm sharing below. Maybe that will be useful when you'd decide to upgrade template

FROM apache/airflow:2.2.5

#Install Make pre-requisites
USER root
RUN apt-get update \
  && apt-get install -y --no-install-recommends build-essential
USER airflow

#Install additional dependencies
COPY Makefile Makefile
COPY airflow.requirements.txt airflow.requirements.txt

RUN make internal-install-airflow
RUN make internal-install-deps

Personally, I've found a little bit difficult to understand code behind make internal-install-airflow component, so I'm putting additional Airflow modules into airflow.requirements.txt file, but I'm pretty sure that this will work too after providing appropriate airflow and python version in Makefile.

@cjk
Copy link

cjk commented Apr 29, 2022

Hey @kijewskimateusz thanks for providing your solution for upgrading Airflow.
When I upgraded to Airflow 2.2.3 a couple of months ago, all I had to do was update AIRFLOW_VERSION in the Makefile and then rebuild everything.
No changes in a Dockerfile were necessary, or am I missing something?

@kijewskimateusz
Copy link
Author

kijewskimateusz commented Apr 29, 2022

I have been following this Airflow documentation page, which suggests to use already published Apache Airflow image, if you aim to extend image with additional modules. I can see that approach that repository author has taken is described in Customizing the image section.

I may be incorrect due to various factors, so please do not take me as single source of truth.

@cjk
Copy link

cjk commented Apr 29, 2022

I see, thanks for clarifying. There is probably more than one way to update Airflow in this scenario depending on your needs 🤷‍♂️

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants