[Bug] [task] can't get env when runing task

[wangbowen1024]

Search before asking

• I had searched in the issues and found no similar issues.

What happened

can't get env when runing task, just like SPARKSQL or PYTHON or DATAX,maybe more。

i set env info into （./bin/env/dolphinscheduler_env.sh）

and set user env info :

but get error when run python task .
i debug find ,the system env not set：

and user env also not set:

What you expected to happen

not error

How to reproduce

everytime

Anything else

No response

Version

3.2.x

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[ruanwenjun]

Try to import the env in your task.

[wangbowen1024]

Try to import the env in your task.

I tried, but I failed. Now I write these environment variables to /etc/profile to resolve

[cnfree0355]

I have the same issue with version 3.2
Here is my environment setup in dolphinscheduler_env.sh

  export SPARK_HOME=${SPARK_HOME:-/data/spark3}

  export PYTHON_LAUNCHER=${PYTHON_LAUNCHER:-/usr/local/python3/bin/python3}

  export DATAX_LAUNCHER=${DATAX_LAUNCHER:-/usr/local/datax/bin/datax.py}

  export PATH=$HADOOP_HOME/bin:$SPARK_HOME/bin:$PYTHON_LAUNCHER:$JAVA_HOME/bin:$HIVE_HOME/bin:$FLINK_HOME/bin:$DATAX_LAUNCHER:$PATH

When I pass the task or the result of these variables

echo " ------shell task 1 ------"
echo "The python launcher program is ${PYTHON_LAUNCHER} "
echo "The spark home is ${SPARK_HOME}"
echo "The datax launcher program is ${DATAX_LAUNCHER}"`

As shown in the log below, they are all null.

 ------shell task 1 ------
	The python launcher program is  
	The spark home is 
	The datax launcher program is 

[cnfree0355]

I have the same issue with version 3.2 Here is my environment setup in dolphinscheduler_env.sh

  export SPARK_HOME=${SPARK_HOME:-/data/spark3}

  export PYTHON_LAUNCHER=${PYTHON_LAUNCHER:-/usr/local/python3/bin/python3}

  export DATAX_LAUNCHER=${DATAX_LAUNCHER:-/usr/local/datax/bin/datax.py}

  export PATH=$HADOOP_HOME/bin:$SPARK_HOME/bin:$PYTHON_LAUNCHER:$JAVA_HOME/bin:$HIVE_HOME/bin:$FLINK_HOME/bin:$DATAX_LAUNCHER:$PATH

When I pass the task or the result of these variables

echo " ------shell task 1 ------"
echo "The python launcher program is ${PYTHON_LAUNCHER} "
echo "The spark home is ${SPARK_HOME}"
echo "The datax launcher program is ${DATAX_LAUNCHER}"`

As shown in the log below, they are all null.

 ------shell task 1 ------
	The python launcher program is  
	The spark home is 
	The datax launcher program is 

Add environment variable parameters from the management interface environment management options
Then associate the above variables during flow and project operations, but it still doesn't work.

[wangbowen1024]

I have the same issue with version 3.2 Here is my environment setup in dolphinscheduler_env.sh

  export SPARK_HOME=${SPARK_HOME:-/data/spark3}

  export PYTHON_LAUNCHER=${PYTHON_LAUNCHER:-/usr/local/python3/bin/python3}

  export DATAX_LAUNCHER=${DATAX_LAUNCHER:-/usr/local/datax/bin/datax.py}

  export PATH=$HADOOP_HOME/bin:$SPARK_HOME/bin:$PYTHON_LAUNCHER:$JAVA_HOME/bin:$HIVE_HOME/bin:$FLINK_HOME/bin:$DATAX_LAUNCHER:$PATH

When I pass the task or the result of these variables

echo " ------shell task 1 ------"
echo "The python launcher program is ${PYTHON_LAUNCHER} "
echo "The spark home is ${SPARK_HOME}"
echo "The datax launcher program is ${DATAX_LAUNCHER}"`

As shown in the log below, they are all null.

 ------shell task 1 ------
	The python launcher program is  
	The spark home is 
	The datax launcher program is 

Add environment variable parameters from the management interface environment management options Then associate the above variables during flow and project operations, but it still doesn't work.

you can set these env to /etc/profile to sloved

[zhongjiajie]

Hi all, you need to create new env in security center with both PYTHON_LAUNCHER and DATAX_LAUNCHER

export PYTHON_LAUNCHER=/Users/zhongjiajie/.pyenv/shims/python3
export DATAX_LAUNCHER=/Users/zhongjiajie/Documents/dist/datax/bin/datax.py

and then use the env in task, I test latest code and it work, I would like to close this issue, you can reopen it if you have further issues