[Enhancement] Optimize Jenkins Pipeline for Aether Deployment

[MAVRICK-1]

[Enhancement] Optimize Jenkins Pipeline for Aether Deployment

Issue Type: Enhancement

Description:
The Jenkins pipeline for Aether deployment needs optimizations for better efficiency, error handling, and maintainability. The following improvements will be implemented:

Improvements:

1. Enhanced Error Handling

• Use set -e in sh commands to ensure the pipeline exits immediately on failure.
• Improve catchError handling for better debugging messages.

2. Optimize Environment Variables

• Define WORK_DIR = "$WORKSPACE/aether-onramp" to avoid redundant cd commands.
• Use withEnv for dynamic environment variables (MYIP, MYIFC).

3. Efficient Log Retrieval

• Use a loop to fetch logs dynamically instead of multiple kubectl get pods calls.
• Append timestamps to log filenames to prevent overwriting.

4. Performance Enhancements

• Parallelize independent stages where possible.
• Use mkdir -p to ensure directories exist without redundant checks.
• Minimize unnecessary cd commands by defining working directories upfront.

5. Improved Slack Notifications

• Ensure meaningful error messages are sent with job details.

[MAVRICK-1]

@llpeterson can i work on this ?

[llpeterson]

Absolutely. I'd recommend tackling the issue (mostly) serially, so as to avoid huge Pull Requests. Starting with (1).