Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remote test execution #13

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/e2e_test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -72,7 +72,7 @@ jobs:
- name: Run Test
shell: bash
run: |
python -m robot --outputdir reports-${{ matrix.target }}-${{ matrix.arch }} --settag ${{ matrix.target }}-${{ matrix.arch }} --name ${{ matrix.target }}-${{ matrix.arch }} ./test
python -m robot --outputdir reports-${{ matrix.target }}-${{ matrix.arch }} --settag ${{ matrix.target }}-${{ matrix.arch }} --name ${{ matrix.target }}-${{ matrix.arch }} ./test/remote_example_tests.robot

- name: Archieve test results
if: always()
Expand Down
10 changes: 10 additions & 0 deletions test/remote_example_tests.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
*** Test Cases ***;${github_url};${expect};[Tags];[Documentation]
Hello_B-U585I-IOT02A;https://github.com/Arm-Examples/Hello_B-U585I-IOT02A;${0};;
Hello_FRDM-K32L3A6;https://github.com/Arm-Examples/Hello_FRDM-K32L3A6;${0};;
Hello_IMXRT1050-EVKB;https://github.com/Arm-Examples/Hello_IMXRT1050-EVKB;${0};;
Hello_LPCXpresso55S69;https://github.com/Arm-Examples/Hello_LPCXpresso55S69;${0};;
Blinky_FRDM-K32L3A6;https://github.com/Arm-Examples/Blinky_FRDM-K32L3A6;${0};;
Blinky_NUCLEO-G0B1RE;https://github.com/Arm-Examples/Blinky_NUCLEO-G0B1RE;${0};;
Blinky_NUCLEO-F756ZG;https://github.com/Arm-Examples/Blinky_NUCLEO-F756ZG;${0};;
keil-studio-get-started;https://github.com/Arm-Examples/keil-studio-get-started;${0};;
Hello_AVH;https://github.com/Arm-Examples/Hello_AVH;${0};;
15 changes: 8 additions & 7 deletions test/remote_example_tests.robot
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,8 @@ Suite Teardown Global Teardown
Library lib${/}utils.py
Library String
Library Collections
Library lib${/}elf_compare.py
Library lib${/}elf_compare.py
Library DataDriver
Resource resources${/}global.resource
Resource resources${/}utils.resource
Test Template Test github examples
Expand All @@ -18,6 +19,7 @@ ${Hello_FRDM-K32L3A6} https://github.com/Arm-Examples/Hello_FRDM-K32L3A6


*** Test Cases ***
Test remote example ${github_url} and expect ${expect} Default UserData
# Test Csolution example
# ${csolution-examples} ${Pass}

Expand All @@ -29,15 +31,14 @@ ${Hello_FRDM-K32L3A6} https://github.com/Arm-Examples/Hello_FRDM-K32L3A6

*** Keywords ***
Test github examples
[Arguments] ${github_url} ${expect}
${dest_dir}= Evaluate "${github_url}".split('/')[-1]
${dest_dir}= Set Variable ${TEST_DATA_DIR}${/}${Remote_Example_Dir}${/}${dest_dir}
Checkout GitHub Repository ${github_url} ${dest_dir}
[Arguments] ${github_url} ${expect}
${dest_dir}= Evaluate "${github_url}".split('/')[-1]
${dest_dir}= Set Variable ${TEST_DATA_DIR}${/}${Remote_Example_Dir}${/}${dest_dir}
Checkout GitHub Repository ${github_url} ${dest_dir}
${files} Glob Files In Directory ${dest_dir} *.csolution.* ${True}
FOR ${file} IN @{files}
${example_name}= Get Parent Directory Name ${file}
Run Keyword If '${example_name}' != 'CubeMX'
... Run Csolution Project ${file} ${expect}
Run Csolution Project ${file} ${expect}
END

Run Csolution Project
Expand Down
1 change: 1 addition & 0 deletions test/requirements.txt
Original file line number Diff line number Diff line change
@@ -1,2 +1,3 @@
# Requirements needed
robotframework >= 7.0
robotframework-datadriver >= 1.11.2
Loading