Skip to content

Latest commit

 

History

History
119 lines (90 loc) · 5.26 KB

README.md

File metadata and controls

119 lines (90 loc) · 5.26 KB

robotframework-statusupdater

Introduction

Updates status of tests to various test management systems

Current code is more of PoC, so work is still needed. Testlink implementation tested with Bitnami's Container.

Usage

Test management system is recognized from the variables in the scope. If for some reason different suites go to different systems, those variables can be set at Suite level.

If you are using the robotframework-maven-plugin you can use this library by adding the following dependency to your pom.xml:

<dependency>
    <groupId>com.github.hi-fi</groupId>
    <artifactId>robotframework-statusupdater</artifactId>
    <version>0.0.4</version>
    <scope>test</scope>
</dependency>
  • More information about this library can be found in the Keyword Documentation.
  • For keyword completion in RIDE you can download this Library Specs and place it in your PYTHONPATH.

Common

There're some common variables that control how library works when used as a listener. Note that listerner has to be specified when starting the tests (e.g. Generic way and Java with Maven plugin

Variable name Description
startSuiteListenerEnabled Listen suite start
stopSuiteListenerEnabled Listen suite end
startTestListenerEnabled Listen test start
stopTestListenerEnabled Listen test end

HP Quality Center / ALM (version 12)

With Quality Center/ALM, update is done to testcase name's first part (until first whitespace) in the Robot tests.

Required variables

Variable name Description
QC_URL Part of the QC's URL before /qcbin...
QC_USER User who has rights to specified domain and project and rights to execute tests
QC_PW Password for QC_USER
QC_DOMAIN Domain to use in QC
QC_PROJECT Project to use in QC

Statuses

Robot test status QC Status Comment
- Not Completed Default status when test execution is created to QC. Practically means that test is started in Robot
PASS Passed
FAIL If test has tag "BLOCKED" (case insensitive), Blocked; Otherwise Failed

Jira with Xray

Required variables

Variable name Description
JIRAXRAY_URL JIRA's hostname
JIRAXRAY_CONTEXT Path to Jira. Jira is accessed normally with JIRAXRAY_URL/JIRAXRAY_CONTEXT -address.
JIRAXRAY_USER User that has rights to create test executions to specified project.
JIRAXRAY_PW Password for JIRAXRAY_USER

Statuses

Robot test status QC Status Comment
- Not Completed Default status when test execution is created to QC. Practically means that test is started in Robot
PASS Passed
FAIL If test has tag "BLOCKED" (case insensitive), Blocked; Otherwise Failed

Jira with Zephyr

Required variables

Variable name Description
JIRAZEPHYR_URL JIRA's hostname
JIRAZEPHYR_CONTEXT Path to Jira. Jira is accessed normally with JIRAZEPHYR_URL/JIRAZEPHYR_CONTEXT -address.
JIRAZEPHYR_USER User that has rights to create test executions to specified project.
JIRAZEPHYR_PW Password for JIRAZEPHYR_USER
cycleId Zephyr cycle ID. Can be fetched with REST API call (not visible at UI)
versionId Zephyr version ID. Can be fetched with REST API call (not visible at UI)

Statuses

Robot test status QC Status Comment
- Not Completed Default status when test execution is created to QC. Practically means that test is started in Robot
PASS Passed
FAIL If test has tag "BLOCKED" (case insensitive), Blocked; Otherwise Failed

Testlink

With TestLink, update is done with testcase's external ID, which has to be first part of the testcase name in the Robot tests. In the case of failure failure message is written to notes of the TestLink execution.

Required variables

Variable name Description
TESTLINK_URL TestLink's XML-RPC endpoint. With Docker TestLink this is at http:///lib/api/xmlrpc/v1/xmlrpc.php
TESTLINK_API_KEY API key from the user who should be visible at the automated updates
planName Name of TestLink's test plan containing test case that needs to be updated
projectName Name of TestLink's project containing test plan containing test case that needs to be updated
buildId ID number of the build that is executed in Test Plan

Statuses

Updates Testlink only at test end.

Robot test status Testlink Status
PASS PASSED
FAIL If test has tag "BLOCKED" (case insensitive), BLOCKED; Otherwise FAILED