cloud-solutions-card copy

jsm-solutions-card

atlassian-services-solutions-card (2)

test-solutions-card

care-solutions-card

devops-solutions-card(1)

gdpr-solutions-card

    Solutions

    Expert consulting and managed services to help complex organisations to work flatter, faster and more dynamically

    Atlassian Gold Solution Partner banner white BG (PNG)

    BDQ.cloud are proud to be an Atlassian Gold Solution Partner.

    SOLUTIONS HOME →

      BDQ Originals

      EEASD_for_mega_menu_150x175

       

      BDQMAJC_for_mega_menu_150x175

        Other products

        Atlassian-vertical-blue@2x-rgb

         

        Sonatype_stacked_logo_full_color_150x150

           

           

          zephyr-clear-300x150

            Products

            Whether it's our own Atlassian Marketplace apps or the apps that we provide a value-added-reseller service for, you can trust BDQ for the best support, consultancy, training and implementation available.

            Products Home →

              zephyr-basicsjira-essentialsjsd-runningconfluence-essentials

                zephyr-managementpart-1getting-startedconfluence-server(2)

                  zephyr-automationpart-2getting-moreportfolio-jira

                    Training

                    • We provide high quality technology training to customers in the UK, EU and US.

                    • Our customers range from small companies to multi-nationals. They all want to maximise employee productivity.

                    • We listen to what our customers want to achieve, and take this into account when delivering the courses.

                    Training Home →

                      Resources

                      From webinar recordings to whitepapers, case studies to blog posts. Help yourself to our free content that will hopefully inform and inspire
                      Resources Home →

                       

                        5 min read

                        Test Automation - How it works with Zephyr

                        Featured Image

                        This is a short blog post about Zephyr for Jira and the various options for integrating it with test automation. This was correct at the time of writing, but Zephyr are very active with their product development, so expect more features to be on their way!

                        What is Zephyr for Jira and what has it got to do with test automation?

                        Zephyr for Jira is a very popular test automation tool that is fully integrated with Jira. It is available both on Server and on Cloud. It is very effective for managing manual testing and has all the usual facilities that one might expect. However, it also exposes interfaces and has plugins that allow it to show results from automated builds and other test tools. 

                        You can therefore show both results from manual testing, and automated testing, all within the same product!

                        Core Zephyr for Jira concepts

                        Zephyr for Jira uses the following. There is more, but this is relevant to the automation discussion.

                        Object Description
                        Test Cases These are specialised type of Jira issues, which contain test steps, summaries, descriptions and so forth. A Test Case will be executed within the context of a Test Cycle. Passes, fails etc will appear within Test Cycles.
                        Releases/FixVersions

                        This is a Jira concept, which Zephyr for Jira uses. The basic idea is that work is grouped into Releases. V1.0, V2.0 and so forth. Stories would generally be in one Release, but an Epic may span more than one Release (depending on how you are structuring your Agile projects). It is important to note this, as Zephyr Test Cycles, are associated with Releases.

                        Therefore you can have the concept of Smoke Tests, Functional Tests, re tests or any other group of tests, all associated with a given Release. E.g. "We need to run the Regression Cycle before releaseing V3.0.

                        Test Cycles

                        These are associated with a Release, and contain a number of Test Cases.

                        A Test Case can be in any number of Test Cycles, and its result may be different depending on the Test Cycle. E.g. it may fail in Cycle 1, but after being fixed, it may pass in Cycle 2.

                        The Execution result of a Test Case exist in the context of a Test Cycle.

                         

                        The automation interfaces allow us to push results into these constructs. Here we have an example of a Test Cycle for a version 3.0.0 release.

                        Integration options

                        These interfaces mainly use REST and JSON - currently within an API called the ZAPI (Zephyr API). Zephyr do provide all the documentation for this.

                        You must push data into the structures above.

                        For example:

                        • A set of Junit tests would each correspond to a test case
                        • Each execution of those tests would correspond to a Test Cycle, with the results in that Test Cycle.

                        As things stand, the integration options are as follows:

                        • Jenkins/Bamboo plugins. These are plugins which you can use within your CI/CD tool. 
                          • These will generate Test Cases and Test cycles.
                          • Junit or TestNG files should be generated during your build job, and passed to the plugin
                          • The plugin will push the results back to Zephyr for Jira
                        • ATOM - the user uploads files directly into Zephyr For Jira, creating test results
                        • ATOM Zbot agent installed on remote server:
                          • The Zbot can retrieve files from a given location.
                          • It can be triggered using the ATOM API, remotely (e.g. during a build, or manually)
                        • ZAPI - direct REST API access - full control
                          • You can add data directly via the REST API
                          • It is your responsibility to create the required structures
                          • This is the most complex route
                          • The API documents are here: https://getzephyr.docs.apiary.io/#

                        An ATOM task looks like the screen below, and is accessible from the Jira Server. 

                        The Jenkins plugin is similar:

                         

                        In both cases, you can see that you have to choose a Verions and a Cycle (or allow a new Cycle to be created). Test Cycles are where the automation frameworks post their results.

                        Summary

                        The easiest way of pushing back results is to use the plugin - drop them into Bamboo or Jenkins, configure accordingly, and you will start to get results from your CI/CD processes appearing within Zephyr for Jira.

                        The most control, and most complex route, involves using the full ZAPI REST api. You have to do everything yourself manually, and the ZBot and ATOM framework is in the middle - this allows you to pull results, and trigger via the REST API, or manually.

                        If you would like more advice, or assistance with implementing test automation, please get in touch.

                         

                        We hosted a webinar that looks at the challenges associated with managing testing.

                        Test Management for global IT implementations with Jira and Zephyr

                        Wednesday 2nd September 2020, 3pm BST

                        Are you managing a large scale IT implementation? How are you managing the scope of your tests? Do you have visibility over all the testing being done and it's progress? Do you have remote teams and testers, and are they all collaborating effectively?

                        Listen in to this webinar with Laurence Postgate and Chris Bland as they discuss the problems of managing testing in global IT implementations.

                        Don't worry! We recorded the webinar for you - just click the link to access the video.

                        Watch webinar recording