What's New

You can find information about the features introduced, enhancements, or other changes made in IBM® DevOps Test Hub (Test Hub). You can also find the features that were introduced in earlier versions of Test Hub. DevOps Test Hub is the new name of Rational® Test Automation Server from 11.0.0 onwards.

What's New in DevOps Test Hub 2024.06 (11.0.2)

The following section lists the features, enhancements, or other changes made in Test Hub 2024.06 (11.0.2).

Feature title Description

Enhanced Machine learning (ML) insights on Performance tests

A new parameter called Performance Agent Health is now added in Performance tests or Schedules to improve machine learning (ML) insights for performance testing. See Machine learning capabilities in DevOps Test Hub.

Support to run SAP tests on DevOps Test Hub

You can now run the SAP tests that were created in DevOps Test UI on DevOps Test Hub. For more information, refer to Task flow for running SAP tests on DevOps Test Hub.

Enhancements to the Integration user interface

The Integration feature now includes an enhanced user interface. Previously, the Change Management and Test Management were presented in separate tabs. Now, they are integrated into a single improved user interface that offers seamless management of both Test and Change integrations.

Enhancements to the Webhooks page

The Webhooks page now features an enhanced user interface. The appearance of the Templates and Webhooks tabs is improved. Further, the Edit channel type option is relabeled as Channel Type, and the options Show all levels and Hide other levels are replaced with a default-selected Show all levels checkbox.

Enhanced the user interface on the Configuration page

The Configuration page is updated and now features a more refined user interface.

Previously, the project configuration details and repositories were presented in separate tabs. Now, they are combined into one streamlined user interface. You can now seamlessly manage configuration details and repositories.

Enhanced user interface of the Edit branch dialog

The Edit branch dialog is updated and now features a more refined user interface.

Previously, if your edit branch was trailing behind the source branch, there were neither alerts nor any options for you to pull the changes. Now, with the improved user interface, a warning message is displayed if your chosen edit branch is behind the source branch. Additionally, you can easily pull the changes from the source branch to your edit branch by using the new checkbox.

What's New in earlier versions

What's New in 11.0.1

The following section lists the features, enhancements, or other changes made in Test Hub 11.0.1.

Feature title Description

Adding an external database connection and importing data to create test assets

You can now add an external database connection to a project in Test Hub, and then create a database query to import data from the database. You can also create test assets such as datasets and Data definitions by using the database query.

Enhanced the UI with the new Security page

You can now use the Security page to create and manage API secrets and dataset classifications. You can also add the credentials of external databases to data classifications.

You can now provide Read access to the classifications at the role level, while Write access is restricted. The Access Control List UI is enhanced so that you grant both Read and Write access to members with classification privileges. See Protecting API test assets by using secrets, Managing an encrypted dataset.

Installing and configuring the DevOps Test Hub Results Data plugin by using a proxy connection

You can now install and configure the DevOps Test Hub Results Data plugin by using a proxy connection in Grafana instead of using additional helm parameters during the installation of Test Hub. See Installing and configuring the DevOps Test Hub Results Data plugin.

Viewing resource monitoring usage data on Grafana

You can now view the resource monitoring usage data by creating queries on Grafana, and retrieve this data that is collected for a certain period during a test run in Test Hub. See Viewing resource monitoring usage data on Grafana.

What's New in 11.0.0

The following section lists the features, enhancements, or other changes made in Test Hub 11.0.0.

Feature title Description

Renaming of Rational® Test products

The following Rational® Test products have new names starting from 11.0.0:
  • IBM Rational Test Automation Server is now IBM DevOps Test Hub.
  • IBM Rational Functional Tester is now IBM DevOps Test UI.
  • IBM Rational Integration Tester is now IBM DevOps Test Integrations and APIs.
  • IBM Rational Performance Tester is now IBM DevOps Test Performance.
  • IBM Rational Performance Test Server is now IBM DevOps Test Performance Test Server.
  • IBM Rational Service Tester for SOA Quality is now IBM DevOps Test Performance for SOA Quality.
  • IBM Rational Test Control Panel is now IBM DevOps Test Virtualization Control Panel.
  • IBM Rational Test RealTime is now IBM DevOps Test Embedded.
  • IBM Rational Test Virtualization Server is now IBM DevOps Test Virtualization.
  • IBM Rational Test Workbench is now IBM DevOps Test Workbench.

Enhancements to the data fabrication feature

The data fabrication feature is enhanced and you can now perform the following tasks:
  • Create an empty Data definition, or import the header row fields from a CSV file or a dataset. You can then add the basic generators or modify the generators to suit your test data fabrication requirements.
  • Create folders in your project repository and select them as locations to save your data definitions.
  • Use the Save All option to save all files that are opened for editing or have unsaved changes.
  • Use the right-click options to close any or all files that are opened for editing or have unsaved changes.
  • Use the distribution parameter, which is enhanced to automatically allocate and rebalance the distribution among the existing and new configurations that are added subsequently.
  • Preview the sample test data for each configuration of a generator.

Support to view configuration details of a Virtual Service instance

You can now view the configuration details of a Virtual Service that you configured during a run from the Instances page. The details such as the datasets selected for overrides, variables, JVM arguments, environment variables, and additional parameters are displayed, if they are configured.

Enhancements to editing datasets

The editing capabilities of datasets are further enhanced in Test Hub 11.0.0. You can now perform different actions to edit the dataset from the UI by using the Editing panel, the context menu options, and the insert options available in the Dataset panel.

New options to edit and save Data definitions

You can now use the right-click options for Data definitions from the Data Navigator to open the Data definition for editing or saving it as a different Data definition.

What's New in 10.5.4

The following section lists the features, enhancements, or other changes made in Rational Test Automation Server 10.5.4.

Feature title Description

Support to generate test data

Rational Test Automation Server now supports the capability to generate test data that you can use in your tests at test run time.

You can use the built-in data generators or create customized data generators to suit your test data requirements. You can preview the test data in the UI before you generate the test data. You can also download the generated test data.

You can view the history of the test data generated, and you can regenerate the test data with or without altering any of the parameters used.

See Data fabrication.

Support for Machine learning insights on performance tests

Rational Test Automation Server is enhanced to provide Machine learning (ML) insights on performance tests that match certain criteria when you run tests from projects in a team space. Rational Test Automation Server uses ML algorithms to analyze the following types of parameters in performance tests:
  • Response Time Lock-Step Pattern
  • Response Time Standard Deviation Pattern
  • Throughput Drop Pattern

The findings from the analysis are presented as a recommendation for each of the parameters on the Infrastructure > Analyzers page in the team space.

You can improve ML recommendations by altering the default Threshold value that specifies the level of confidence required in the insights. You can also improve the accuracy of the recommendations by running multiple tests with differing loads repeatedly.

See Machine learning capabilities in DevOps Test Hub.

Enhanced the dataset editor and managing capabilities

The CSV Editor that is used to edit datasets is enhanced and now opens within the Rational Test Automation Server UI, which previously opened in a separate browser tab.

Further, the pages and the methods to create, open, or view datasets are changed in their presentation in the UI.

See Working with Datasets on DevOps Test Hub.

Enhanced dataset classification

You can now set the dataset classification (encrypted password) for a dataset irrespective of its location in branches in a repository. The dataset classification that you set is applied to all branches and you need not set a password for each branch that contains the dataset. If you want to use different passwords, then you can create a different dataset by cloning the dataset that you want.

See Managing an encrypted dataset.

Support for in-built Chrome and Edge browsers

Rational Test Automation Server now provides support for running browser-based tests by using the in-built Chrome and Edge browsers after you accept the license terms for usage. If you do not accept the license terms at the time of signing in or later, tests that use these browsers fail to run successfully.

See Managing third-party licenses.

Support to run AFT Suite on a mobile device by using variables

You can now run an AFT Suite, which contains mobile or Web UI tests on a device, emulator, or simulator that is connected to an agent of a device cloud. You must enter the details of the agent or device cloud as variables while you configure a run of the AFT Suite.

See Configuring an AFT Suite to run on a mobile device by using variables.

Support to override the project in a mobile device cloud

You can now select or create a project to override the project that is configured for a cloud credential when you want to run a mobile test, Web UI test, Compound test, or an AFT Suite. The tests run on mobile devices that are connected to a mobile device cloud.

See Configuring an AFT Suite to run on a mobile device by using a cloud credential, Configuring a run of a Compound Test that contains mobile tests to run by using a cloud credential, or Configuring a run of a Compound Test that contains Web UI tests to run by using a cloud credential.

Support to add reports and logs to Jira issues

After you configure Jira as a change management system on Rational Test Automation Server, you can now add the test reports or test log to the Jira issue that you create for a test result. You can then view the attached reports or log from your project in Jira.

See Creating Jira issues for the test results.

Support to view test log statistics in Grafana

You can now view the overall statistics and time-series statistics in Grafana by using queries for the test logs that are generated in Rational Test Automation Server.

See Viewing test results data in Grafana.

Enhanced the display of events in Web UI or Functional test logs

The display of the events in the Web UI or Functional test log is enhanced. Previously, the events were displayed under the UIScript node and placed under the Test node, which did not represent the correct hierarchy.

Now, the events are placed under the Test node and the UIScript node is no longer displayed, thus displaying the correct hierarchy of the events in the test log.

Requirement of Java 17 for Resource Monitoring agents

The Resource Monitoring Java Agent now requires Java 17 JRE or JDK to be installed on the computer that is used to collect the Resource Monitoring data from Rational Test Automation Server.

What's New in 10.5.3

The following section lists the features, enhancements, or other changes made in Rational Test Automation Server 10.5.3.

Feature title Description

Support to run mobile tests on device clouds

You can now configure a connection from Rational Test Automation Server to a mobile device cloud by using the credentials of your cloud subscription account. You can then add team space members as authorized users of the cloud credential. The authorized users can run mobile tests on the mobile devices that are connected to a mobile device cloud.

See Management of mobile device cloud credentials.

Enhancement to the webhooks feature

The webhooks feature is enhanced to enable you to configure the behavior of notifications that were not sent because the webhook was disabled. You can decide to discard or send the queued notifications when you re-enable the webhook. Webhook templates defined at the team space are now also displayed at the project level.

See Configuration of a webhook.

Support to download test reports

You can now download the reports and logs of the tests from the Results page. Reports can be saved to a folder on your computer as a compressed file or PDF, which depends on the format of the generated report.

See Test results and reports.

Support to override input tags of virtual services

You can now specify values for stub input tags by using advanced configuration parameters when you run a virtual service.

See Additional configuration parameters for virtual services.

Support to add an Azure repository

You can now add an Azure repository that contains test resources to your project in Rational Test Automation Server, and then run the resources from the server.

See Repository considerations for a server project.

Removed support of Prometheus for virtual services

Virtual service usage in Rational Test Automation Server no longer utilizes Prometheus. If you upgrade from a previous version of Rational Test Automation Server to 10.5.3, any virtual service usage that was captured before 10.5.3 will not be visible in the team space or project virtualization usage pages.

What's New in 10.5.2

The following section lists the features, enhancements, or other changes made in Rational Test Automation Server 10.5.2.

Feature title Description

Support to run tests or resources as a GitHub Action

You can now run tests or resources that are contained in your project on Rational Test Automation Server as a GitHub Action from a Git repository.

See Configuration of test runs in a GitHub Actions Workflow.

Running Selenium tests on Rational Test Automation Server

You can now run Selenium tests that are within a Maven project from Rational Test Automation Server.

You must commit the Maven project as a pom.xml to a Git repository. After you add the Git repository to your project on Rational Test Automation Server, you can configure a run of the Selenium test from the Execution page.

See Configuring a run of a Selenium test.

Running virtual services on API agents from Rational Test Automation Server

You can now configure an IBM Rational Integration Tester Agent to register with a team space in Rational Test Automation Server by using the server hostname, team space name, and your offline token. When you start the virtual services, you can select the Rational Integration Tester agent as the location and not select the Kubernetes cluster.

See Management of API agents.

Support for IBM Rational ClearQuest® as a change management system

You can now create Rational ClearQuest work items for the tests that ran on Rational Test Automation Server, after you configure Rational ClearQuest as a change management system on Rational Test Automation Server.

Configuring external webhooks on Rational Test Automation Server

You can configure the URL of third-party applications such as Teams or Slack, as a webhook on Rational Test Automation Server when you want to receive push notifications about events that occur on the server.

You can create templates and select specific events for which you want to receive notification messages in the defined template for those events.

See Configuration of a webhook.

What's New in 10.5.1

The following section lists the features, enhancements, or other changes made in Rational Test Automation Server 10.5.1.

Feature title Description

Support to export test results to a Jira Xray project

When you use Atlassian Jira as a change management system on Rational Test Automation Server and you use Xray as the test management application in Jira, you can now integrate Xray with Rational Test Automation Server. With this integration, you can export the test results of the tests that run on Rational Test Automation Server to an issue in your Jira Xray project. You can then view and use the test results in your project in Jira.

See Integration with Xray test management for Jira.

Configuring Azure DevOps as a change management system

You can now add Azure DevOps as a change management system on Rational Test Automation Server, if you use Azure DevOps to create and monitor defects or bugs, issues, or other work items. After you configure Azure DevOps on Rational Test Automation Server, you can create work items for the test runs from Rational Test Automation Server and view the created work items on Azure DevOps by clicking the links within Rational Test Automation Server.

See Configuration of Azure DevOps as a change management.

Support for HCL® Compass as a change management system

You can now create HCL Compass records for the tests that you run on Rational Test Automation Server, after you configure the HCL Compass server as a change management system on Rational Test Automation Server.

See Configuration of DevOps Plan as a change management.

Copying of the generated keys individually

When you configured Atlassian Jira as a change management system on Rational Test Automation Server, you were able to copy the public and consumer keys in a single action. However, it was difficult to differentiate the keys when you pasted them in the individual fields on the Jira server configuration page. You can now copy the public and consumer keys separately and use them to configure the Jira server.

Support to create defects on tests run by other project members

Previously, you were able to create defects only on tests that you ran on Rational Test Automation Server. You can now create defects in the change management system configured in your project on tests that are run by other project members too.

Enhanced publishing of association changes in the system model

Previously, you were able to publish the changes made to the component associations with test resources in the system model from the Author > Changes page. You can now review and publish the association or dissociation changes of test resources with components in a system model from the System Model page. You can use the Image of the publish icon. icon on the System Model page to publish the association changes.

Viewing results data in Grafana

By using the Grafana plugin for Rational Test Automation Server, you can retrieve and explore test log data for tests run from Rational Test Automation Server on the Grafana dashboard. See Test results data in Grafana.

What's New in 10.5.0

The following section lists the features, enhancements, or other changes made in Rational Test Automation Server 10.5.0.

Feature title Description

Support to install Jaeger as part of Rational Test Automation Server is removed

The support to install Jaeger during the installation of Rational Test Automation Server is removed.

Running tests on remote Kubernetes clusters

You can now run the supported test resources on remote Kubernetes clusters that you register with a team space on Rational Test Automation Server and add the Kubernetes cluster to your project in the team space.

You can select the remote cluster as a location to run the tests when you configure a run.

You can edit the configurations of a cluster, remove a cluster from a project, or unregister the cluster from a team space.

See Management of remote Kubernetes clusters.

Creating an Edit branch to contain resources before committing to the repository branch

When you want to create or edit datasets or resources that are associated with components in a system model, you must now create an Edit branch, which is a temporary branch that will contain these until the time you commit or publish these to a branch in the project repository or the team space repository.

Support to schedule recurring test runs

You can now schedule recurring test runs on Rational Test Automation Server.

Support to run additional test assets from integration plugins

By using appropriate Rational Test Automation Server integration plugins, you can now run the following types of test assets:
  • Apache JMeter tests

  • Apache JUnit tests

  • Postman resources

  • HCL AppScan CodeSweep

You can run these tests from the Azure DevOps, IBM Engineering Test Management, Jenkins, and IBM UrbanCode™ Deploy.

Enhancements to the IBM Rational Test Workbench extension

When you run tests from Azure DevOps Pipeline by using the IBM Rational Test Workbench extension, you can now store the JUnit report that is generated for the test in the XML format.

See Running DevOps Test Hub tests in an Azure DevOps Pipeline.

Enhancements to the Jenkin plugin

You can now view the test results by using the Test Results Analyzer feature in Jenkins if you have installed the Test Results Analyzer plugin in Jenkins. See Running tests from Jenkins.

What's New in 10.2.3

The following section lists the features, enhancements, or other changes made in Rational Test Automation Server 10.2.3.

Feature title Description

Installing server software on Azure Kubernetes Service

You can now install Rational Test Automation Server on Azure Kubernetes Service that has a Kubernetes environment to run functional, integration, and performance tests.

Support to view or hide license details

As a system administrator or team space owner, you can now view or hide the details of the License Server on the License Configuration page.

Enhancement to publishing of datasets from Rational Test Automation Server

Rational Test Automation Server now provides the capability to publish a dataset subsequent to publications from other users when the changes made to the datasets do not conflict with the changes made by the other users.

Viewing or editing load test profile details for Schedules

You can now view the load test profile details for the Schedules that you added in Rational Performance Tester in the Description column on the Author > Tests page. You can also edit the load test profile details if you do not want to run the Schedules with the configured profile.

Adding notes to a test result

You can now add notes to a test result and group these notes into a discussion in the Details panel on the Results page. You can also perform a search for specific content in the notes.

Enhanced the option to export queries from Rational Test Automation Server

Previously, you were able to export the queries that you created from Rational Test Automation Server as a curl command. You can now use the Export option to export the queries to Shell, Curl, or PowerShell scripts. You can now select the script, the output format, and the number of results that are returned by the query.

Enhanced the viewing of test logs

Previously, the test log displayed all the activities that were captured for a test run and viewing the essential information was tedious. You can now select a view that filters the activities that you might be interested in as a tester. You can however, view all the activities that are captured for a test run by switching off the filter.

The Test Log page now displays the view correctly when you return to the page after viewing another page on the server UI. You can also use an option on the UI to view the test log list.

Viewing attachments in the test log

You can now view the attachments such as images, documents, PDFs, scripts, json or xml files, that are captured by the test log. You can view the attachments that are supported for display in a web browser. You can also copy or download the attachments to your computer.

Viewing the test run duration and time from test logs

After you run a test, you can view the calendar time and the duration for each of the test steps from the test log.

Enhancements to integration plugins

While you configure test runs from the integrated product, you can now use additional parameters such as: Datasets, Labels, Secret Collection, Start Date, and Variables in the following integration plugins:
  • Azure DevOps
  • IBM UrbanCode Deploy
  • Jenkins

Support to run virtual services by using server plugins

Previously, you were able to run test assets that were in your project on Rational Test Automation Server from the integrated applications by using the server plugins. You can now run or start instances of virtual service resources that are in your project on Rational Test Automation Server from integrated applications such as Azure DevOps, Jenkins, and IBM UrbanCode Deploy.

Support to run additional test assets from Jenkins

You can now run the following types of test assets from the Jenkins server by using the Rational Test Automation Server Jenkins plugin:
  • API tests
  • Functional tests
  • Performance tests
  • Virtual services

Viewing test run results on the Azure test plans dashboard

When you use the IBM Rational Test Workbench Azure extension in Azure pipelines to run tests on Rational Test Automation Server, you can view the test results on the Jobs page. If you want to view the results of the test runs on the test plans dashboard, you must set up test plans with test cases for your project in Azure. You must also provide details about the Azure server, your personal access token, the Azure project, the test case, and the test plan while you configure the test run for the test results to display on the test plans dashboard.

What's New in 10.2.2

The following section lists the features, enhancements, or other changes made in Rational Test Automation Server 10.2.2.

Feature title Description

Support to add multiple repositories simultaneously

Previously, you were able to add individual Git repositories one at a time to your project on Rational Test Automation Server.

Now, you can add multiple repositories simultaneously that are contained in the same repository domain.

See Adding repositories to a server project.

Support to configure and run individual test assets

Previously,you were able to configure and run Suites, Compound Tests, or Schedules on Rational Test Automation Server. Now, you can configure and run individual test assets such as an API test, a Functional test, or Performance test.

See Test run configurations.

Enhanced Jenkins plugins to run tests from a Jenkins pipeline project

The Rational Test Automation Server Jenkins plugins are enhanced so that you can now run tests as a job in a Jenkins Pipeline project.

Configuring additional Jira fields

Jira server administrator can now configure additional fields as Required fields in the project on the Jira server to be displayed in the Raise defect in Jira window while creating a defect from Rational Test Automation Server.

See Creating Jira issues for the test results.

Collecting and viewing resource monitoring usage data

You can create queries to retrieve monitoring usage data that is collected for a time period during a test run.

See Collecting and viewing resource monitoring usage data, Configuring a test, Viewing resource monitoring usage data, and Creating queries for resource monitoring usage data.

Viewing test logs

When a test run is complete, a test log report is generated for the tests which are configured to collect test logs data. The test log contains details about the events in the tests and their properties. See Test logs.

Querying test log data

You can create queries to view test log data for all the test results in a project or for one particular result.

See Test log queries and Configuring and running log queries.

What's New in 10.2.1

The following section lists the features, enhancements, or other changes made in Rational Test Automation Server 10.2.1.

Feature title Description

Integration with IBM Engineering Test Management

You can now integrate Rational Test Automation Server with IBM Engineering Test Management to run the test assets in a project in your team space from Engineering Test Management. After the tests run, you can view the results on the Results page. See Integration with IBM Engineering Test Management.

Overriding results database

When you want to override the Results Database that is configured in the API Suite project, you can now provide the URL, user name, password, and the database driver as program arguments in the Advanced settings in the Execute test asset dialog box. You can optionally use an encrypted password that is generated by using the EncryptPassword application that is in the installation directory of Rational Integration Tester.

What's New in 10.2.0

The following section lists the features, enhancements, or other changes made in Rational Test Automation Server 10.2.0.

Feature title Description

Supporting installation of the server software in an air-gap environment

If your OpenShift Container Platform (OCP) cluster is within a restricted network with no access to the internet, you can now install Rational Test Automation Server on such OCP clusters by using an air-gapped environment. See Installing the DevOps Test Hub on IBM Red Hat OpenShift in an air-gapped environment.

Creating and maintaining multiple team spaces

Previously, Rational Test Automation Server supported only one logical partition as the initial team space. Now, you can create and maintain multiple team spaces in Rational Test Automation Server. The initial team space is available for all licensed users of Rational Test Automation Server before you create any other team space.

You can perform the following tasks in team spaces:
  • Configure licenses or licensed users for each team space.
  • View all team spaces created on Rational Test Automation Server and the team spaces that you can access from the Team Space Dashboard page.
  • Register Dockers, agents, intercepts, or Resource Monitoring agents with a team space before you use them in your projects of that team space.
  • Add team space members with the following roles:
    • Team Space Owner
    • Project Creator
    • Architect
    • Member
  • Isolate the projects from the users who are not members of the team space.

See Team space overview.

Configure a repository with any default branch in a team space

Now, you can configure any branch in a repository as the default branch in a team space.

Starting or stopping virtual services associated with components

After you associate virtual services with components in the System Model page, you can then navigate to the Resources or Instances page to either start an instance or stop a running instance.

See Viewing resources that are associated with components.

Viewing and stopping virtual service instances associated with components

After you start an instance of the virtual services that are associated with components in the System Model page, you can then navigate to the Instances page to either view the running instance or stop a running instance. You can also view the components that are associated with running instances of virtual services from the Instances page.

See Viewing running instances of virtual services.

Introducing the Concurrent Virtual Services licenses

A new licensing option, Concurrent Virtual Services, is required when you want to run an instance of a virtual service on Rational Test Automation Server.

See DevOps Test Hub licensing information.

Viewing running instances associated with components

After you have associated virtual services with components in the System Model and started instances, you can view the instances that are associated with the components from the Instances page. You can also filter the view to display running instances by using components as a criteria in the filters.

Hiding inactive instances from the virtual service Instances page view

You can now hide the virtual service instances that are stopped or those that failed, from the display on the virtual service Instances page via a single button.

See Viewing running instances of virtual services.

Stopping multiple running instances of virtual services

You can now stop multiple or all running instances of virtual services from the Instances page.

See Stopping virtual services.

Navigating to the Progress page to view the state of test asset runs

You can now navigate to the Progress page from the Execution page to view the runs that were started, scheduled, or completed by clicking the Show in the Progress page icon that is enabled for the specific test asset.

See Viewing the state of test assets.

Stopping or Canceling multiple test runs

You can now stop multiple or all running test assets from the Progress page. You can also cancel multiple or all scheduled runs of test assets from the Progress page.

See Stopping test runs or Canceling scheduled test runs.

Defining resource monitoring sources for a team space

As a team space owner, you can define resource monitoring sources in the team space so that they can be shared between multiple projects in the team space. During a performance schedule execution with resource monitoring labels, the sources defined in a team space are collected with the sources that are defined in a project whenever they match the provided labels. As a user of a team space, you can use the resource monitoring sources that are defined in the team space.

Agents listed for selection based on capabilities

When you install static agents and add the agents to your project on Rational Test Automation Server, the agents based on the capabilities that match with the agent specified in the test assets are listed for an override. The agents with the best matching capabilities are listed on the top followed by other agents with mismatched capabilities.

Adding categories and properties to user-defined capabilities

The user-defined capabilities feature is enhanced. Now, you can group user-defined capabilities under categories that you create. You can also add name-value pairs as properties for the capabilities.

See Working with the capabilities of a performance agent.

What's New in 10.1.3

The following section lists the features, enhancements, or other changes made in Rational Test Automation Server 10.1.3.

Feature title Description

Introducing Team Spaces on Rational Test Automation Server

Rational Test Automation Server is now provisioned to display an initial Team Space, which is a logical partition of Rational Test Automation Server.

The operations that you managed at the server level can now be performed at the Team Space level. You can now configure licenses or an SMTP server, create projects, register the remote agents, dockers, or intercepts within a Team Space. See Team space overview.

System modeling

You can create a system model to view the logical representation of any application under test in a Team Space. The system modeling is a Tech Preview feature.

You can configure a Team Space repository, which is different from the project repository, to save the system model.

You can create components that represent different types of assets and associate the components by defining the relationship between the components. You can also create child components for components. You can use these concepts to build a system model and view the model. You can then publish the system model to the Team Space repository.

You can also associate the virtual services in a project repository with components of the system model. From the associated component, you can view and run the virtual services.

See System modeling.

Working with virtual services

You can now view the virtual service resources that are in your project repositories from the Resources page and then configure a run of the virtual service. Working with virtual services is a Tech Preview feature.

After you start a virtual service, the running instances can be viewed from both the Resources page and Instances page.

You can perform the following tasks on virtual services:
  • View information about the details, behavior, usage, routing rules, and diagnostic information of the virtual service instance.
  • Modify the behavior or the logging level of a running instance.

See Management of virtualized services.

Stubs are excluded from Execution and Progress pages

Starting from 10.1.3, stubs are not displayed on the Execution page to start them nor are they displayed on the Progress page after they are started. Stubs must be started from the Virtualization > Resources page and stubs that are running can be viewed from the Virtualization > Instances page.

See Management of virtualized services.

Agents are selected automatically for an override

When you install static agents V10.1.2 and add the agents to your project on Rational Test Automation Server, Rational Test Automation Server determines and then displays the capabilities of the agents. Further, Rational Test Automation Server compares the capabilities of the agents with the required capabilities specified for the agent in the test assets and automatically selects the most suitable agent for an override. You can either proceed with running the test on the agent selected or select an agent from the agents displayed that have the same capabilities. See Adding a performance agent to a project.

Working with capabilities that you define for static agents

When you install static agents V10.1.3 and register them with Rational Test Automation Server, you can add, view, edit, or delete the capabilities of static agents. See Working with the capabilities of a performance agent.

Refreshing of the migrated project repositories

After you migrate a project from a previous version to a later version of Rational Test Automation Server, the repositories that are configured for the project are refreshed only after the project owner logs in to Rational Test Automation Server.

What's New in 10.1.2

The following section lists the features, enhancements, or other changes made in Rational Test Automation Server 10.1.2.

Feature title Description

Documentation

You can now quickly add your comments to provide your feedback about the documentation for Rational Test Automation Server by posting to a product forum. To add your comments as feedback, you must first register at IBM Support. Your login information along with your comments are governed by the privacy policy of IBM. By commenting, you accept the terms of use of IBM.

Installation

You can now install Rational Test Automation Server on Ubuntu (using k3s) platform. See Installation of DevOps Test Hub on Ubuntu.

Enhanced license configuration settings

If you are an administrator, the Configure license option enables you to change the configuration values such as the value of IBM Common License Key Server. An administrator can also add, remove, or replace prioritized users.

Refreshing repositories

The repositories are refreshed automatically at regular intervals to ensure that each repository is in synchronization with the remote repository. You can also trigger the refresh activity manually for a repository to fetch the changes instantly. See Refreshing repositories manually.

Creating webhooks

You can now create a webhook for a repository in Git server. For each push event in the Git server, the webhook notifies Rational Test Automation Server to trigger the refresh activity to pull the latest changes to the server repository. See Creating webhooks.

Viewing capabilities of registered agents

Previously, you were able to view the details about the agents. You can now view and ascertain the system and application capabilities of all agents that are registered with Rational Test Automation Server. With the information presented, you can make informed decisions about selecting an agent for running tests from Rational Test Automation Server. See Adding a performance agent to a project.

Managing notifications

You can now choose whether to receive in-app, email, or both notifications for each notification channel. By default in-app notifications are enabled. The notifications are about tasks that need completion from users or for information purposes. See Managing email notifications.

Configuring notifications

As an administrator, you can now set up an SMTP email server to send email notifications. The notifications are about tasks that need completion from the users or for information purposes. See Configuring an SMTP server to manage email notifications.

Support for integration with Azure

You can now use the Rational Test Workbench extension to establish a trusted and secure connection between Azure DevOps Server and Rational Test Automation Server to run the Rational Test Automation Server tests from the Azure DevOps Server. See Integration with Azure DevOps.

Support for integration with Jenkins

You can now use the Rational Test Automation Server Jenkins plugin to establish a trusted and secure connection between the Jenkins server and Rational Test Automation Server to run the Rational Test Automation Server tests from the Jenkins server. See Integration with Jenkins.

Support for integration with IBM UrbanCode Deploy

You can now use the Rational Test Automation Server UCD plugin to establish a trusted and secure connection between the UCD server and Rational Test Automation Server to run the Rational Test Automation Server tests from the UCD server. See Integration with IBM DevOps Deploy.

Support for integration with Jira

Rational Test Automation Server is now integrated with Jira software, as a result, you can create a defect in Jira from the Rational Test Automation Server UI. See Configuration of Atlassian Jira as a change management.

Importing a CSV file with a separator character

You can now import a CSV file that has a separator character into the dataset and configure the required separator values in the CSV Editor.

See Editing a dataset.

What's New in 10.1.1

The following section lists the features, enhancements, or other changes made in Rational Test Automation Server 10.1.1.

Feature title Description

Reviewing system requirements

You can now find system requirements information about hardware and software compatibility in this documentation. For more information, see System Requirements for DevOps Test Hub 2024.06 (11.0.2).

Upgrading the server software

You can now upgrade to the latest version of Rational Test Automation Server on the Red Hat OpenShift platform by using the helm upgrade command from 10.1.0. See DevOps Test Hub upgrade methods.

Support for running Compound Tests that contain mobile tests

You can now configure a run for a Compound Test that contains mobile tests and then run the Compound Test on Rational Test Automation Server. See Configuring a run of a Compound Test that contains mobile tests to run by using variables.

Overriding Resource Monitoring settings in a performance schedule

Now in the Execution dialog, the Resource Monitoring tab displays the settings related to the Resource Monitoring sources and labels as they were set in the performance schedule. This information is helpful to decide whether you want to override them with the Resource Monitoring sources that are available in your Server project, or not. See Controlling resource monitoring sources in a schedule.

Service virtualization: Tech Preview

Virtualizing a service in a namespace of Rational Test Automation Server

Previously, you specified the short name of a service that you wanted to virtualize as the host for the HTTP transport and specified the namespace in the recording settings for an Istio proxy. For example, to record the reviews service that had an FQDN of reviews.default.svc.cluster.local the host for the HTTP transport to be specified was reviews, and the namespace to be specified for the Istio Proxy was default. However, Istio routing in Rational Test Automation Server only uses the host name and port to generate the routing rule and for stubbing. Therefore, the host name must contain the namespace so that Rational Test Automation Server can correctly identify the service that is being stubbed.

Now, you can enable Rational Test Automation Server to use the namespaces that you want by providing the namespaces at the time of the installation of the server software.

Saving a copied dataset

You can now save a copy of a dataset in a different folder or make a copy with a different name, by using the Save As option.

See Working with Datasets on DevOps Test Hub.

Displaying icons to view who is editing datasets

In Rational Test Automation Server, you can now see all members who are editing a particular dataset.

See Editing a dataset.

What's New in 10.1.0

The following section lists the features, enhancements, or other changes made in Rational Test Automation Server 10.1.0.

Feature title Description

Installation

Rational Test Automation Server can only be installed on the following platforms:
  • Red Hat OpenShift 4.2+

  • Ubuntu (using MicroK8s)

See Installation of DevOps Test Hub.

Server Licensing

You can purchase floating licenses for Rational Test Automation Server and install the licenses on IBM Rational License Key Server. The administrator must configure the purchased floating licenses in Rational Test Automation Server.

For more information, see DevOps Test Hub licensing information.

Backup and restore of user data

You can back up and restore the user data in Rational Test Automation Server V10.1.0. You can also migrate the backed-up user data from the previous versions of Rational Test Automation Server to Rational Test Automation Server V10.1.0.

For more information, see Backup and restoration of the DevOps Test Hub data.

Running AFT Suites on remote agents

You can now select an agent added to your project on Rational Test Automation Server to override the agent configured in the AFT XML file in the test asset.

Selecting test resources

You can now select either the current or previous versions of the test resources that you want to run while you are configuring the test run.

Resetting test run configurations

You can now reset the settings you configured for a test run when you are either initiating or repeating the test run. For more information, see Resetting the configuration settings for a test run.

Support for running an HTML test in a Compound Test on Rational Test Automation Server

You can now, run an HTML test as a compound test on Rational Test Automation Server and choose to override the configured browser while configuring the test.

For more information, see Configuring a run of a Compound Test that contains HTML tests.

Navigating from a result to the associated Jaeger trace

Now, test logs are delivered in a Jaeger format by default for executed compound tests and schedules. You can still set a Program Argument to re-enable the traditional test log format when you run the tests.

For more information, see Test results and reports.

Relaunching an execution from the Results view

From the Results view, you can re-execute a test with the same parameters as the ones that you previously set for the previous test run. You can also re-execute multiple tests at a time with the same parameters as the initial ones.

For more information, see Re-executing tests from results.

Controlling Resource Monitoring sources

Now you can use label matching to control what Resource Monitoring sources are collected during the execution of a Performance schedule.

For more information, see Controlling resource monitoring sources in a schedule.

Functional Test reports

A Unified Report is generated as a result of a functional test execution.

For more information, see Test results and reports.

Querying metrics

Now the Resource Monitoring service can query metrics from a target monitored by a running Prometheus server with default or customized queries.

For more information, see Monitoring metrics collected by a Prometheus server.

Scrapping metrics

The Resource Monitoring service can scrap metrics exposed by an OpenMetrics exporter through metric counters.

For more information, see Monitoring metrics exposed by an OpenMetrics exporter.

Selecting branches

In earlier versions, branch selection was configured on the Repositories page and applied globally to all users. Now, each user is presented with a Branch field that lists all the branches of the repositories added to your project. The list is available in the Execution, Datasets and Overview pages Rational Test Automation Server. For more information, see Selecting the global branch in a project.

Creating secret collections

Members with the Tester role assigned in a project, can now create secrets collections.

For more information, see Protecting API test assets by using secrets.

Project repository

You can now add a repository with multiple folders to a single project. With this improvement, each project is now restricted to a single copy of a given repository.

Rational Test Automation Server integration with Azure DevOps integration with Azure DevOps

You can now integrate Rational Test Automation Server with Azure DevOps by using the Rational Test Workbench extension to run tests as tasks in Azure DevOps pipelines.

For more information, see Integration with Azure DevOps.

Rational Test Automation Server integration with IBM UrbanCode Deploy

You can now integrate Rational Test Automation Server with IBM UrbanCode Deploy by using the Rational Test Automation Server UCD plugin to run tests on the UCD server.

For more information, see Integration with IBM DevOps Deploy.

Running stubs

You can now run stubs that you create in Rational Integration Tester, from the Execution page on Rational Test Automation Server. You can run IBM WebSphere® MQ stubs and HTTP stubs on Rational Test Automation Server.

For more information, see Configuring a run of a virtual service.

Running stubs for Istio services

After you create stubs for Istio in Rational Integration Tester that virtualize services in a Kubernetes cluster, you can run those stubs on Rational Test Automation Server. The stubs can virtualize services that use the Istio service mesh for the following types of requests:
  • Requests received by services in the Istio service mesh.
  • Requests sent from namespaces in the Istio service mesh to external services that are not in the Istio service mesh.

Stub usage statistics

After you run stubs on Rational Test Automation Server, you can view the stub usage statistics from the Stub Usage page. For more information, see Viewing usage statistics of virtual services.

Routing rules

You can view the details of the intercepts, proxies, or stubs with routing rules defined that are connected to Rational Test Automation Server, from the Routing Rules page. For more information, see Viewing routing rules of the virtual services.

Using Excel Data Sources

Excel Data Sources defined in Rational Integration Tester projects can now be used as Datasets in your Rational Test Automation Server projects. Note that Excel Data Sources that define a specific worksheet to use are ignored.

Authoring datasets

Now, you can create, edit, or delete a dataset in Rational Test Automation Server. You can also publish the created dataset to Git repository so that other members of the project can use your dataset in their test asset run.

For more information, see Working with Datasets on DevOps Test Hub.