Releases

2.4.0

24/02/2020

Features & Improvements
  • Now you can send start time and duration of a video to EUS from a QoE test, so EUS can generate and send QoE metrics to visualize in GUI.
  • Now you can pass ElasTest an external ElasticSearch to use it as Monitoring Service instead the default one (mysql/ES).
  • GUI Minor improvements.
Bug Fixes
  • GUI Fix bug when download executions as JSON related to skipped tests suites.
  • EUS .eus files now stores properly in ElasTest Docker.

2.3.0

03/02/2020

Features & Improvements
  • GUI TJob Execution View:
    • A new tab has been added to test cases using browsers, showing files grouped by session.
    • The files view has been improved
    • If there is a QoE execution, the VMAF average is displayed
  • General stability improvements.
Bug Fixes
  • EUS fixed in HEK mode

2.2.0

19/12/2019

Features & Improvements
  • EIM now allows inserting / deleting packet loss in the SuT without cron
  • The names of some demo projects have been changed:
    • EMS Example to Building assertions with monitoring data
    • EDS Example to IoT device emulation
    • QoE to Asserting Quality of Experience in WebRTC
  • ElasTest Jenkins Plugin has been updated to 1.2.0 version, which allows the EOE to insert packetloss/cpu burst through the EIM.
Bug Fixes
  • Problems with Test Engines in EK mode have been fixed

2.1.1

11/12/2019

Bug Fixes
  • Tags of EIM and ECE images has been fixed to specific version
  • Logstash regex for clean log messages has been fixed and improved
Little improvements
  • New demo project added: QoE with AWS

2.1.0

14/11/2019

Features & Improvements
Bug Fixes
  • Fixed a bug in Log Comparator that caused the comparison not to be displayed in the AIO tab (All-In-One).
  • Trim is now used in the Parameter fields, in the creation/edition of TJob/SuT
  • The message "Chrome is being controlled by automated test software" is now also hidden in Chrome browsers from version 75 onwards. This caused problems for Crossbrowser when used together with other browsers.

2.0.1

22/10/2019

Bug Fixes
  • Sut of Fullteaching demo project fixed.
  • Don't show tooltip in GUI menu elements when is expanded.

2.0.0

15/10/2019

Features & Improvements
  • Kubernetes support is here!
  • Great GUI enhancements:
    • The side menu has been collapsed by default so that only the icons are displayed.
    • Great changes in the finished TJob Execution view: Test Results/Test cases are shown in tabs; Global execution data are now colapsed in a Expansion panel; If the execution fails and there are previous successful runs, Log Comparator is shown.
    • Now in the log cards it is shown if there are errors or warnings and it is possible to filter them. Errors and warnings are also coloured.
    • Space between cards and other elements has been reduced.
    • Now you can select several TJobs and delete them all at once in the Project section.
    • The number of TJobs and Suts contained in a project is now shown in the global project table.
    • Now you can resize some cards like Browser card in TestLink Test Plan execution.
    • Now the Sut Id is shown in TJobExecution views and tables
    • Network traces received by Metricbeat can be displayed now.
    • It's possible to collapse the LogAnalyzer menu.
    • Angular has been updated to version 8 and Covalent to 2.1.1.
  • TestLink Improvements:
    • Now you can pause and resume a Test Plan Execution.
    • Test Plans can now be executed with Crossbrowser.
    • External TJob Execs (Test Plan Executions) can now be removed.
    • ElasTest Security Service (ESS) can now be used in Test Plan Execution.
  • New environment variable is available in the TJob: ET_TEST_CONTAINER_NAME.
  • Dockbeat collects now Browser container metrics.
  • On remove TJobExec, TJob or External TJob Exec its folders associated with its content are deleted.
  • The version of the ElasTest Browsers has been updated to 2.1.0.
  • It is now possible to deploy ElasTest browsers in AWS.
  • The download of executions as JSON has been improved: now the logs and metrics of each test case are downloaded, in case of having start / finish traces that limit them
Bug Fixes
  • TestLink:
    • Fixed the bug that, when synchronizing TestLink data, removed start/end date from ExternalTestExecution (Test Plan Execution).
    • Now the browser logs are retrieved again in Test Plans with Suts.
    • Fixed bug that incorrectly established the names of internal Suts containers in ExternalTJobExecutions (Test Plan Execution), which caused the logs not to be saved.
  • GUI:
    • Fixed bug in the section of a specific Project that when duplicating or deleting a TJob did not reload the list and had to re-navigate to see the changes.
    • Fixed a bug with some metricbeat charts, which only added one of the subtypes
    • There was a bug in the Metric Cards that when you remove one of them the one that wasn't was removed.
    • Other little fixes.
  • EUS:
    • Solved concurrency problem on send messages through the same websocket.
    • Fixed bug in which when a request to the browser returned a code other than 200, an exception was launched. This began to give problems with the last versions of chrome (>75) and with Firefox.
    • Fixed a bug that did not intercept elastest scripts (elastestScript) and therefore, Single Browser test videos were not splitting and naming.
  • Now the metric traces sent by each Dockbeat are filtered according to their execution id, since when several executions were launched all the dockbeats sent the metrics of all the executions and the information was multiplied.

1.5.0

29/04/2019

Features & Improvements
  • Added a button to download files from the browser context during a TestLink Test Plan Execution.
  • Now you can select one or more Suts and delete them all at once.
  • It is now possible to activate/deactivate the All-In-One chart from the Monitoring Configuration modal window.
  • Now when configuring in a Jenkins job the maximum number of builds to keep, this number will be synchronized with the maximum number of executions in ElasTest.
Bug Fixes
  • Now, in ElasTest Jenkins Plugin, the log traces are sent to ElasTest with the timestamp, thus solving the problem of incorrect dates.
  • Fixed a bug on the page of a TestLink Test Case Execution that brokes the GUI.
  • Now when a test suite has all its tests skipped, the suite is also shown as skipped and not as success.
  • Fixed a bug in the modal window of an execution of a TJob with parameters that, when removing all parameters, the button to add more parameters disappeared.
  • Fixed a bug in singlenode mode: The Delete red indices button was always disabled and could not be pressed even if there were red indices.

1.4.1

09/04/2019

Bug Fixes
  • Fixed a bug in Log Comparator.
  • Fixed a bug in ElasTest mini that, when running a TJob with EUS and another TSS did not connect to the correct url of the EUS WebSocket.
  • Fixed a bug that didn't start the correct Jenkins version by starting it with the -jk command.

1.4.0

08/04/2019

Features & Improvements
  • Browsers started by a TJob run now have a fixed name, allowing you to compare browser logs between different executions.
  • It is now possible to upload files to a browser and also download them.
  • A button has been added to upload files to the browser context on the TestLink Test Plan execution page.
  • It is possible to attach evidence files to the executions by means of an api that the TJob receives in an environment variable (ET_ETM_TJOB_ATTACHMENT_API).
  • The View in loganalyzer button has been added to the section of a specific Test Case.
Bug Fixes
  • Fixed a bug in Log Comparator that failed to get start/finish traces when testName had special characters or reserved for regex (:[]$...).
  • Browser logs that contain line breaks are now split and combined with the line break character, since it used to give an exception and were not being saved.
  • Definitively fixed LogAnalyzer date bug with Test Cases.
  • If there is a connection problem on get browser images from Docker Hub, the cached images are used.

1.3.1

28/03/2019

Features & Improvements
  • Usability and performance enhancements in TJob Execution page and in the Test Case Execution page of a TJob Execution.
Bug Fixes
  • Fixed the bug where videos were not played when they contained special characters in their name.
  • Fixed some bugs in LogAnalyzer

1.3.0

20/03/2019

Features & Improvements
  • The maximum number of executions can now be configured in the TJobs.
  • Usability and performance enhancements:
    • In the Projects section, only the id and name of the projects are brought from the backend instead of bringing all their data.
    • In the section of a specific Project, up to four times the complete object was being requested from the backend. Now only what is necessary is requested.
    • Dashboard section:
      • The Show All button has been replaced by Show 12 more.
      • The spinner is not shown when new information is obtained.
      • Now the executions loaded at the beginning are not reloaded again.
    • Now in the section of a specific TJob the executions are paginated.
  • A new section has been added: Manage Elastest. Here you can view the status, the general info and the logs of the containers of the core components of ElasTest, as well as the version that is being used. In singlenode mode you can also manage Elasticsearch indices
  • For Sut with external Elasticsearch, the user is now allowed to indicate a list of fields with a list of values by which to filter to save the traces.
  • Monitoring traces are now removed when deleting a TJobExecution, TJob, Sut, SutExecution or Project (the entire index in Elasticsearch for singlenode mode OR the data in Mysql for mini mode)
  • Elasticsearch has been updated to version 6.6.1 (for singlenode mode)
  • Now a message is displayed while logs are loaded in LogAnalyzer
  • Stop Session button added to WebBrowsers for live sessions.
  • For testing with Web Browsers from outside ElasTest it is now possible to set a timeout to end the session automatically if you do not interact with the browser through selenium after the set time. To do this, it is necessary to make use of the custom capability elastestTimeout.
  • For Jenkins TJobs the Jenkins icon is now shown instead of the edit pencil.
Bug Fixes
  • Fixed the bug that when running several TJob Execs that use EUS showed all sessions within an execution, instead of only showing the corresponding ones.
  • Some minor bugs have been fixed in LogAnalyzer. Among them it's worth mentioning that it didn't show the full height of a trace that contained line breaks.

1.2.0

07/03/2019

Features & Improvements
  • Log Comparator:
    • Now you can set the timeout to calculate the diff. Default: 0 (infinite)
    • The line numbering for the Tests Logs mode starts at 1 for each test case and the line number is not shown in the name of the test case.
    • Now the Complete mode shows the complete message as it is saved (sometimes it has timestamp and sometimes not) and the Non-timestamp mode removes it from messages that contain it.
  • TestLink:
    • Added a button to the main table that removes all synchronized data from elastest and resynchronizes it.
    • TestLink now allows you to select a platform when running a Test Plan.
    • General improvements in stability and styles.
Bug Fixes
  • TestLink:
    • Test cases are now executed sorted by id during execution and not randomly.
    • Fixed the bug that, if a test case was associated with more than one test plan, only appeared in the Test Plan to which it had been associated recently.
    • Now the url of an external sut opens automatically in the browser during execution.

1.1.0

01/03/2019

Features & Improvements
  • Log Comparator added in TJob Executions comparator.
  • Projects/tJobs/Suts/Execs tables can now be sorted by columns.
  • We have incorporated a new code editor in the TJob and Sut edition for the commands field, instead of using textarea.
  • Now all modal windows are draggable.
  • TJobExec Test Case tabs have now lazy load.
  • Now you can pass a list of hosts to TestLink browsers to put them in their /etc/hosts.
  • Improvements in Sut with external Elasticsearch.
Bug Fixes

1.0.1

19/02/2019

Features & Improvements
Bug Fixes
  • The Test Case Steps are now shown again during the execution of the TestLink test plan .
  • Fixed problem with browser in TestLinkthat after some time deleted the session automatically.
  • Solved problem with TestLink plan execution that when stopping a execution manually the correct message was not shown because it failed when parsing the DELETE response.
  • Fixed bug with LogAnalyzer that when pressing the button Reload Log did not show the content.

1.0.0

13/02/2019

Features & Improvements
  • Now when you run a TestLink test plan from ElasTest, you can select the browser and the desired version.
  • Added "View in log analyzer" button on TestLink test plan execution page.
  • Metrics can now also be compared in the TJob Executions comparator.
  • A button has been added to the log cards to download them as a .log file.
  • Now you can select one or more Projects and delete them all at once. You can also do the same with the TJob Executions, inside the tJob page.
  • Now the search of logs and metrics of an execution is done with start/end date range, which corrects the timeout problem when requesting them.
  • Added the log-level option to the ElasTest Platform, so that the user can set the log level of the ETM.
  • EMS Example and EDS Example demo projects added.
  • Updated the integrated Jenkins with the latest version of the ElasTest plugin.
Bug Fixes
  • Fixed bug in mini that did not check the correct port of the TSS.
  • Now EUS does not launch an exception when starting a browser if the maximize command fails.
  • Fixed a bug in the finished TJob Execution page that when clicking in the trash and giving to cancel, the button remained disabled

1.0.0-beta7

31/01/2019

Features & Improvements
  • ElasTest modes have changed: Now there are two: mini and singlenode. Cluster mode coming soon.
  • Upgrade ElasTest GUI to Angular 7
  • Autorefresh has been added for the TJob Execution tables in the GUI Dashboard.
  • Test Support Services section has been removed from all ElasTest modes.
  • Now in singlenode an instance of EUS is started when starting ElasTest and will be used for all executions. This reduces the execution time of TJobs, as they do not have to start an EUS instance, and also the consumption of resources.
  • The WebBrowsers section is now also shown in singlenode, since it has an instance of EUS since the beginning.
  • Changes in the way to instrumentalize an external sut through EIM: Now the Sut is instrumented only during the execution of a TJob.
  • Now you can select several TJob runs and compare their test results.
  • ElasTest Jenkins Plugin 1.0.0-beta8 released.
Bug Fixes
  • Solved problem when running several Jobs in a Jenkins with slaves that make use of the ElasTest Jenkins Plugin at the same time.
  • Fixed bug in mini that did not send the Endpoint environment vars of a TSS to the TJob, necessary for its use.
  • Fixed bug in LogAnalyzer who didn't check well if TestLink was started and never showed TestLink's projects.

1.0.0-beta6

23/01/2019

Features & Improvements
  • QUEUED status has been added for TJob executions that are queued when there are more than 4 simultaneous executions.
  • The --logs option of ElasTest Platform has been removed. The starting logs of ElasTest containers will now be automatically displayed in the logs of the ElasTest Platform container. This also solves container freezing problems.
  • General improvements in the stability of ElasTest
Bug Fixes
  • Fixed bug with Logstash in experimental mode that didn't process WebRTC traces correctly.
  • Fixed bug by running several TJobs with browsers that made them fail.

1.0.0-beta5

20/12/2018

Features & Improvements
  • Now you can configure a Sut with parameters in ElasTest Jenkins Plugin.
  • Now when you specify the use of a Sut with external Elasticsearch, you can also set the path in which the service is located, if necessary.
  • A new environment variable has been added to the TJob execution containers: ET_NETWORK.
  • Containers now contain labels with information to be used by ElasTest.
Bug Fixes

1.0.0-beta4

03/12/2018

Features & Improvements
Bug Fixes

1.0.0-beta3

31/10/2018

Features & Improvements
Bug Fixes

1.0.0-beta2

04/10/2018

Improvements
  • Now you can configure the ElasTest data folder at startup. If the folder is changed in future startups, the contents of the config folder must be copied if TL was reached at any time.
  • TestLink and Jenkins credentials. The credentials will be the same credentials as those introduced for ElasTest. If it has not been entered, they will be created.
  • Manually started browsers can now be opened in a new tab.
  • Now it shows where the logs and metrics of a TJobExec are stored (MYSQL if it is mini or ELASTICSEARCH if it is experimental)
  • Now the volumes created by the execution of a TJob are removed at the end of this.
  • Error message on start ElasTest if main container (ETM) is exited. An error file is also generated in case the user wants to send it to the ElasTest team.
  • The time conversion of the monitoring traces is now more efficient. It is calculated once per host name and only transforms if necessary.
  • Now the connections to the WebSockets are reconnected automatically if the connection is lost.
Bug Fixes
  • Automatic navigation to the results page when the execution of the test finishes.
  • Problem with duplicate logs fixed.
  • Automatic subscription to the Sut logs of a Jenkins execution.
  • The problem with the generation of the Jenkins url when starting from the platform in experimental mode and as a server has been solved.
  • Bug with the Nginx proxy image fixed. It did not receive the SIGTERM signal and ElasTest Platform took a long time to stop (until it gave a waiting time of 90 and stopped the proxy to force)
  • Startup problems in Windows and MacOS has been solved. Now the volumes /etc/localtime and /etc/timezone are no longer binded to the elastest/etm container; instead ElasTest Platform is that requests it via HTTP and sends it as a parameter to the ETM.
  • Both Jenkins and the ElasTest plugin are now correctly configured when Jenkins starts from the Platform.
  • Problem with splitted log traces and without date has been fixed.

1.0.0-beta1

12/09/2018

  • Improvement in requirements. We've been working on the high memory consumption requirements of previous versions, and this new version can be deployed on machines with 8Gb of RAM starting ElasTest in default mode

  • GUI improvements. Among other small improvements, it should be noted that more information is now shown to the user, such as the percentage of downloading a docker image, either from a tjob, a sut or a browser.

  • Improvements in Jenkins plugin. It is no longer necessary for the user to start dockbeat and filebeat to send logs and metrics to ElasTest, the plugin is responsible for it now.

  • Jenkins instance provided by ElasTest. You can use now a Jenkins instance provided by ElasTest, can be started on load ElasTest or later manually from the ElasTest GUI.

  • Improvements in TestLink integration. It is possible to configure a Sut so that ElasTest starts it every time a Test Plan is executed

  • Improvements in log analysis.

  • Bug fixes.

0.9.1

09/05/2018

  • Jenkins integration. You don’t need to abandon your CI tools. Use ElasTest straight from your Jenkins jobs (Freestyle or Pipeline). For instance, if you’re using Pipeline jobs, just wrap up your Pipeline in an elastest step, and you’ll be ready to use all the fancy features we bring to testers and developers, like managed browsers! See our advanced example for a more complex scenario.

  • TestLink integration. TestLink is the most widely used web-based test management tool and ElasTest provides integration with TestLink. With this integration now you can easily record videos and gather logs and metrics when manually running your tests.

  • New Docker images for browsers. We have been developing a new set of browser Docker images that brings the benefits of both Selenoid and Selenium docker images. These images are ready for some awesome features we will be developing in the following months, like changing browser resolution to adapt better to the desktop of our users.

  • Browser recordings can now be opened as a new tab or on a floating dialog.

  • Our powerful Log Analyzer now remembers previous configurations.

  • Generate your SuT on the fly with Commands Containers: a new Docker image can be generated on the fly, and this image will be run as the SuT.

  • ElasTest Command line options documented in its own subsection within the installation page.

  • Changes in environment variables: the ElasTest endpoint for sending metrics from an external SuT has changed, and the ET_MON_LSHTTP_API environment variable is now available also for Test Support Services.

  • There are new environment variables available: ET_SUT_CONTAINER_NAME, ET_MON_INTERNAL_LSBEATS_PORT and ET_SUT_LOG_TAG. Those allows ElasTest to do a better job when identifying what’s coming from which SuT.

  • We have changed the name of the status for a TJob that has been stopped manually to STOPPED.