Category

Announcements

Category

Introduction

We work hard to improve the functionality and usability of our autonomous testing platform to support your software quality initiatives. This month we’re thrilled to release a few of your most requested features; Extract Value Step enhancements, Validate Checkbox/Radio button, Failed Test Retries option in Scheduler. Check them out and let us know what you think. 

Extract Value Step Enhancements

What is it?

As part of the extract value step, you now have the ability to extract specific values from an element on the page using the new extract mode field. This allows to extract the entire string, just the numbers, date or use regular expressions.

NOTE:  You also have the flexibility to extract the first, last or all the numbers from the element on the page when using “Number” option.

Why should I care? 

There is no longer a need to add custom code to get the specific value from the element on the page.  For example – You can now use the “Number” option and extract just the price (numeric value) from the text “$1980.45”.

Validate Checkbox/Radio Button

What is it?

You now have a built in step to validate checkbox and radio buttons on the page.

Why should I care? 

You no longer need to add custom code to check whether a checkbox or radio button is checked.

Failed Test Retries Option (Scheduler)

What is it?

This is a follow up to the Failed Test Retry flag which was released earlier to be used as part of the CLI. When a value is set in this field (1-20), a failed test will be executed repeatedly until either the test passes or the max number of retries has been reached (in which case the test will finish execution with a failed status). 


Why should I care?

You now have the ability to use this option via scheduler as well; apart from just the CLI.

Introduction

We work hard to improve the functionality and usability of our autonomous testing platform to support your software quality initiatives. This month we’re thrilled to release a few of your most requested features; Multi Tab Indicator, Advanced Merge, Failed Test Retry Flag and Refresh Option. Check them out and let us know what you think.

Multi Tab Indicator

What is it?

You now have a numeric value that displays in the top right section of each step that executes in multiple tabs.

Why should I care?

There is no longer a need to open a step and look at the screenshots or other related information to know what tab the step ran on. With the tab number indication, the user has more visibility into test runs that involve multiple tabs/windows. Learn More

Advanced Merge

What is it?

When merging changes into a branch, a modal window will now pop up showing different changes that are being merged into the branch. The changes are categorized into Test, Shared Steps and Suites.

At the top level, users will be able to see what changed in each category – how many new items were created, updated, or deleted. Expanding each item, will display more details about individual changes.

Why should I care?

You now have better visibility and confidence before merging branches. All the details that are getting into the branch are clearly detailed in the modal window.

Failed Test Retry Flag

What is it?

When this flag is set, a failed test will be executed repeatedly until either the test passes or the max number of retries has been reached (in which case the test will finish execution with a failed status). This flag is passed in via the CLI by using the below syntax

––retries <max_num_of_retries>

Why should I care?

You now have the ability to re-run failed tests automatically, with the use of this flag. So even if a test fails once or twice because of some unexpected issues, it will automatically run again so that the test passes the next time.  

NOTE: When a test passes after one or more retries, it will be indicated in the UI as shown below

Refresh Option

What is it?

This new option will completely reload the page before proceeding to the next step.

Why should I care?

You no longer have to add custom action to reload the page. Now, there is a one click option to do it.

Additional capital will allow the company to scale operations, headcount and accelerate autonomous testing

San Francisco, June 12, 2019 Testim, a leading provider of AI based software testing, today announced it has closed $10 million in Series B funding to address the global demand for continuous testing allowing development teams to move at the speed of business without compromising software quality. This funding round was led by SignalFire. Meron Capital and existing investors Lightspeed Venture Partners, NHN Ventures and Spider Capital also participated in the round, bringing the total amount of capital Testim has raised to $19.5 million.

Software releases that were once planned on a monthly basis now occur weekly with updates almost every day. According to Gartner, “by 2021, 30 percent of application development organizations will use AI-enabled test automation that supports the different stages of the DevOps life cycle.” 1 The shift to AI-based testing is being driven by the need for continuous and faster development that does not compromise the quality of the delivered software.

“To remain competitive, software teams must move faster than ever,” said Oren Rubin, founder and CEO of Testim. “We are helping them test more with much less effort, reducing their release risk and increasing their velocity to market.”   

Software releases that were once planned on a monthly basis now occur weekly with updates almost every day. Application development organizations are using AI-enabled test automation to streamline the software testing process at each stage of the DevOps lifecycle. The shift to AI-based testing is being driven by the need for continuous and faster development that does not compromise the quality of the delivered software.

Rubin continued, “When Testim was founded, our goal was to enable software teams to author tests 20 times faster than before. No one believed it was possible but by continuously innovating and leveraging new technologies, we met that goal. Now, we have a more ambitious one – to author 150 times faster through autonomous testing.”

Testim’s platform, which uses artificial intelligence to speed up test authoring and dramatically reduce test maintenance, ensures that companies can sustain a fast release cadence with the highest quality software. The new funding will also bring to market Testim’s mobile app test automation platform, which is in early access.

“We invested in Testim early because we recognized its leadership and innovation in the fast-growing test automation space,” said Ilya Kirnos, founding partner and CTO of SignalFire. “We’ve already seen Testim win customers like Autodesk, NetApp, Logmein, Sprinklr and JFrog. With 700 percent market growth in less than two years, Testim is on track to disrupt the $37 billion testing market with its technology innovation.”

Ronit Belson recently joined Testim as its chief operating officer. She brings startup and enterprise experience from the DevOps space, leading companies and teams at Cloudmeter (acquired by Splunk), OpTier (acquired by SAP) and Rollout.io. Belson’s background in scaling high performing teams will support Testim’s plans to grow operations in North America and attract new hires across all departments including engineering, product, sales, marketing and customer success.

Company accomplishments:

  • First to introduce AI-based test authoring for native mobile applications
  • Achieved goal of allowing customers to author 1000 tests in a single month
  • 2019 SD Times 100 ‘Best in Show’ in Software Development for Testing

Customer quotes

JFrog

“As an Agile software development organization, at JFrog, we rely on automated code testing coverage. This allows us fast releases while ensuring our customer experience and software quality,” said Eli Givoni, QA and release manager at Jfrog. “Writing a reliable UI functional test is an art and requires experience. Using Testim, engineers that have never written a single Selenium test can easily create stable quality tests with the right coverage that we need.”

LogMeIn

“We picked what we thought was the most mature product of all those we had evaluated. Testim actually made record and playback work for modern web apps, making it easier for non-technical team members to author tests. It is quite easy to use and straightforward,” said Tamir Daniely, software development engineer in test at LogMeIn.

Figure8

“Testim.io’s mobile product is so intuitive that we’re able to create a good test suite for our Android app that integrates with our CD process using very little effort,” said Rotem Itzhak, head of mobile at Figure8. “Testim is also easy to manage by our QA team, leaving our dev teams more time to add features and change our app at a faster pace.”

To learn more about Testim or to schedule a demo, please visit www.testim.io.

About Testim

Founded in late 2014, Testim helps companies accelerate time-to-market, improve software quality and integrates into agile processes. With offices in San Francisco and Tel Aviv, the company is a pioneer in using AI for the authoring, execution and maintenance of automated tests. Included in the 2019 SD Times 100: ‘Best in Show’ in Software Development for Testing, the Testim platform learns and adapts automated tests to code changes, reducing 90 percent of maintenance time and 70 percent of authoring time. Netapp, Autodesk, Swisscom, Logmein, and others run over 2,000,000 tests using Testim every month.


Introduction

We work hard to improve the functionality and usability of our autonomous testing platform to support your software quality initiatives. This month we’re thrilled to release a few of your most requested features; Email Validation, Advanced Scheduler, For Each Loop. Check them out and let us know what you think.

Email Validation

What is it?

You now have the ability to generate email addresses, send emails and validate the contents of an email within the Testim IDE itself.

Why should I care?

There is no longer a need to use 3rd party email vendors such as Guerilla Mail and Shark Lasers to do email validations. All this is handled within Testim and there is no need for any context switching. The validations can be done within a click of a button as shown below.

Advanced Scheduler

What is it?

You now have the ability to run tests in parallel, add results label, choose branches and set a timeout for a scheduler run with the Advanced Scheduler feature.

Why should I care?

With this new feature, you now have more control over you scheduled runs in terms of making it run faster by adding parallelism, labeling each scheduled run, pick and choose which branch you want to run the tests on and finally setting a timeout value to control when a test needs to be aborted.

For Each Loop

What is it?

You now have the ability to iterate over any list of similar items and perform repeated actions.

Why should I care?

Iterating over rows in a table, clicking on multiple checkboxes in a list of items or validating the order of a list of similar items; just got a lot easier with the for each loop functionality. You simply choose this option and select the element you want to repeatedly click to perform certain validations. It does not matter which element in the list of similar items is selected as the loop always starts from the first element and iterates over its siblings.

Click on this demo test to learn how the For Each Loop functionality works.

Introduction

We work hard to improve the functionality and usability of our autonomous testing platform to support your software quality initiatives. This month we’re thrilled to release a few of your most requested features; Advanced Analytics, Results Export Feature. Check them out and let us know what you think.

Advanced Analytics

What is it?

You will now be able to see an aggregated failure summary report inside a suite runs page. The report will contain a snapshot of the test failures and a pie chart. To help with debugging; clicking any error group or one of the pie chart segments will filter the view to show only the tests that failed on the selected error. This speeds up the troubleshooting of failed tests by pinpointing the root cause of run failures.

Why should I care?

Sometimes, a single problem in one shared step (for example, a “login” group) can cause many tests to fail. With the release of this feature, you will now be able to quickly hone in on those high-impact problems and dramatically reduce the time it takes to stabilize the suite.

 

Results Export Feature

What is it?

You will now see an export button in the results page (suite runs, test runs and single suite view). Clicking this button will download the results data as a CSV file, which can then be imported into excel or Google sheets.

NOTE: Only the data that is currently presented in the UI will be put into the CSV file. For example, if “Last 24 hours” is selected and the status filter is set to “Failed”, the CSV file will only include failed tests from the last 24 hours.

Why should I care?

We now have the ability to easily share the test results across teams with people who use and do not use Testim. This also gives the flexibility to feed the generated CSV file to any external tool or framework for more customized reporting. The possibilities are endless.

Introduction

We work hard to improve the functionality and usability of our autonomous testing platform to support your software quality initiatives. This month we’re thrilled to release a few of your most requested features; Auto Scroll, Scheduler Failure Notifications. Check them out and let us know what you think.

Auto Scroll

What is it?

When an element on the page is moved around, finding the target element may require scrolling even though it wasn’t required when the test was initially recorded. Testim does this automatically with auto scroll.  

NOTE: User also has the option to disable this feature, if required.

Why should I care?

You no longer have to worry about tests failing because of element not visible/found when the element location is changed in the page; thereby needing to scroll.  With auto scroll, you can scroll automatically to the element that is outside the viewport.

Scheduler Failure Notifications

What is it?

Users now have the ability to get email notifications on every failed test that ran on the grid using the scheduler.

Why should I care?

With the new “Send notifications on every failure” feature, users will receive notifications on failures every time a scheduler run fails. Now, you have instant feedback on failed scheduler runs. This is unlike the “Notify on error” option, where uses gets notifications only once; when a scheduler run fails. No new email is sent out until the failed scheduler run is fixed.

 

The Mobile Beta is now closed as of 7/2019

It’s no surprise that mobile is big and only getting bigger. There are currently 8.7 billion mobile connections in the world, more than a billion active devices than there are people. Ensuring seamless user experiences for mobile users requires extensive software testing. However, testing mobile is much easier said than done – until now!

We are thrilled to unveil Testim Mobile.  SIGN UP  to our Mobile Beta program to experience super fast automated test creation and execution with minimal maintenance.

For those who are familiar with Testim, now you get all of the same AI capabilities you are accustomed to in the web version, now available in mobile. With this release, we have become the only fully integrated AI test automation platform that supports Web, Mobile Web and Native applications.

For those who are not familiar with Testim, we help engineering teams of all sizes across the globe improve test coverage, speed up release cycles and reduce risk in their delivery process. Companies like Wix, Globality, Autodesk, Swisscom and LogMeIn use Testim to integrate testing into their evolving Agile software development processes.

Playback Tests on Real Devices or Emulators

To get the true behavior of the application, it is recommended to playback tests on real devices, and not settle for an emulator. The main challenge with real device coverage is the plethora of available devices and configurations, which can include screen resolutions, performance levels, different firmwares from manufacturers, different operating systems and much more.

With Testim, you can directly playback tests on the physical device seamlessly; apart from just using the emulator.

Record actions in real time

When the user performs gestures such as tap, text inputs, scroll etc on the device/emulator, they are recorded in real time in the Testim editor. This allows you to see exactly which actions are being captured.

Get screenshots for each and every step

As we start recording different flows and creating multiple tests, it becomes critical to visually see the UI elements of the app when recording and playing the tests. Testim provides screenshots for each and every step that is recorded. Once the same test is played back, you can see the baseline and the expected image side by side. This way you know exactly what is happening underneath the hood.

Assertions

One of the most important capability of any automation framework is its ability to do assertions, this holds true for mobile as well. With Testim, you can do various validations to ensure the UI elements on the page are displayed as expected.

Feedback on each step

The user also gets feedback on each step in terms of whether the tests Passed or Failed by showing a “Green” or “Red icon” on the top left portion of each step as shown below

Ease of Use

The downfall of most of the automation frameworks is the complexity that goes into setting up the physical device with the framework, recording/playing back tests, maintaining and organizing the tests into meaningful components. With Testim, everything is handled within the the Testim editor just like how it is for users who are accustomed to doing Web and Mobile Web automation using Testim. There is no context switching between different windows, tabs, tools or frameworks. Just pair the device and start recording. It is that simple. We take care of the rest. All the features you have been using such as branching, version control, test suite/plans, test runs works the same in Testim Mobile.

In addition, you can maintain your Web, Mobile Web and Native automation projects all in one place and easily switch between projects and manage your tests.

Robust CLI actions

Users have the ability to create custom Node.js scripts that can be executed in the CLI (Command Line Interface). This will give users the flexibility to not only perform UI level validations on the mobile application but also the opportunity to do more advanced actions such as database validations.

Inserting Custom Code

Custom javascript code can be added to perform addition validations (if needed). We can perform manipulation/validation of parameters.

Control structures built within Testim

Save time by using the while loop to repeat steps. This eliminates the need to duplicate steps or write code to perform certain actions on your mobile application repeatedly. This feature helps to build simple and robust tests.

Multi Application Recording

With Testim Mobile you have the the flexibility to record actions from multiple applications within the same test. This means, you can easily switch between applications during recording and perform end to end testing, without any additional configuration.

 

Upcoming features in future releases

We will be releasing more features for Testim Mobile in the upcoming months. Here is a quick sneak peek into some of them-

Support for advanced gestures

Users will be able to record/playback more gestures on their applications that includes double tap, nested scroll, multi-touch, long press menus and much more.

Pixel level validation

Testim provides a step by step baseline and expected images out of the box, as a basic means of debugging your test runs. In addition, you will also be able to do visual validation. This feature is helpful when you need to ensure the UI of the mobile application is exactly what is supposed to be, across different devices.

Support for multiple IME’s

With multiple IME’s (Input Method Editor) available in the Android ecosystem, it makes sense to give users the flexibility to record/playback tests with the desired IME. We will soon be able to use alternative input methods such as on-screen keyboards, speech input etc, on our devices and record/playback tests with Testim Mobile.

 

Get started with Mobile Native App Automation

Don’t take our word for it, test drive the Mobile Beta and find out first hand for yourself to see how AI driven mobile automation can be super fast, stable, and simple.

It is also worth mentioning that, users who sign up for the program get a personalized on-boarding process from our team, which also includes 24/7 customer support. The best part of all this is, everything is FREE. We are more interested in your feedback and would like to showcase our AI powered mobile automation framework.

So, what are you waiting for? Enroll to our beta program and take your first step towards easy and seamless mobile native app test automation using AI.

The Mobile Beta is now closed as of 07/2019

Testim is #1 in innovation among all other competitors for several years now. This can be seen from the new features we have been releasing constantly to make automation faster, more stable and much more collaborative than ever. In continuation with this, we are excited to bring you our next big feature which we are calling Group Context. Imagine you have one or more components (E.g. gallery of images) within a page or across several pages, and you need to easily state on which component to perform the group of actions. Although this is relatively doable in coding (via the Page Object design pattern), this was extremely hard to implement in codeless tools until now with the release of Group Context. Testim is the only codeless platform that can currently support this action

For those of you not familiar with Testim, let’s start by defining “Context”?

“Context” is key in real life and in coding. You provide the necessary information in order to perform an action. For Example – Say you make a reservation at a restaurant for a party of four people, you would be required to provide a name for the reservation. Here the name is “contextual information” and you making a reservation is the “context”. Similarly, in test automation, it is important to know the context of elements from the DOM level in order to perform an action.

A Context in Test Automation

Context is all the more important when you have reusable components in your automation suite. For Example – let’s take the below web page.

 

It is a simple web page, containing a gallery of items. In this case, it has names of places with description and an option to book them as part of a reservation. In each item in the gallery, you have similar elements such as an image, text, and button, this is because the code for generating those instances is the same. So, on a high level, all these gallery items are exactly the same except for the different data showing up for each element in the gallery item.

Say we create a reusable group to:

  1. Validate whether an image and text is present in the gallery item 1 which is “Madan”
  2. Validate whether there is a “Book” button in the gallery item
  3. Click on the “Book” button
  4. Do some validations in the “Checkout” screen

It would look something like this:

 

Now, what if I want to use group on Item 2 of the gallery which is “Shenji” instead of “Madan” (which was the 1st item) ?

 

Typically, we would have to create another reusable group to make it work for gallery item 2, which is time consuming and does not make sense when the whole gallery shares the same DOM structure.

When using code (e.g. Selenium), you can use the Page Object design pattern, and just pass the context in the constructor, either as a locator or a WebElement (see slides 40 and 41 here).

In codeless/low-code platforms, this wasn’t possible until now with the release of our new feature “Group Context”. Now you can maximize reuse by assigning entire groups to different elements of the page and across pages within a single click. Taking the above example, you would not have to reassign all the elements/properties of steps within the group when you want to perform same set of actions, on another item in the gallery, with the exact same DOM structure. This means, we can use the same group on gallery item 2 which is “Shenji” without having to do any rework by just choosing the Context-> Custom option from the properties panel as shown below

 

Use Cases for Group Context

Group Context can be used in many other scenarios, such as:

  • Repeating elements: when you have similar elements repeating in the page and want to execute the same steps on all of them.
  • Table rows: when you want to execute the same steps on different rows in a table.
  • Tabs or frames: when you want to reuse a group of steps recorded on one tab on other tabs in the same or different page

 

Summary

We constantly keep working hard to improve the functionality and usability of our autonomous testing platform to support your software quality initiatives. We strongly believe this feature will benefit teams and help in making automation much smarter. Group Context is currently in beta and we would love your feedback.

Please use our chat support to give us feedback or e-mail us at product@testim.io. Happy Testing!!!

Introduction

We work hard to improve the functionality and usability of our autonomous testing platform to support your software quality initiatives. With that said, we’re thrilled to release a few of your most requested features; negative validation, extract value, and integration to test management. Check them out and let us know what you think.

Negative Validation

What is it?

Validations are the most important steps we need in our tests. Validations allow us to see if our app does what we expect it to do. Testim provides a wide range of validation options so you can choose the ones that best suit your needs. Now you can choose a negative validation.

  • Element Not Visible – Make sure an element is not visible to the user.

Why should I care?  
Use the element not visible validation to check whether your element does not exist/visible in the page.  Use this validation to make sure an element disappeared from the screen or wasn’t shown in the first place. Learn more

negative validation

Extract Value

What is it?

Extract value lets you copy values directly from your application to be used in later steps. For example, if you have text in your application such as username, name or account number use extract value to validate that it appears on another page. You can also use it to extract a value for future calculation at a later step.

Why should I care?
Now, you can use the new parameter in a validation step, set text, custom steps, etc. So if you want to change the element you selected, now you don’t have to re-record this step. Learn more

extract value

Integrate Test Management

What is it?

Testim can now sync your test results with TestRail so you can get a side by side view of your manual and automated tests.

Why should I care?

If your doing exploratory testing, now you can link your manual and automated tests to your requirements and defects for end to end traceability. Learn more

integrate test management

Customers have access to these features now. Check it out and let us know what you think. If you’re not a customer, sign up for a free trial to experience autonomous testing. We’d love to hear what you think of the new features. Please share your thoughts on Twitter or Facebook.

Tel Aviv—January 17, 2018—Ness, one of Israel’s leading IT services companies and Testim.io, the fastest growing provider of autonomous testing software, are joining forces today to help companies integrate testing into their CI/CD processes to reduce risk, speed up release cycles and ship higher quality software.

Ness has completed thousands of process management, BI & Analytics, software development and testing and QA projects for more than 500 organizations throughout Israel. Testim’s autonomous testing solutions are used by more than 100 global customers to automate UI testing for web and mobile software. Together, Ness and Testim.io offer customers a combined professional services and smart software solution to make software quality an organizational initiatives.

By joining forces, Ness and Testim.io will help customers accelerate their digital transformation journey achieving exceptional quality at reduced cost as well as better organizational collaboration.

“We are constantly looking for ways to help software delivery teams to release faster without compromising on quality,” says Omer Dror, Testing & Validation Business Division Manager for Ness . “Testim’s test stability and smart locations convinced us that together we can help customers gain more test coverage, accelerate their release cycles and improve productivity and time-to-market.”

On February 5, 2018 Ness and Testim invite software delivery professionals to participate in a free 1-Day conference located at Ness Headquarters in Tel Aviv.  

About Ness Technologies
Ness is the leading IT services company in Israel. With more than 65 years of successful management experience, Ness helps its customers with the most complex IT projects. 

About Testim
Testim leverages machine learning for the authoring, execution and maintenance of automated test cases. We use dynamic locators and learn with every execution. The outcome is super fast authoring and stable tests that learn, thus eliminating the need to continually maintain tests with every code change. NetApp, Gett, Wix and others run over 300,000 tests using Testim every month.

Be smart & save time...
Simply automate.

Get Started Free