Category

Announcements

Category

Introduction

We work hard to improve the functionality and usability of our autonomous testing platform to support your software quality initiatives. This month we’re thrilled to release a few of your most requested features; Advanced Analytics, Results Export Feature. Check them out and let us know what you think.

Advanced Analytics

What is it?

You will now be able to see an aggregated failure summary report inside a suite runs page. The report will contain a snapshot of the test failures and a pie chart. To help with debugging; clicking any error group or one of the pie chart segments will filter the view to show only the tests that failed on the selected error. This speeds up the troubleshooting of failed tests by pinpointing the root cause of run failures.

Why should I care?

Sometimes, a single problem in one shared step (for example, a “login” group) can cause many tests to fail. With the release of this feature, you will now be able to quickly hone in on those high-impact problems and dramatically reduce the time it takes to stabilize the suite.

 

Results Export Feature

What is it?

You will now see an export button in the results page (suite runs, test runs and single suite view). Clicking this button will download the results data as a CSV file, which can then be imported into excel or Google sheets.

NOTE: Only the data that is currently presented in the UI will be put into the CSV file. For example, if “Last 24 hours” is selected and the status filter is set to “Failed”, the CSV file will only include failed tests from the last 24 hours.

Why should I care?

We now have the ability to easily share the test results across teams with people who use and do not use Testim. This also gives the flexibility to feed the generated CSV file to any external tool or framework for more customized reporting. The possibilities are endless.

Introduction

We work hard to improve the functionality and usability of our autonomous testing platform to support your software quality initiatives. This month we’re thrilled to release a few of your most requested features; Auto Scroll, Scheduler Failure Notifications. Check them out and let us know what you think.

Auto Scroll

What is it?

When an element on the page is moved around, finding the target element may require scrolling even though it wasn’t required when the test was initially recorded. Testim does this automatically with auto scroll.  

NOTE: User also has the option to disable this feature, if required.

Why should I care?

You no longer have to worry about tests failing because of element not visible/found when the element location is changed in the page; thereby needing to scroll.  With auto scroll, you can scroll automatically to the element that is outside the viewport.

Scheduler Failure Notifications

What is it?

Users now have the ability to get email notifications on every failed test that ran on the grid using the scheduler.

Why should I care?

With the new “Send notifications on every failure” feature, users will receive notifications on failures every time a scheduler run fails. Now, you have instant feedback on failed scheduler runs. This is unlike the “Notify on error” option, where uses gets notifications only once; when a scheduler run fails. No new email is sent out until the failed scheduler run is fixed.

 

It’s no surprise that mobile is big and only getting bigger. There are currently 8.7 billion mobile connections in the world, more than a billion active devices than there are people. Ensuring seamless user experiences for mobile users requires extensive software testing. However, testing mobile is much easier said than done – until now!

We are thrilled to unveil Testim Mobile.  SIGN UP  to our Mobile Beta program to experience super fast automated test creation and execution with minimal maintenance.

For those who are familiar with Testim, now you get all of the same AI capabilities you are accustomed to in the web version, now available in mobile. With this release, we have become the only fully integrated AI test automation platform that supports Web, Mobile Web and Native applications.

For those who are not familiar with Testim, we help engineering teams of all sizes across the globe improve test coverage, speed up release cycles and reduce risk in their delivery process. Companies like Wix, Globality, Autodesk, Swisscom and LogMeIn use Testim to integrate testing into their evolving Agile software development processes.

Playback Tests on Real Devices or Emulators

To get the true behavior of the application, it is recommended to playback tests on real devices, and not settle for an emulator. The main challenge with real device coverage is the plethora of available devices and configurations, which can include screen resolutions, performance levels, different firmwares from manufacturers, different operating systems and much more.

With Testim, you can directly playback tests on the physical device seamlessly; apart from just using the emulator.

Record actions in real time

When the user performs gestures such as tap, text inputs, scroll etc on the device/emulator, they are recorded in real time in the Testim editor. This allows you to see exactly which actions are being captured.

Get screenshots for each and every step

As we start recording different flows and creating multiple tests, it becomes critical to visually see the UI elements of the app when recording and playing the tests. Testim provides screenshots for each and every step that is recorded. Once the same test is played back, you can see the baseline and the expected image side by side. This way you know exactly what is happening underneath the hood.

Assertions

One of the most important capability of any automation framework is its ability to do assertions, this holds true for mobile as well. With Testim, you can do various validations to ensure the UI elements on the page are displayed as expected.

Feedback on each step

The user also gets feedback on each step in terms of whether the tests Passed or Failed by showing a “Green” or “Red icon” on the top left portion of each step as shown below

Ease of Use

The downfall of most of the automation frameworks is the complexity that goes into setting up the physical device with the framework, recording/playing back tests, maintaining and organizing the tests into meaningful components. With Testim, everything is handled within the the Testim editor just like how it is for users who are accustomed to doing Web and Mobile Web automation using Testim. There is no context switching between different windows, tabs, tools or frameworks. Just pair the device and start recording. It is that simple. We take care of the rest. All the features you have been using such as branching, version control, test suite/plans, test runs works the same in Testim Mobile.

In addition, you can maintain your Web, Mobile Web and Native automation projects all in one place and easily switch between projects and manage your tests.

Robust CLI actions

Users have the ability to create custom Node.js scripts that can be executed in the CLI (Command Line Interface). This will give users the flexibility to not only perform UI level validations on the mobile application but also the opportunity to do more advanced actions such as database validations.

Inserting Custom Code

Custom javascript code can be added to perform addition validations (if needed). We can perform manipulation/validation of parameters.

Control structures built within Testim

Save time by using the while loop to repeat steps. This eliminates the need to duplicate steps or write code to perform certain actions on your mobile application repeatedly. This feature helps to build simple and robust tests.

Multi Application Recording

With Testim Mobile you have the the flexibility to record actions from multiple applications within the same test. This means, you can easily switch between applications during recording and perform end to end testing, without any additional configuration.

 

Upcoming features in future releases

We will be releasing more features for Testim Mobile in the upcoming months. Here is a quick sneak peek into some of them-

Support for advanced gestures

Users will be able to record/playback more gestures on their applications that includes double tap, nested scroll, multi-touch, long press menus and much more.

Pixel level validation

Testim provides a step by step baseline and expected images out of the box, as a basic means of debugging your test runs. In addition, you will also be able to do visual validation. This feature is helpful when you need to ensure the UI of the mobile application is exactly what is supposed to be, across different devices.

Support for multiple IME’s

With multiple IME’s (Input Method Editor) available in the Android ecosystem, it makes sense to give users the flexibility to record/playback tests with the desired IME. We will soon be able to use alternative input methods such as on-screen keyboards, speech input etc, on our devices and record/playback tests with Testim Mobile.

 

Get started with Mobile Native App Automation

Don’t take our word for it, test drive the Mobile Beta and find out first hand for yourself to see how AI driven mobile automation can be super fast, stable, and simple.

It is also worth mentioning that, users who sign up for the program get a personalized on-boarding process from our team, which also includes 24/7 customer support. The best part of all this is, everything is FREE. We are more interested in your feedback and would like to showcase our AI powered mobile automation framework.

So, what are you waiting for? Enroll to our beta program and take your first step towards easy and seamless mobile native app test automation using AI.

Testim is #1 in innovation among all other competitors for several years now. This can be seen from the new features we have been releasing constantly to make automation faster, more stable and much more collaborative than ever. In continuation with this, we are excited to bring you our next big feature which we are calling Group Context. Imagine you have one or more components (E.g. gallery of images) within a page or across several pages, and you need to easily state on which component to perform the group of actions. Although this is relatively doable in coding (via the Page Object design pattern), this was extremely hard to implement in codeless tools until now with the release of Group Context. Testim is the only codeless platform that can currently support this action

For those of you not familiar with Testim, let’s start by defining “Context”?

“Context” is key in real life and in coding. You provide the necessary information in order to perform an action. For Example – Say you make a reservation at a restaurant for a party of four people, you would be required to provide a name for the reservation. Here the name is “contextual information” and you making a reservation is the “context”. Similarly, in test automation, it is important to know the context of elements from the DOM level in order to perform an action.

A Context in Test Automation

Context is all the more important when you have reusable components in your automation suite. For Example – let’s take the below web page.

 

It is a simple web page, containing a gallery of items. In this case, it has names of places with description and an option to book them as part of a reservation. In each item in the gallery, you have similar elements such as an image, text, and button, this is because the code for generating those instances is the same. So, on a high level, all these gallery items are exactly the same except for the different data showing up for each element in the gallery item.

Say we create a reusable group to:

  1. Validate whether an image and text is present in the gallery item 1 which is “Madan”
  2. Validate whether there is a “Book” button in the gallery item
  3. Click on the “Book” button
  4. Do some validations in the “Checkout” screen

It would look something like this:

 

Now, what if I want to use group on Item 2 of the gallery which is “Shenji” instead of “Madan” (which was the 1st item) ?

 

Typically, we would have to create another reusable group to make it work for gallery item 2, which is time consuming and does not make sense when the whole gallery shares the same DOM structure.

When using code (e.g. Selenium), you can use the Page Object design pattern, and just pass the context in the constructor, either as a locator or a WebElement (see slides 40 and 41 here).

In codeless/low-code platforms, this wasn’t possible until now with the release of our new feature “Group Context”. Now you can maximize reuse by assigning entire groups to different elements of the page and across pages within a single click. Taking the above example, you would not have to reassign all the elements/properties of steps within the group when you want to perform same set of actions, on another item in the gallery, with the exact same DOM structure. This means, we can use the same group on gallery item 2 which is “Shenji” without having to do any rework by just choosing the Context-> Custom option from the properties panel as shown below

 

Use Cases for Group Context

Group Context can be used in many other scenarios, such as:

  • Repeating elements: when you have similar elements repeating in the page and want to execute the same steps on all of them.
  • Table rows: when you want to execute the same steps on different rows in a table.
  • Tabs or frames: when you want to reuse a group of steps recorded on one tab on other tabs in the same or different page

 

Summary

We constantly keep working hard to improve the functionality and usability of our autonomous testing platform to support your software quality initiatives. We strongly believe this feature will benefit teams and help in making automation much smarter. Group Context is currently in beta and we would love your feedback.

Please use our chat support to give us feedback or e-mail us at product@testim.io. Happy Testing!!!

Introduction

We work hard to improve the functionality and usability of our autonomous testing platform to support your software quality initiatives. With that said, we’re thrilled to release a few of your most requested features; negative validation, extract value, and integration to test management. Check them out and let us know what you think.

Negative Validation

What is it?

Validations are the most important steps we need in our tests. Validations allow us to see if our app does what we expect it to do. Testim provides a wide range of validation options so you can choose the ones that best suit your needs. Now you can choose a negative validation.

  • Element Not Visible – Make sure an element is not visible to the user.

Why should I care?  
Use the element not visible validation to check whether your element does not exist/visible in the page.  Use this validation to make sure an element disappeared from the screen or wasn’t shown in the first place. Learn more

negative validation

Extract Value

What is it?

Extract value lets you copy values directly from your application to be used in later steps. For example, if you have text in your application such as username, name or account number use extract value to validate that it appears on another page. You can also use it to extract a value for future calculation at a later step.

Why should I care?
Now, you can use the new parameter in a validation step, set text, custom steps, etc. So if you want to change the element you selected, now you don’t have to re-record this step. Learn more

extract value

Integrate Test Management

What is it?

Testim can now sync your test results with TestRail so you can get a side by side view of your manual and automated tests.

Why should I care?

If your doing exploratory testing, now you can link your manual and automated tests to your requirements and defects for end to end traceability. Learn more

integrate test management

Customers have access to these features now. Check it out and let us know what you think. If you’re not a customer, sign up for a free trial to experience autonomous testing. We’d love to hear what you think of the new features. Please share your thoughts on Twitter or Facebook.

Tel Aviv—January 17, 2018—Ness, one of Israel’s leading IT services companies and Testim.io, the fastest growing provider of autonomous testing software, are joining forces today to help companies integrate testing into their CI/CD processes to reduce risk, speed up release cycles and ship higher quality software.

Ness has completed thousands of process management, BI & Analytics, software development and testing and QA projects for more than 500 organizations throughout Israel. Testim’s autonomous testing solutions are used by more than 100 global customers to automate UI testing for web and mobile software. Together, Ness and Testim.io offer customers a combined professional services and smart software solution to make software quality an organizational initiatives.

By joining forces, Ness and Testim.io will help customers accelerate their digital transformation journey achieving exceptional quality at reduced cost as well as better organizational collaboration.

“We are constantly looking for ways to help software delivery teams to release faster without compromising on quality,” says Omer Dror, Testing & Validation Business Division Manager for Ness . “Testim’s test stability and smart locations convinced us that together we can help customers gain more test coverage, accelerate their release cycles and improve productivity and time-to-market.”

On February 5, 2018 Ness and Testim invite software delivery professionals to participate in a free 1-Day conference located at Ness Headquarters in Tel Aviv.  

About Ness Technologies
Ness is the leading IT services company in Israel. With more than 65 years of successful management experience, Ness helps its customers with the most complex IT projects. 

About Testim
Testim leverages machine learning for the authoring, execution and maintenance of automated test cases. We use dynamic locators and learn with every execution. The outcome is super fast authoring and stable tests that learn, thus eliminating the need to continually maintain tests with every code change. NetApp, Gett, Wix and others run over 300,000 tests using Testim every month.

We’re excited to announce that Testim has raised $5.6M in Series A funding, led by Lightspeed Venture Partners. In the last year, we’ve raised a total of $8 million from early investors including Foundation Capital, Spider Capital and joined Heavybit.

This is a big deal for us and we’re incredibly thrilled by what it means. The funds will support our mission to help your engineering team make application testing autonomous and integrative to their agile development cycle. We started this company because we’ve used plenty of automation tools and found them hard to use with little confidence in the stability of the tests. I’m sure you’ve had similar experiences. Together, we’ve built a family of customers including Wix.com, NetApp and Walmart, grown our team to 20+ employees, and become the fastest growing provider of autonomous testing with a 34% compound monthly growth rate.

This funding is the fuel we need to continue investing in our customer’s success by growing our engineering team, expanding our customer success team and supporting your evolving processes. In the last 4 months we’ve added tons of enhancements to help teams automate their testing even faster.

In the next year, and with your ongoing input, we’re excited to tackle:

  • Make testing mobile native applications a breeze
  • Add more self-learning capabilities to our algorithms, making our tests even more stable
  • Integrate Testim.io with more development tools (well, we already support Slack, Jira, Git, CI tools and other software development tools)

We’d love to hear what you think of our product.  Test drive Testim today by signing up for a free trial to experience code and maintenance free test automation.

Introduction

We work hard to improve the functionality and usability of our platform, constantly adding new features. Our sprints are weekly with minor updates being released sometimes every day, so a lot is added over the course of a month. We share updates by email and social media but wanted to provide a monthly recap of the month’s latests enhancements, summarizing the big and small things we delivered to improve your success with the Testim. We’d love to hear your feedback.

Customers have access to these feature now, check it out and let us know what you think. If you’re not a customer, sign up for a free trial to experience autonomous testing. If your an existing user, please send us your feedback.

GitHub

Using GitHub? Then checkout these two new advancements we’ve made to the integration.

What is it?

  1. Align your tests for your branches automatically. Testim now supports webhooks: Your tests will automatically be forked with every new branch.
  2. Easily report bugs in Git Issues straight from your browser. All the relevant bug info will automatically be populated in Testim – learn more about bug capture.

testim integration github

Why should I care?
Merging branches in GitHub? Testim will automatically merge tests in Testim so you don’t have to do that manually. Isn’t that what test automation is all about, more automation? Learn more about branches.

In order to integrate testing into your development cycle, it’s important to integrate your test automation platform to your source control. This allows you to align your tests to branches so that you can test different versions of code simultaneously or in different sequences.

UI/UX Facelift

What is it?

As we strive to improve your user experience we try to make everything more convenient by reducing the number of clicks it takes to perform common actions.  Some of these include:

  1. Edit the steps’ properties
  2. View steps’ screenshot
  3. Delete step

Why should I care?

The new UI allows you to do all of this in a single click, just hover and click the appropriate button.

We made the steps bigger so the thumbnails could contain more information. This way you don’t have to open the screenshot to understand the context. The steps description length is also longer.

We tried to remove the clutter and hide uncommon actions (e.g. override timeout) to have a cleaner UI. But don’t worry, none of the actions are gone.

testim.io new UI

  1. Shows and editor with a few steps (e.g. this one)
  2. Hover the 2nd “book” step, and click delete 3 times
  3. Click on the properties button on the step that is now beneath the mouse
  4. Click on the fullscreen button on the step that is now beneath the mouse (don’t show the spinner)

And one more thing… It’s much prettier! We’d love to hear what you think of the new UI. Please share your thoughts on Twitter or Facebook.

Introduction
We work hard to improve the functionality and usability of our platform, constantly adding new features. Our sprints are weekly with minor updates being released sometimes every day, so a lot is added over the course of a month. We share updates by email and social media but wanted to provide a recap of the latest enhancements, summarizing the big and small things we delivered to improve your success with the product. We’d love to hear your feedback.

Test History

Is past performance an indicator of future success? The folks on Wall Street don’t think so… But we do! This is why we are pleased to offer the new Test History feature in Testim.  


The new Test History feature allows users to see slide and dice test results to get more actionable insights.

Why should I care?
This gives users much more insight from the test results. Quickly analyze how many tests ran during the selected time frame, how many succeeded and the average duration of each run, how your tests performs across multiple environments and whether certain environments or scenarios consistently fail. This allows project team to see improvement trends across scenarios or environments over time. Click here to learn more.

What’s included?
Test History allows you to filter based on the following parameters:

  • Run time
  • Specific tests / All tests
  • Last X runs
  • Status
  • Browser

Create Dependencies Between Tests
This new capability allows users to create different aspects of dependencies between tests. As a best practice, we recommend to keep the tests as isolated as possible. However we recognize that sometimes you need the ability to create dependencies between tests.

Why should I care?
Now users can create a logical sequence of tests. By working closely with our customers, we’ve seen project teams required to set a sequence of activities. A general testing framework does not allow you to create a sequence, forcing users to create one long test which may result in performance issues and failures. By creating dependencies during test plans you can create shorter discrete actions, order them in sequence and set dependencies and share data between tests. Click here to learn more.

Setting up Cookies
Cookies is a reserved parameter name for specifying a set of cookies you would like Testim to set for your application.  You can set cookies for each browser session before the test is started or before the page is even loaded. Use cookies to set browser data to be available for your tests. The cookies parameter is set as an array, where each cookie object needs to contain a name and value properties.

Why should I care?
Websites use cookies to personalize user experience. By using this feature, you can test different types of personalized experiences. Click here to learn more.

Improved Scrolling
More flexible way of scrolling through your page.

Why should I care?
Traditionally scrolling in your test automation would be set by pixels so you would test your script to skip 60 pixels. Offering a more flexible scrolling ability makes your tests more adaptive. An  example is to scroll to the element, mouse wheel. Click here to learn more.

How do I get my hands on these hot new features?
Customers have access to these feature now, check it out and let us know what you think. If you’re not a customer, test drive the new features by signing up for a free trial to experience code and maintenance free test automation.

Testing is one of the key processes in software development. As the requirements to support multiple browsers and devices increases, it is driving the demand to automate the functional testing of applications. While teams embark on their DevOps transformational journeys, the handoffs between traditional application lifecycle silos begin to dismantle, enabling a continuous process of updating their applications.

The key challenges for software teams in DevOps include:

  • how to achieve maximum coverage testing with shorter time frames?
  • how to figure out what to automate vs. leave manual?
  • how to transform from testing and validation before go live to more predictive forms of testing and real-time quality monitoring?

With the increased adoption of agile methodologies, test automation is a key piece of continuous testing. According to the 2015-2016 World Quality Report, research show that the average percentage of test case automation has increased from 28% to 45%. An enabler of this trend has been the advancements in development and testing tools which have helped organizations build a solid infrastructure for automation.

Testim’s stable, self-healing, end-to-end test automation solution is recognized by Software Testing Help as a Top 20 Best Tool to help developers and/or testers create their test suites without any coding, script management or maintenance of the tests. Using machine learning, Testim provides the maximum coverage with the fewest amount of test scenarios allowing teams to optimize their test suite. This also eliminates the need of trying to figure out what to automate vs. leave manual since tests are automatically created as the user uses the application. Additionally, Testim helps teams transform from testing and validation by leveraging historical data to prioritize tests.

“We are humbled by making this list,” says Oren Rubin, CEO for Testim. “This is a testament to our commitment to helping project teams eliminate the complexity of building their test automation suite.”

About SoftwaretestingHelp.com
STH is one of the most popular blogs focusing on Software Testing and Quality Assurance topics. This blog is growing up so fast and currently, we have around thousands of testing professionals who visit every day and gain help from this blog. The topics which we cover on this blog include – software testing tutorials, methodologies, manual testing, automation testing, testing tools, interview questions, web testing, testing templates, quality assurance, testing certifications, books, career guidance, job openings, latest testing trends, news, and much more that cannot be listed here on a single page.

About Testim.io
Testim.io leverages machine learning for the authoring, execution and maintenance of automated test cases. We use dynamic locators and learn with every execution. The outcome is super fast authoring and stable tests that learn, thus eliminating the need to continually maintain tests with every code change. Netapp, Verizon Wireless, Wix.com and others run over 300,000 tests using Testim.io every month.

Be smart & save time...
Simply automate.

Get Started Free