Functionize Testing ML Engine - how it works

How Big Data & ML Drive the Functionize Gen AI Engine

Trained on the 7 years of testing data from globally deployed applications, Functionize has the most advanced, accurate, and extensible machine learning models of any QA testing solution.
Autonomous software testing agents can perform test generation with auto maintenance
testGPT - autonomouse test generation

testGPT:
Generative AI tools

Gen AI agents can generate realistic tests, resolve issues & perform maintenance and more

ML model is 99.9% accurate

99.95% accuracy in
ML element tracking

Highest element selection accuracy in the industry coupled with tests that make self-healing decisions in sub-seconds

Dynamic learning - model adapts to changes in your application

Dynamic
learning

Functionize learns from every execution & adapts to changes in your application

Computer Vision

Computer
vision

Visual AI combined with machine learning that creates a deeper understanding of test intent

Functionize ML-engine

AI Features

Autonomous test creation with testGPT
Generative Test Creation

Fully autonomous test creation based on real user journeys

Visual testing, verifications and baselinening
Visual Testing

Visual verifications for full page testing or element-based testing

Anomaly detection - focus on real bugs
Anomaly Detection

Spot anomalies with Gen AI agent to reduce fail positives

Sel healing or Auto maintenance
Self-Healing

Model learns on every execution and dynamically heals tests

Smart Screenshots
Smart screenshots

You can visually see all the elements as layers: baked into a screenshot

Visual testing feature - Quick select & Quick edit
Quick Select/Edit

Edit elements right in the screnshots

Modeling

Federated Training model is a combination of multiple machine learning models and approaches

Data Lake

Real user journeys
All application states
All elements on each page
Data from creation & execution
~2500 data points per page
~10M points per one journey
500,000 tests
100Gb+ dataset

Our Journey to Generative AI

Our ML engine sees the application as a state machine

Applications change the state on the user input in our case test input.

The whole user journey can be thought of as a Markov decision process: a series of inputs and outputs to the state machine.

Engine learns all states

Deep Learning Navigates the test machine to understand:

  • The interactivity of the app - is it ready or loading something;
  • It understands all the elements on the page, their types and properties (DOM)
  • It sees the app in a high dimensional space, like timing and network traffic and have a human-like logic:
  • Do I need to scroll to the element?
  • Which part of the button should I click? etc.
ML engine sees the application as a massive state machine graph (Makrov decition process)

Evaluating the outcome

Functionize collects hundreds of attributes per element

What is the probability that I was successful in that action?

Vastly reduce visual-based test failures

It is able to dynamically adapt over time, self-heal and improve.

Computer Vision Validation

ML engine gathers the data

Each step is represented as a massive high-dimensional matrix with rich data:

  • Locations on the page
  • Structural position
  • Scrolling data
  • Timing data
  • Pre, post states
  • Relationship to code
  • CSS properties
  • Visual styles
  • Context & relation to other elements
  • Network metrics
  • Screenshots

We collect this data for every element on the page!

Test Data types being collected: location, code, DOM, CSS properties, context, nesting, timing, scrolling, pre and post states, screenshots.

Engine also learns on test runs & test edits

ML engine gathers the data on each test run which forms a time series data set, which is leveraged to adapt to changes and perform auto maintenance or self healing.

Every time a tester edits the test - our engine learns with reinforcement learning making self-healing even more robust.

Functionize collects unpresedented ammount of test data to build large data sets and and train super presize application models

Each test generates tens of millions of data points

An average web application has nearly 3500 elements on each page. We collect around 200 attributes per element that results in 700K data points per one step.

So for a 100 step test, we collect an average of over 70 million attributes and that's only the data from the initial test creation.

Every test run and edit adds even more data.

What is the next logical step?

Millions of data points in a vast Data Sea

Why cloud platform is essential

The resulting training model can be very heavy: tens of millions of data points per execution.

That Data lake requires a cloud to store and process all of this massive data including screenshots for each and every run of your test.

With CI/CD you want to test and co-locate it with data to get all the benefits of self-healing, have better latency etc.

Cloud platform is essential for testing as it stors and process all massive datasets at one place
Journey to Full Autonomy

Autonomous Testing with testGPT

Advance towards testing autonomy with Generative AI, blending efficiency with cutting-edge technology.

Introducing test agents that make decisions and perform testing actions on your behalf:

Test Generation

Crate tests from prompts based on real user journeys.

Diagnostics & Maintenance

Auto-debug your tests with automated root-cause analysis and quick updates.

Test Documentation

Test Plan Generation for your case management tool.

TestGPT Represents the Next Frontier in Achieving Fully Autonomous Testing

TestAGENTS power testGPT

Most sophisticated ML architecture to achieve testing at scale

AI Models and
Cloud Power

Unleash the power of fully autonomous testing. Harness agent technology, large-scale AI models, and cloud-scale to propel your testing into a new era of autonomy.

agents mimic human testers

Powered by
Agent Technology

testAGENTS performs important autonomous testing actions based on application "awareness”, translating to massive productivity gains and cost reductions.

Best in industry support

Interactions Through
Language

Command with clarity. All user interactions with testGPT are streamlined through English prompts, the foundational language of AI.

testAGENTS Make the Impossible, Possible

6x

faster

Accelerate software
delivery by slashing
test cycle times

98%

coverage

Elevate release
confidence with the
heightened app visibility

70%

lower cost

Free up resources
to focus on revenue-driving initiatives

Ready to
Take Off?

Schedule a demo to see how Functionize is redefining the testing landscape, and can empower your team to achieve superior testing results in record time.

Computer Vision

Computer Vision Validation

More Than a Pixel by Pixel Comparison. Functionize will visually learn your application layout and identify any test failures or anomalies leveraging our ML Engine.

Smart screenshots: ML can understand application changes

Smart screenshots: Combining computer vision with machine learning allows for a deeper understanding of application changes.

Functionize leverages true color, no compression screenshots

Functionize leverages true color, no compression screenshots, analyzed by our ML Engine, to quickly mitigate visual issues, supporting development velocity.

Computer Vision Validation

Smart Element Detection

Eliminate visual test failures quickly & easily. Measure visual completion of each page versus only the DOM to better understand when users can fully interact with your product.

Functionize collects hundreds of attributes per element

Functionize collects thousands of attributes per element. Their unique combination creates a digital fingerprint, which is kept up to date with every execution.

All of this data enables 99.9% element selection accuracy. This makes xpath/element ID selector-based test failures a thing of the past.

Vastly reduce visual-based test failures

Vastly reduce visual-based test failures, regardless of the complexity or density of the page.

Accurate Element Detection with ML

Reduce Maintenance

Eliminate hundreds of hours debugging/maintaining with one-click update and self-healing tests. Functionize’s Root Cause Analysis engine supports teams to free up resources and focus on mission-critical tasks.

self healing tests

Tests self-heal to take the burden of maintenance off the user and onto the AI.

Root Cause Analysis

Remedy the root cause of any failed test with a one-click update across one of many tests.

ML Engine

Functionize ensures visual changes to your site do not break your test suites.

Reduce maintenance with Root Cause Analysis