Playwright VS Selenium:
The Evolution of Dominance
Can Selenium Make a Comeback?

The complex multi-level architecture of modern web applications and the demands of the target audience compel development and QA teams to constantly experiment with new technology stacks. This enables them to improve the quality of digital solutions and expedite their release; in other words, to achieve the main goals of the Agile methodology.

Mykhailo – CEO testomat.io test management tool. Professional manager with over 18 years of experience in the IT industry. Besides he is dedicated leader, purposeful entrepreneur and investor for the Growth Hacker IT, Startups, HoReCa, Development, Accounting. Keep up with the news out of Mykhailo through his personal resources below ↩️

New platforms for web testing are constantly emerging in the market, gradually displacing industry leaders. In this material, we will discuss two of them: Selenium and Playwright. We will compare these web automation tools for end-to-end testing of web apps and answer the question: Will the popularity of Playwright continue to gain momentum, or will Selenium be able to reclaim the top position?

Articles in our testing Blog:

Playwright VS Selenium: Working Principles of the Tools

Playwright is a relatively new web automation testing tool as opposed to Selenium. At its core, its operational principles align more in sync with modern testing standards, especially when considering Playwright vs Selenium. In particular, the Playwright is designed with the mind to address challenges that arose over time with the elder Selenium testing tool.

Request Processing Speed Comparison: difference between selenium and playwright
Request Processing Speed: Playwright VS Selenium

Most AQAs (Test Automation engineers) note the incredible Playwright speed with other test frameworks that were introduced the market earlier.

Key differences in the working principles of Playwright and Selenium:
  • How does Playwright work? When you run a test, the code is transformed into JSON format and sent to the server via the WebSocket protocol.
  • What is the working principle of Selenium? Commands in this framework are sent as HTTP requests, and the response is received in JSON format. The “Request & Response” path takes twice as long as executing a command transmitted using a token.

Test automation with Playwright: Definition and Capabilities

Playwright is an open-source tool based on Node.js, created and actively supported by Microsoft. It is widely used in complex testing projects thanks to its advanced features that aid in end-to-end testing of web applications. Let’s discuss the main features and characteristics of this popular framework, focusing on the Playwright vs Selenium debate for complex testing projects.

✅ Language Support

Playwright supports multiple languages: Java, TypeScript, JavaScript, Python, and C# .NET. This allows IT teams from various tech stack choose it.

✅ Browser, Platform, and Device Support

This widely used tool is versatile. It allows for cross-browser and cross-platform testing. Playwright supports multiple web browsers:

  • Safari based on Webkit.
  • Chromium-based browsers: Microsoft Edge and Google Chrome.
  • Firefox based on its own Quantum engine.

Additionally, this framework allows you to test websites on Windows, Linux, and macOS platforms.

As for supported devices, Playwright allows you to simulate any real device you need. This way, you can run tests without physical access to a phone or tablet. You can also specify geolocation coordinates for the browser context and conduct testing. This ensures that the web application works equally well for users in different parts of the world.

✅ Main Playwright Functionality

Playwright offers its users a wide range of features, enabling faster and more efficient end-to-end testing:

  • Codegen. Imagine being able to write test scripts without writing a single line of code. This test framework provides this capability through the codegen feature, which automatically records all your interactions with the browser.
  • Debugging. The framework lets you debug test failures using several tools:
    Playwright inspector: You can observe the progress of the test step by step in real-time, select and edit locators, and view the results of actionability checks in the respective logs.
    Trace Viewer: You can navigate between test steps and examine what happened at each of them through screenshots and logs.
  • Auto waiting. This feature involves running relevant checks on each element before performing any action. The action will be executed only after the system ensures that all elements behave as expected. Thanks to this feature, Playwright testers can avoid the common problem of flaky tests.
  • Retrying test failures. Use the test retries feature to automatically rerun all failed tests.
  • Visualization and recording of testing results. Playwright supports screenshots and screen recording, which can be viewed alongside reports. This helps teams quickly identify issues.
Other Playwright Capabilities

The capability of visual testing. This refers to UI test automation, which involves testing layouts, designs, styles, and other UI elements.

  • Support for testing in both headed and headless browsers. Choosing the appropriate mode depends on your current tasks. If you need to run tests, it’s better to do so in headless mode to prevent browser windows from interfering with the process. The headed mode is more suitable if your goal is visual testing or debugging tests.
  • Wide integration capabilities. Playwright is compatible with various third-party systems, including CI\CD servers like Jenkins, CircleCI, Azure Pipeline, etc., and third-party test runners such as Jest, Jasmine, and Mocha.
  • The ability to run different types of tests. While Playwright is primarily designed for running end-to-end tests, you can also perform functional and API testing using this framework.
  • Support for parallel test execution. This allows you to increase the testing speed because testers can run tests simultaneously on multiple browser and device combinations.
  • The ability to generate detailed reports. The framework includes built-in reporters (List, Line, Dot, HTML, JSON, and JUnit), and it also supports integration with third-party reporters like Allure, Monocart, Tesults, ReportPortal, Testomatio, Currents, and Serenity/JS.

All of the mentioned features have been the reason for the rapid growth in Playwright’s popularity. When you add its impressive capabilities, high-quality documentation, performance, and test execution speed, you’ll understand that this test automation tool unquestionably deserves your attention.

Now, we invite you to compare the features and capabilities of Playwright with those of another powerful testing tool – Selenium.

When to Choose Selenium? Strengths and Functionality of the Tool

Selenium is an open-source test automation framework written in Java. Unlike the previously discussed platform, Selenium has been around for quite some time. It was created in 2004 by developer Jason Huggins. However, it cannot be labeled end up as outdated testing tool. Selenium team regularly tries to introduce new features and capabilities.

The test framework comprises a set of three tools used for browser automation tests:
  • Selenium WebDriver
  • Selenium IDE
  • Selenium Grid
Selenium WebDriver, Selenium IDE, Selenium Grid
Сomponents Selenium Framework

Let’s start by looking at the components that Selenium includes and the possibilities it offers to QA teams:

  • Selenium WebDriver: An API that enables automation across multiple browsers. To control different browsers, WebDriver utilizes various executable files. For example, there’s ChromeDriver, FirefoxDriver, and so on.
  • Selenium IDE: An integrated development environment for creating and editing Selenium test scripts, a record and playback tool that serves as an extension for Firefox and Chrome browsers. This component is convenient for beginning testers and professionals in manual testing who are just beginning to explore browser automation.
  • Selenium Grid: A component that allows running browser automation tests on multiple machines simultaneously. This significantly speeds up the testing process.
✳️ Language Support

Selenium supports multiple languages: Java, Python, C#, JavaScript, Ruby, PHP, and Perl. Such multilingual support can be a crucial factor for a team when choosing an automation environment.

✳️ Browser, Platform, and Device Support

Like Playwright, Selenium supports cross-platform and cross-browser testing. You can choose from various browsers for testing, including:

  • Chrome
  • Firefox
  • IE
  • Edge
  • Opera
  • Safari etc.

Selenium is also compatible with an impressive number of operating systems, such as Linux, Windows, Solaris, and MacOS. This automation environment supports testing on real devices and virtual machines.

Illustration of how Selenium 4 works
More Selenium Features
  • Support for testing in both headed and headless browsers. Like Playwright, Selenium offers both headed and headless modes. This means that with Selenium, you can use browsers without displaying a graphical user interface to enhance testing speed, and if there’s a need to debug test failures, you can choose the headed mode. Choosing the appropriate mode depends on your current tasks. If you need to run tests, it’s better to do so in headless mode to prevent browser windows from interfering with the process. The headed mode is more suitable if your goal is visual testing or debugging tests.
  • Integration of third-party plugins to extend functionality. For example, by adding the Percy plugin, Selenium can conduct visual regression testing, and Chrome BlazeMeter allows running tests to check performance.
  • Extensive integration capabilities. Selenium easily integrates with CI/CD pipelines and supports multiple test runners like Mocha, Jest, Jasmine, Protractor, and WebDriverIO.
  • Support from a large global community, and the availability of numerous tutorials and detailed official documentation make Selenium a top choice for many QA teams when it comes learning curve of web automation tasks.

Playwright and Selenium offer their users extensive functionality, but they also have specific drawbacks, which should be considered when choosing a platform for testing web applications. Next, we will discuss the advantages and disadvantages of each tool.

Playwright VS Selenium: Advantages of the Frameworks

The web automation tools under consideration share several valuable characteristics for testers. These include support for headed and headless browsing, running different tests, and cross-platform and cross-browser support. It’s also important to note that both tools have open-source code.

Now let’s move on to the advantages of each of them.

🎭  Advantages of Playwright
⭐ Advantages of Selenium
  • Auto waiting feature that helps eliminate flaky tests.
  • Ability to conduct parallel test execution through browser context.
  • Codegen feature that allows the tool to automatically generate test scripts by recording browser actions.
  • Access to detailed reportingHigh testing speed.
  • Availability of its own test runner.
  • Built-in capabilities for taking screenshots and screen recording.
  • Native mobile emulation, enabling mobile web testing.
  • Reliable community support.
  • Ability to perform testing in virtually any modern browser and operating system.
  • Support mobile devices with using third-party libraries.
  • Support for a wide range of programming languages.

Playwright VS Selenium: Drawbacks of the Tools

To objectively evaluate each tool, let’s examine their drawbacks. Let’s consider the next comparison Playwright and Selenium too.

🎭 Drawbacks of Playwright
 ❌  Drawbacks of Selenium
  • Playwright supports fewer browsers and programming languages compared to Selenium.
  • Limited community support due to the framework’s recent entry into the market.
  • The tool does not support real devices out-of-the-box.
  • Absence of auto waiting support, which leads to flaky tests. To address this issue, testers must resort to using implicit and explicit waits.
  • Inability to perform visual testing and API testing with this tool; it only allows browser-based testing.
  • Lack of built-in reporters.
  • The necessity to use third-party test runners.
  • Additional extensions are required for taking screenshots and screen recording.
  • Slower testing speed due to the use of the JSON wire protocol. In the latest framework version, they moved to WebDriver W3C, but the testing speed still lags behind Playwright.

Summarizing

To help your team decide between Selenium and Playwright, we have organized all the above information into a table.

Language Support Java, TypeScript, JavaScript, Python, C# .NET Java, Python, C#, JavaScript, Ruby, PHP, Perl
Browser Support Safari, Microsoft Edge, Google Chrome, Firefox Chrome, Firefox, IE, Edge, Opera, Safari etc.
Operating Systems MacOS, Linux, and Windows Linux, Windows, Solaris, and MacOS
Parallel Test Execution Available “out of the box” Available using Selenium Grid
Test Runners Has its own, but also supports AVA, Jest, Jasmine, Mocha Selenium Command Line Runner and Selenium SIDE Runner
Headless Mode Supported Supported, but not for all browsers
Available Types of Testing Various browser-based testing + Visual and API testing Only browser-based testing
Overall Test Execution Time High testing speed Slow tests
Documentation and Support Options Plenty of quality documentation but insufficient community support, as the community is still developing Good documentation and strong global community support

Playwright is an innovative product with unique features and significant potential. Moreover, it was introduced much later than Selenium, so it takes into account all the aspects of the modern QA field and the shortcomings of its predecessor that didn’t meet the needs of testers in today’s conditions. Its capabilities can be compared only to the latest version of Selenium, and even then, it has certain limitations that necessitate the creation of a next-generation testing tool.

Comparison Playwright and Selenium packages download statistic Source

Considering recent trends, we can confidently say that the popularity of Playwright will continue to grow, but Selenium is not yet ready to relinquish its position entirely. It is used by those teams for whom migrating projects to a new framework would be quite costly or those who prefer to follow their personal preferences.

Explore arguments why test engineers from different testing frameworks have moved to Playwright and the advantages they’ve reaped from Playwright migration. We hope this material will help you choose the optimal tool for web application testing.

Playwright vs Selenium pros and cons Reddit thread

👉 Do you have any questions? Contact the experts at testomat.io – we would happily tell you about web automation.

Playwright extent report 📊
Simultaneously output manual and automated tests with the single test management tool
Follow us