-
Notifications
You must be signed in to change notification settings - Fork 206
Smoke testing instructions
Rafael Zaleski edited this page Jan 20, 2023
·
4 revisions
These instructions are intended for the Release Lead to run after simulating a release via woorelease, and before executing the actual release.
All the smoke tests are derived from the Critical Flows and will always be a subset of those; we're just making sure the release has been properly bundled.
In addition to everything mentioned here the Release Lead should also test any bug fixes added after the manual testing cycle.
Note: Some of these tests can be performed with one transactions. For example, if you have a 3DS card saved you can perform the "Checkout with saved card" and "Checkout with SCA card" smoke tests with 1 purchase.
| User type | Area | Flow Name | Instructions | E2E |
|---|---|---|---|---|
| Merchant | Onboarding | Manual plugin update | N/A | ✅ |
| Shopper | Checkout | Checkout with normal credit card | doc | ✅ |
| Shopper | Checkout | Checkout with saved card | doc | ✅ |
| Shopper | Checkout | Checkout with SCA card | doc | ✅ |
| Shopper | Checkout | Checkout failures (with one of the error cards) | doc | ✅ |
| Shopper | Checkout | Checkout with Payment Request | doc | ❌ |
| Shopper | Checkout | Checkout with Payment Request (3DS card) | doc | ❌ |
| Merchant | Order | Full refund | doc | ✅ |
| Shopper | Subscriptions | Purchase subscription product | doc | ✅ |
| Shopper | Subscriptions | Renew subscription | doc | ✅ |
| Merchant | WooCommerce Blocks | Create a Cart page with the Cart Block | doc | ✅ |
| Merchant | WooCommerce Blocks | Create a Checkout page with the Checkout Block | doc | ✅ |
| Shopper | WooCommerce Blocks | Checkout with normal credit card | doc | ✅ |
| Shopper | WooCommerce Blocks | Checkout with SCA card | doc | ✅ |
| Shopper | WooCommerce Blocks | Checkout failures (with one of the error cards) | doc | ✅ |
| Shopper | WooCommerce Blocks | Checkout with Payment Request | doc | ❌ |
| Shopper | WooCommerce Blocks | Checkout with saved card | doc | ✅ |
| Shopper | WooCommerce Blocks | Purchase subscription product | doc | ✅ |