X Tutup
Skip to content

test: allow skipping individual WPT subtests#62517

Open
panva wants to merge 1 commit intonodejs:mainfrom
panva:wpt-subtest-skipping
Open

test: allow skipping individual WPT subtests#62517
panva wants to merge 1 commit intonodejs:mainfrom
panva:wpt-subtest-skipping

Conversation

@panva
Copy link
Copy Markdown
Member

@panva panva commented Mar 30, 2026

To skip specific subtests within a file (rather than skipping the entire file), use skipTests with an array of exact test names:

{
  "something.scope.js": {
    "skipTests": [
      "exact test name to skip"
    ]
  }
}

When the status file is a CJS module, regular expressions can also be used:

module.exports = {
  'something.scope.js': {
    'skipTests': [
      'exact test name to skip',
      /regexp pattern to match/,
    ],
  },
};

Skipped subtests are reported as [SKIP] in the output, recorded as NOTRUN in the WPT report, and counted separately in the summary line.

This is useful for skipping a particular subtest that crashes the runner, which would otherwise prevent the rest of the file from being run. When using CJS status files, this also enables conditionally skipping slow or resource-heavy subtests in CI on specific architectures.

Signed-off-by: Filip Skokan <panva.ip@gmail.com>
@nodejs-github-bot
Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/web-standards

@nodejs-github-bot nodejs-github-bot added needs-ci PRs that need a full CI run. test Issues and PRs related to the tests. labels Mar 30, 2026
@codecov
Copy link
Copy Markdown

codecov bot commented Mar 30, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 89.70%. Comparing base (c3042c6) to head (16ddb29).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main   #62517      +/-   ##
==========================================
- Coverage   89.70%   89.70%   -0.01%     
==========================================
  Files         692      692              
  Lines      214167   214167              
  Branches    41113    41111       -2     
==========================================
- Hits       192121   192108      -13     
+ Misses      14116    14114       -2     
- Partials     7930     7945      +15     

see 46 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

needs-ci PRs that need a full CI run. test Issues and PRs related to the tests.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

X Tutup