feat(android): aggregate reports when running more than one test (#1163) #1267

woody-tang · 2025-09-29T12:00:11Z

aggregate reports when running multiple android tests using vitest.

netlify · 2025-09-29T12:00:27Z

✅ Deploy Preview for midscene ready!

Name	Link
🔨 Latest commit	`f21d8ab`
🔍 Latest deploy log	https://app.netlify.com/projects/midscene/deploys/68e9f08e9751170008023e62
😎 Deploy Preview	https://deploy-preview-1267--midscene.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

…, remove agent.teardownTestAgent, add one case in android project to show the usage of ReportMergingTool

CLAassistant · 2025-10-05T05:39:50Z

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
1 out of 2 committers have signed the CLA.

✅ yuyutaotao
❌ tangjialei

tangjialei seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

… reports correctly

… for removing getHtmlScripts funtion. Move android test into tests/ai/

Copilot

Pull Request Overview

This PR implements report aggregation functionality for Android tests when running multiple tests with vitest. The feature allows merging individual test reports into a single consolidated report.

Adds a new ReportMergingTool class to handle report aggregation operations
Updates core utilities to support report merging without template inclusion
Creates test coverage for the report merging functionality

Reviewed Changes

Copilot reviewed 9 out of 9 changed files in this pull request and generated 5 comments.

Show a summary per file

File	Description
`packages/core/src/report.ts`	New ReportMergingTool class for aggregating multiple test reports
`packages/core/src/types.ts`	Adds type definitions for test status and report attributes
`packages/core/src/utils.ts`	Exports utilities and adds withTpl parameter to reportHTMLContent
`packages/core/tests/unit-test/report.test.ts`	Comprehensive test suite for report merging functionality
`packages/core/package.json`	Adds export entry for the new report module
`packages/android/tests/ai/merge-reports.test.ts`	Example usage of report merging in Android tests
`packages/android/vitest.config.ts`	Disables parallel file execution for proper report aggregation

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}

Copilot · 2025-10-11T06:24:25Z

packages/core/tests/unit-test/report.test.ts

+    return expectedContents;
+}
+
+describe('repotMergingTool', () => {


Corrected spelling of 'repotMergingTool' to 'reportMergingTool'.

Suggested change

describe('repotMergingTool', () => {

describe('reportMergingTool', () => {

Copilot · 2025-10-11T06:24:25Z

packages/core/src/utils.ts

  if (type !== 'dump') {
    // do not write dump file any more
-    writeFileSync(filePath, fileContent);
+    writeFileSync(filePath, JSON.stringify(fileContent));


This change breaks compatibility for non-JSON content. The function should only stringify when fileContent is an object, not when it's already a string.

Suggested change

writeFileSync(filePath, JSON.stringify(fileContent));

if (typeof fileContent === 'string') {

writeFileSync(filePath, fileContent);

} else {

writeFileSync(filePath, JSON.stringify(fileContent));

}

Copilot · 2025-10-11T06:24:26Z

packages/core/src/report.ts

+    }
+
+    public mergeReports(
+        reportFileName: 'AUTO' | string = 'AUTO',// user custom report filename, save into midscene report dir if undefined


Missing space after comma in inline comment. Should be 'AUTO',// ' -> 'AUTO', // '

Suggested change

reportFileName: 'AUTO' | string = 'AUTO',// user custom report filename, save into midscene report dir if undefined

reportFileName: 'AUTO' | string = 'AUTO', // user custom report filename, save into midscene report dir if undefined

Copilot · 2025-10-11T06:24:26Z

packages/core/src/report.ts

+                        playwright_test_id: reportAttributes.testId,
+                        playwright_test_description: reportAttributes.testDescription,
+                    },
+                }, undefined, undefined, false) + '\n';// use existed function to achieve report script content


Missing space before inline comment and grammatical error. Should be 'false) + '\n'; // use existing function to generate report script content'

Suggested change

}, undefined, undefined, false) + '\n';// use existed function to achieve report script content

}, undefined, undefined, false) + '\n'; // use existing function to generate report script content

Copilot · 2025-10-11T06:24:26Z

packages/android/tests/ai/merge-reports.test.ts

+                testId: `${ctx.task.name}`, //ID is a unique identifier used by the front end to distinguish each use case!
+                testTitle: `${ctx.task.name}`,
+                testDescription: 'description',
+                testDuration: (Date.now() - ctx.task.result?.startTime!) | 0,


Using bitwise OR with 0 to convert to integer is unclear. Use Math.floor() or parseInt() for better readability and intent.

Suggested change

testDuration: (Date.now() - ctx.task.result?.startTime!) | 0,

testDuration: Math.floor(Date.now() - ctx.task.result?.startTime!),

…last script tag

feat(android): aggregate reports when running more than one test (web…

1bfd4c1

…-infra-dev#1163)

github-actions bot added the change: feat label Sep 29, 2025

feat(core): add ReportMergingTool into core/utils with its unit-tests…

1a63542

…, remove agent.teardownTestAgent, add one case in android project to show the usage of ReportMergingTool

chore(core): restore test item: utils -> should handle multiple large…

d80174c

… reports correctly

This was referenced Oct 9, 2025

[Feature]: Standalone Merged Reports Support (Beyond Playwright Integration) #976

Closed

[Feature]: Android supports the test report merging function #918

Closed

feat(core): new report.ts, new unit tests. Enhanced reportHTMLContent…

f21d8ab

… for removing getHtmlScripts funtion. Move android test into tests/ai/

quanru requested a review from Copilot October 11, 2025 06:23

Copilot AI reviewed Oct 11, 2025

View reviewed changes

yuyutaotao changed the base branch from main to feat/report-merging-tool October 11, 2025 08:09

yuyutaotao approved these changes Oct 11, 2025

View reviewed changes

chore(core): violent test, merge 200 reports each has 50m content in …

3454755

…last script tag

yuyutaotao approved these changes Oct 11, 2025

View reviewed changes

Merge branch 'feat/report-merging-tool' into feat/report-aggregation

cf26150

yuyutaotao merged commit 86a7b9c into web-infra-dev:feat/report-merging-tool Oct 11, 2025
1 check was pending

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

feat(android): aggregate reports when running more than one test (#1163) #1267

feat(android): aggregate reports when running more than one test (#1163) #1267

Uh oh!

woody-tang commented Sep 29, 2025

Uh oh!

netlify bot commented Sep 29, 2025 •

edited

Loading

Uh oh!

CLAassistant commented Oct 5, 2025 •

edited

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Copilot AI Oct 11, 2025

Uh oh!

Copilot AI Oct 11, 2025

Uh oh!

Copilot AI Oct 11, 2025

Uh oh!

Copilot AI Oct 11, 2025

Uh oh!

Copilot AI Oct 11, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

	describe('repotMergingTool', () => {
	describe('reportMergingTool', () => {

	reportFileName: 'AUTO' \| string = 'AUTO',// user custom report filename, save into midscene report dir if undefined
	reportFileName: 'AUTO' \| string = 'AUTO', // user custom report filename, save into midscene report dir if undefined

	}, undefined, undefined, false) + '\n';// use existed function to achieve report script content
	}, undefined, undefined, false) + '\n'; // use existing function to generate report script content

	testDuration: (Date.now() - ctx.task.result?.startTime!) \| 0,
	testDuration: Math.floor(Date.now() - ctx.task.result?.startTime!),

feat(android): aggregate reports when running more than one test (#1163) #1267

feat(android): aggregate reports when running more than one test (#1163) #1267

Uh oh!

Conversation

woody-tang commented Sep 29, 2025

Uh oh!

netlify bot commented Sep 29, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

✅ Deploy Preview for midscene ready!

Uh oh!

CLAassistant commented Oct 5, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull Request Overview

Reviewed Changes

Uh oh!

Copilot AI Oct 11, 2025

Choose a reason for hiding this comment

Uh oh!

Copilot AI Oct 11, 2025

Choose a reason for hiding this comment

Uh oh!

Copilot AI Oct 11, 2025

Choose a reason for hiding this comment

Uh oh!

Copilot AI Oct 11, 2025

Choose a reason for hiding this comment

Uh oh!

Copilot AI Oct 11, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

netlify bot commented Sep 29, 2025 •

edited

Loading

CLAassistant commented Oct 5, 2025 •

edited

Loading