Make runner better consume test output

currently the runner would analyze test output from runner console but it has some shortcomings.

error messages output by the tests would also be printed to the System.error stream. So it had to tell runner error or test error.
the regex expression cannot cover all the cases as the stack trace could contain any text if the test failed.

I'd like to redesign the output format generated by the runner. The output item would have following fields as below:

{
    phase: string;
    attributes: Map<string, string>;
    message: string;
    stackTrace: string;
    type: TestReportType; // enum with value info or error
}

And the runner would always output in the following way:
@@<RunnerOutput-'serialized json string of the outputitem'-RunnerOutput>@@

#263

The above solution could solve problem1. While for problem2, I found another issue due to the limit of console, if the stacktrace is huge, then the data received would be trimmed and the data cannot be successfully analyzed.

It turns out the truncation issue is due to the limitation of exec, I've sent a pr to use spawn instead.

Navigation Menu

Repository navigation

Make runner better consume test output #258

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Make runner better consume test output #258

Description

Activity

ansyral commented on Aug 1, 2018

ansyral commented on Aug 1, 2018

ansyral commented on Aug 2, 2018

ansyral commented on Aug 3, 2018

ansyral commented on Aug 7, 2018

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions