GNU Toolchain Support and Maintenance
This set of pages covers the GNU Support and maintenance card and related issues.
Currently all configuration and building of the toolchain is handled by ""cbuild"". Cbuild uses text files to log everything, and keeps all the builds separate. (More on Cbuild) While there is web access to test runs and log files, there isn't much post build/testing analysis done. Currently the hardware is managed by LAVA, and cbuild can spawn LAVA jobs. LAVA also supports web based reporting, so should be able to use the data produced by cbuild for further analysis.
To support the types of data analysis that is desired, the configure and build tools need to support a more data rich environment. Test runs and toolchain build information should be imported into an SQL database so enabling better analysis. The main goal is to have the appropriate data accessible to support charting it in various ways to assist in better understanding of the quality of each toolchain component. This will assist developers in determining if their changes improve or degrade the component's quality. This will also allow others to get an overview of each component's quality, which will support product releases and management planning.
- Plot a test run of a specific version of a component across all supported platforms
- Plot a test case of a component across all supported platforms
- Plot a test case of a component across a list of versions
- Plot a component's PASS percentage across all supported platforms
- Plot a component's PASS percentage across all supported platforms and several versions.
- Plot a component's FAIL percentage across all supported platforms
- Plot a component's FAIL percentage across all supported platforms and several versions.
- Plot all test states as a percentage of total test results
- Plot all test states of the actual totals for each
Here's some notes on a Cbuild Redesign to support a more data rich development environment.
WorkingGroups/ToolChain/GNUToolchainSandM (last modified 2014-08-31 20:05:47)