Software Engineering Institute | Carnegie Mellon University
Software Engineering Institute | Carnegie Mellon University

Digital Library

Javascript is currently disabled for your browser. For an optimal search experience, please enable javascript.

Advanced Search

Basic Search

Content Type

Topics

Publication Date

Technical Note

Robustness Testing of Software-Intensive Systems: Explanation and Guide

  • Abstract

    Many Department of Defense (DoD) programs engage in what has been called "happy-path testing" (that is, testing that is only meant to show that the system meets its functional requirements). While testing to ensure that requirements are met is necessary, often tests aimed at ensuring that the system handles errors and failures appropriately are neglected. Robustness has been defined by the Food and Drug Administration as "the degree to which a software system or component can function correctly in the presence of invalid inputs or stressful environmental conditions." This technical note provides guidance and procedures for performing robustness testing as part of DoD or federal acquisition programs that have a software component. It includes background on the need for robustness testing and describes how robustness testing fits into DoD acquisition, including source selection issues, development issues, and developmental and operational testing issues.

  • Download

Cite This Report

SEI

Cohen, Julie; Plakosh, Daniel; & Keeler, Kristi. Robustness Testing of Software-Intensive Systems: Explanation and Guide (CMU/SEI-2005-TN-015). Software Engineering Institute, Carnegie Mellon University, 2005. http://resources.sei.cmu.edu/library/asset-view.cfm?AssetID=7413

IEEE

Cohen. Julie, Plakosh. Daniel, and Keeler. Kristi, "Robustness Testing of Software-Intensive Systems: Explanation and Guide," Software Engineering Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania, Technical Note CMU/SEI-2005-TN-015, 2005. http://resources.sei.cmu.edu/library/asset-view.cfm?AssetID=7413

APA

Cohen, Julie., Plakosh, Daniel., & Keeler, Kristi. (2005). Robustness Testing of Software-Intensive Systems: Explanation and Guide (CMU/SEI-2005-TN-015). Retrieved December 20, 2014, from the Software Engineering Institute, Carnegie Mellon University website: http://resources.sei.cmu.edu/library/asset-view.cfm?AssetID=7413

CHI

Julie Cohen, Daniel Plakosh, & Kristi Keeler. Robustness Testing of Software-Intensive Systems: Explanation and Guide (CMU/SEI-2005-TN-015). Pittsburgh, PA: Software Engineering Institute, Carnegie Mellon University, 2005. http://resources.sei.cmu.edu/library/asset-view.cfm?AssetID=7413

MLA

Cohen, Julie., Plakosh, Daniel., & Keeler, Kristi. 2005. Robustness Testing of Software-Intensive Systems: Explanation and Guide (Technical Report CMU/SEI-2005-TN-015). Pittsburgh: Software Engineering Institute, Carnegie Mellon University. http://resources.sei.cmu.edu/library/asset-view.cfm?AssetID=7413