Software Engineering Institute

Robert W. Stoddard

Software Engineering Institute

Publications by Robert W. Stoddard

Teaming Data Science and Causal Inference

April 06, 2022 • Video

Robert W. Stoddard Shane McGraw

In this episode, Shane McGraw interviewed Bob Stoddard, SEMA team lead, about how data scientists joining his group of technical professionals and researchers will make an impact on the U.S. Department of Defense through data-driven decision solutions.
watch
Poster - Causal Models for Software Cost Prediction and Control

November 04, 2020 • Poster

Michael D. Konrad William Nichols Robert W. Stoddard

This poster describes CMU SEI's collaboration with other researchers to apply causal learning to learn how to control costs in software development and sustainment.
read
Causal Models for Software Cost Prediction & Control (video)

November 12, 2019 • Video

Michael D. Konrad William Nichols Robert W. Stoddard

Watch SEI researchers Dr. Michael Konrad, Dr. William Nichols, Mr. Robert Stoddard, and Dr. David Zubrow discuss recent results from applying causal learning to control and predict software cost.
watch
Causal Models for Software Cost Prediction and Control (video)

November 11, 2019 • Video

Michael D. Konrad William Nichols Robert W. Stoddard

Researchers at CMU SEI collaborated with other researchers to apply causal learning to learn how to control costs in software development and sustainment.
watch
Causal Models for Software Cost Prediction and Control

October 28, 2019 • Presentation

Michael D. Konrad Robert W. Stoddard William Nichols

This presentation describes work toward establishing causation with observational data, which remains a vital need and a key technical challenge.
read
Causal Models for Software Cost Prediction & Control

October 28, 2019 • Poster

Michael D. Konrad Robert W. Stoddard William Nichols

This poster provides an update on ongoing research to use causal learning in software cost prediction.
read
Prioritizing Alerts from Multiple Static Analysis Tools, Using Classification Models

August 14, 2018 • Conference Paper

Lori Flynn William Snavely David Svoboda

This paper was accepted by the SQUADE workshop at ICSE 2018. It describes the development of several classification models for the prioritization of alerts produced by static analysis tools and how those models were tested for accuracy.
read
Why Does Software Cost So Much?

August 02, 2018 • Podcast

Michael D. Konrad Robert W. Stoddard

Mike Konrad and Bob Stoddard discuss an approach known as causal learning that can help the Department of Defense identify which factors cause software costs to escalate and, therefore, serve as a better basis for guidance on how to intervene.
learn more
Why Does Software Cost So Much? Towards a Causal Model

October 30, 2017 • Presentation

Robert W. Stoddard Michael D. Konrad

Presentation on research to build an actionable, full causal model of software cost factors that is immediately useful to DoD programs and contract negotiators
read
Why Does Software Cost So Much? Towards a Causal Model

October 30, 2017 • Poster

Robert W. Stoddard Michael D. Konrad

Poster on research to build an actionable, full causal model of software cost factors
read
Replacing Promises with Data: A Structured Way to Assess Software Health

March 23, 2017 • Presentation

Karen LaFond (U.S. Army)Alfred Schenker Robert W. Stoddard

Acquisition programs need a structured approach to evaluating the health of contractors' software projects. This presentation describes the Army Ground Combat Systems program's efforts in this area.
read
Why Does Software Cost So Much? Toward a Causal Model (March 2017)

March 23, 2017 • Presentation

Robert W. Stoddard Michael D. Konrad William Nichols

This presentation shares early research results that may confirm some well-known drivers of DoD software cost and debunk others.
read
Elicitation of Unstated Needs

November 18, 2015 • Presentation

Mary Beth Chrissis Robert W. Stoddard Michael D. Konrad

This presentation covers the KJ method and additional extensions that allow KJ to be used in a virtual environment (KJ+). The results of a KJ+ case study and two brief exercises are included.
read
Quantifying Uncertainty in Early Lifecycle Cost Estimation Poster (SEI 2015 Research Review)

October 22, 2015 • Poster

Robert W. Stoddard

The QUELCE method continues to be refined. This poster describes recent developments.
read
Quantifying Uncertainty for Early Lifecycle Cost Estimation:FY15 Results

October 16, 2015 • Presentation

Robert W. Stoddard

The QUELCE method continues to be refined. This slide set describes recent developments.
read
Improving Federal Cybersecurity Governance Through Data-Driven Decision Making and Execution

September 16, 2015 • Technical Report

Douglas Gray Brian D. Wisniewski Julia H. Allen

This technical report focuses on cybersecurity at the indirect, strategic level. It discusses how cybersecurity decision makers at the tactical or implementation level can establish a supportive contextual environment to help enable their success.
read
Advanced Modeling of Teaming Data to Enable Superior Team Performance

November 04, 2014 • Presentation

Robert W. Stoddard Dan Bennett (Hill Air Force Base)David Webb (Hill Air Force Base)

This TSP Symposium 2014 presentation describes data analyzed using statistical analysis and modern structural equation modeling (SEM) to enhance team performance.
read
Eliciting Unstated Requirements

August 26, 2014 • Presentation

Nancy R. Mead Michael D. Konrad Robert W. Stoddard

The tutorial presents the traditional KJ method for eliciting unstated user needs and extensions made to allow KJ to be used in a virtual environment.
read
Improving the Automated Detection and Analysis of Secure Coding Violations

June 27, 2014 • Technical Note

Daniel Plakosh Robert C. Seacord Robert W. Stoddard

This technical note describes the accuracy analysis of the Source Code Analysis Laboratory (SCALe) tools and the characteristics of flagged coding violations.
read
Wireless Emergency Alerts: Trust Model Simulations

February 26, 2014 • Special Report

Timothy Morrow Robert W. Stoddard Joseph P. Elm

This report presents four types of simulations run on the public trust model and the alert originator trust model developed for the Wireless Emergency Alerts (WEA) service, focusing on how to increase both alert originators' and the public's trust in WEA.
read
Wireless Emergency Alerts: Trust Model Technical Report

February 25, 2014 • Special Report

Robert W. Stoddard Joseph P. Elm James McCurley

This report describes a trust model to enable the Federal Emergency Management Agency to maximize the effectiveness of the Wireless Emergency Alerts (WEA) service and provides guidance for alert originators in using WEA to maximize public safety.
read
Results of SEI Line-Funded Exploratory New Starts Projects: FY 2012

July 01, 2013 • Technical Report

Bjorn Andersson Lori Flynn David P. Gluch

This report describes line-funded exploratory new starts (LENS) projects that were conducted during fiscal year 2012 (October 2011 through September 2012).
read
Quantifying Uncertainty in Expert Judgment: Initial Results

March 01, 2013 • Technical Report

Dennis Goldenson Robert W. Stoddard

The work described in this report, part of a larger SEI research effort on Quantifying Uncertainty in Early Lifecycle Cost Estimation (QUELCE), aims to develop and validate methods for calibrating expert judgment.
read
Analyzing Cases of Resilience Success and Failure - A Research Study

December 01, 2012 • Technical Note

Julia H. Allen Pamela D. Curtis Andrew P. Moore

In this report, the authors describe research aimed at helping organizations to know the business value of implementing resilience processes and practices.
read
Quantifying Uncertainty in Early Lifecycle Cost Estimation

November 27, 2012 • Webinar

Jim McCurley Robert Stoddard

In this presentation we describe a new, integrative approach for pre-Milestone A cost estimation, which we call QUELCE (Quantifying Uncertainty in Early Lifecycle Cost Estimation).
watch
Quantifying Uncertainty in Early Lifecycle Cost Estimation

November 01, 2012 • Podcast

Jim McCurley Robert Stoddard

In this podcast episode, Jim McCurley and Robert Stoddard discuss a new method developed by the SEI's Software Engineering Measurement and Analysis (SEMA) team, Quantifying Uncertainty in Early Lifecycle Cost Estimation (QUELCE).
learn more
Source Code Analysis Laboratory (SCALe)

April 01, 2012 • Technical Note

Robert C. Seacord Will Dormann James McCurley

In this report, the authors describe the CERT Program's Source Code Analysis Laboratory (SCALe), a conformance test against secure coding standards.
read
Deriving Software Security Measures from Information Security Standards of Practice

February 16, 2012 • White Paper

Christopher J. Alberts Julia H. Allen Robert W. Stoddard

In this paper, the authors describe an approach for deriving measures of software security from common standard practices for information security.
read
Risk-Based Measurement and Analysis: Application to Software Security

February 01, 2012 • Technical Note

Christopher J. Alberts Julia H. Allen Robert W. Stoddard

In this report, the authors present the concepts of a risk-based approach to software security measurement and analysis and describe the IMAF and MRD.
read
Quantifying Uncertainty in Early Lifecycle Cost Estimation (QUELCE)

December 01, 2011 • Technical Report

Robert Ferguson Dennis Goldenson James McCurley

The method of quantifying uncertainty described in this report synthesizes scenario building, Bayesian Belief Network (BBN) modeling and Monte Carlo simulation into an estimation method that quantifies uncertainties, allows subjective inputs, visually depicts influential relationships among program change drivers and outputs, and assists with the explicit description and documentation underlying an estimate.
read
Security Measurement and Analysis

January 01, 2011 • Presentation

Christopher J. Alberts Julia H. Allen Robert W. Stoddard

In this presentation, the authors describe work being performed by the SEI in the area of security measurement and analysis.
read
Source Code Analysis Laboratory (SCALe) for Energy Delivery Systems

December 01, 2010 • Technical Report

Robert C. Seacord Will Dormann James McCurley

In this report, the authors describe the Source Code Analysis Laboratory (SCALe), which tests software for conformance to CERT secure coding standards.
read
Illuminating the Intersection of TSP and CMMI High Maturity Process Performance Models

September 22, 2010 • Presentation

Robert W. Stoddard David Webb (U.S. Air Force)Shigeru Sasao (Carnegie Mellon University)

Presentation given at TSP Symposium on September 21-23, 2010
read
Integrated Measurement and Analysis Framework for Software Security

September 01, 2010 • Technical Note

Christopher J. Alberts Julia H. Allen Robert W. Stoddard

In this report, the authors address how to measure software security in complex environments using the Integrated Measurement and Analysis Framework (IMAF).
read
Approaches to Process Performance Modeling: A Summary from the SEI Series of Workshops on CMMI High Maturity Measurement and Analysis

January 01, 2010 • Technical Report

Robert W. Stoddard Dennis Goldenson

This report summarizes the results from the second and third high maturity measurement and analysis workshops.
read
An Innovative Requirements Solution: Combining Six Sigma KJ Language Data Analysis With Automated Content Analysis

March 23, 2009 • Presentation

Dennis Goldenson Ira Monarch Robert W. Stoddard

This March 2009 presentation, An Innovative Requirements Solution, was presented by Ira Monarch, Dennis Goldenson, and Robert W. Stoddard at SEPG North America 2009.
read
Use and Organizational Effects of Measurement and Analysis in High Maturity Organizations: Results from the 2008 SEI State of Measurement and Analysis Practice Surveys

February 01, 2009 • Technical Report

Dennis Goldenson James McCurley Robert W. Stoddard

This report contains results from a survey of high maturity organizations conducted by the Software Engineering Institute (SEI) in 2008. The questions center on the use of process performance modeling in those organizations and the value added by that use.
read
Results of SEI Independent Research and Development Projects (FY 2008)

December 01, 2008 • Technical Report

Dionisio de Niz Gabriel Moreno Robert Nord

This report describes the independent research and development (IRAD) projects that were conducted during fiscal year 2008 (October 2007 through September 2008).
read
CMMI High Maturity Measurement and Analysis Workshop Report: March 2008

November 01, 2008 • Technical Note

Robert W. Stoddard Dennis Goldenson David Zubrow

This report outlines a 2008 workshop, in which leaders discussed high maturity practices and how to sustain momentum for improvement.
read
Uses of Monte Carlo Simulation for TSP Team

September 23, 2008 • Presentation

David Webb (Hill Air Force Base)Jim Van Buren (Draper Laboratory)David Tuma (Tuma Solutions)

Presentation given at TSP Symposium on September 22-25, 2008
read
Interpreting CMMI High Maturity for Small Organizations 2008

September 01, 2008 • Presentation

Robert W. Stoddard

Presented in September 2008 by Robert Stoddard.
read
Tools Supporting CMMI High Maturity for Small Organizations 2008

September 01, 2008 • Presentation

Robert W. Stoddard

Presented in September 2008 by Robert Stoddard.
read
A Practitioner View of CMMI Process Performance Models

March 20, 2008 • Presentation

Robert W. Stoddard

This presentation is a half-day tutorial presented at North America SEPG.
read
High Maturity Measurement Workshop

March 20, 2008 • Presentation

Dennis Goldenson Robert W. Stoddard

Presented by Dennis Goldenson and Bob Stoddard in March 2008.
read
Tutorial: If You're Living the "High Life", You're Living the Informative Material

March 03, 2008 • Presentation

Michael D. Konrad Robert W. Stoddard Rusty Young

This presentation provides an overview of CMMI high maturity, which occurs at levels 4 and 5. It was presented at SEPG 2008, in Tampa Florida, March 2008.
read
CMMI and Six Sigma: Partners in Process Improvement

December 18, 2007 • Book

M. L. Penn Jeannine Siviy Robert W. Stoddard

This book focuses on a "faster, better, cheaper" implementation of CMMI and Six Sigma. Book topics range from formation of a value proposition to specific implementation tactics.
read
If You're Living the "High Life," You're Living the Informative Material

October 17, 2007 • Presentation

Michael D. Konrad Robert W. Stoddard Rusty Young

This presentation provides information on how the informative material within the CMMI-DEV model relates to high maturity implementations of CMMI-DEV in various organizations.
read
Exactly What are Process Performance Models in the CMMI?

June 12, 2007 • Presentation

Robert W. Stoddard Ben Linders Millee Sapp (Warner Robins Air Logistics Center)

Presented: June 2007
read
Quicker and Better Quality Improvement Business Cases with Bayesian Belief Networks and Six Sigma

June 11, 2007 • Presentation

Ben Linders Robert W. Stoddard

This 2007 presentation was delivered by Ben Linders and Robert W. Stoddard of the Software Engineering Institute (SEI) as part of E-SEPG 2007.
read
Software Design-for-Six Sigma (SDFSS) and SEI Technologies Meet!

June 11, 2007 • Presentation

Robert W. Stoddard

This presentation was delivered at the 2007 European Conference, held from June 11-14, 2007.
read
Achieving Success via Multi-Model Process Improvement: SEPG 2007

March 23, 2007 • Presentation

M. L. Penn Jeannine Siviy Robert W. Stoddard

This presentation provides information on multi-model process improvement.
read
High Maturity: How Do We Know?

January 01, 2007 • Presentation

Mary Beth Chrissis Will Hayes Robert McFeeley

This presentation provides an overview of material also available in the Understanding CMMI High Maturity Practices course offered by the SEI.
read