Skip to Content (custom)

Qualititative Prediction of Estimate Accuracy

Publication No
RS131-1
Type
Research & Development Product
Publication Date
Mar 01, 1999
Pages
27
Research Team
RT-131
DOCUMENT DETAILS
Abstract
Key Findings
Filters & Tags
Abstract

For engineering and construction projects, accurate early cost estimates are extremely important to the sponsoring organization and the engineering team. For the sponsoring organization, early cost estimates are often a basis for business unit decisions.

The accuracy of an early estimate depends on four determinants: who was involved in preparing the estimate, how was the estimate prepared, what was known about the project, and other factors considered while preparing the estimate. To measure the impact of these four determinants with respect to estimate accuracy, the CII Improving Early Estimates Research Team developed the Estimate Score Program (ESP), a software tool that evaluates 45 elements, organized in four divisions. The ESP software was developed to automate the scoring procedure and to assess accuracy and predict contingency based on historical cost data. The software and user’s manual are published by CII on a compact disc and publication (Implementation Resource 131-3, Estimate Score Program Guide [archived]). The research team also produced Implementation Resource 131-2, Improving Early Estimates: Best Practices Guide.

The ESP tool enables the business unit and the team to make better decisions based on statistically valid information. It improves team alignment by providing a better understanding of the estimate and the factors that can affect the accuracy of an early estimate.

This summary focuses on the research team’s development of the ESP tool (CII Implementation Resource 131-3). The tool itself is a credible, readily usable software that has the potential to improve not only early estimates, but project team alignment as well.

Key Findings
The research identified 45 elements to measure the quality of an estimate, including 14 PDRI scope definition elements and 31 elements not directly related to scope definition. The complete list of 45 elements was then subdivided into eleven factor groups; through factor analysis in developing Estimate Score Program (ESP) each of the 45 elements was allocated an element weight and determines the factor weights of the eleven factor groups.  Factor group weights have relative influence the four drivers of the estimate score. (RS131-1, p. 4)
 

The factor analysis and regression analysis performed in development of the ESP identified eleven factor groups with the most impact on estimate accuracy. 

The figure below describes the eleven factors in order of significance. The most significant factor, basic process design, accounts for 25% of the estimate score therefore concludes that a comprehensive and definitive process design is critical to the accuracy of early estimates. Basic process design includes process flow sheets, heat and material balance, project schedule, capacities, equipment list, and P&IDs as the highest factors elements. (RS131-1, p. 9)

This is the second factor of significance in the accuracy of early estimates. Extensive analysis of historical project data revealed that there is a positive correlation between estimated and actual total installed cost based on issues related to the team’s skills and experience, the estimating procedures, and scope definition. It was concluded in situations where scope definition is limited, project teams with good established estimating practices and experienced personnel were able to prepare accurate early estimates. 

The figure below illustrates the hypothesis RT-131 developed regarding the positive impacts of team experience and good procedures with various levels of scope definition. (RS131-1, p. 25)

Graphic showing effect of the team experience and procedures on estimate quality.
This tool had the function to allow users to query the database of completed projects to identify projects against which to compare an early estimate. A Scatter Plot and Cumulative Graph are graphical views of project data returned by the query and display the Estimate Score values or Probability values and corresponding amount of contingency as a percent of the base estimate. Values are displayed based on the queried projects and chosen confidence level. Users can view the results of recommended contingency amounts given their current project estimate score. (RS131-1, p. 19)
Filters & Tags
Project Phase
Research Topic
Improving Early Estimates
Keywords
Early Estimate Accuracy, Estimate Assessment, Estimate Score Program, Estimate Evaluation, Project Estimating, Contingency Assessment, Risk Assessment, Predicting Project Cost, Predicting Total Install Cost, rt131