Definition and Measurement of Engineering/Design Deliverable Quality (Best Practice)

RT-320 Topic Summary
RT 320

Overview

Defects in engineering/design deliverables negatively affect project performance in terms of cost, schedule, and safety, by causing significant amounts of rework in the design and/or construction phases. RT-320 offers capital project teams key guidance on assessing both the design quality and the design completeness of the most problematic engineering/design deliverables.  
 
RT-320 took a bottom-up, priority-driven approach to understanding design quality defects, impacts, causes, and methods of measuring design quality. The team began by identifying the 11 most problematic deliverables and the 73 most common and significant defects associated with these deliverables. The research team then identified 349 causal factors, from which were derived 118 leading and 23 lagging metrics. With additional insight from published literature and corporate practices, the team identified 266 completeness checklist items for the 11 most problematic deliverables. Finally, RT-320 developed two implementation tools: the Design Deliverable Quality Assessment (DDQA) tool and the Completeness of Design Deliverable Checklist (CDDC) tool.
IR320-2, Tools for Enhancing the Quality of Problematic Design Deliverables, presents the major findings of this research, the highlights of the two implementation tools, the inputs and outputs of the tools, and the roles and responsibilities of potential users. 

Key Findings and Implementation Tools

1 : Design Quality Essentials

Based on prior published literature, RT-320 defined design deliverable quality in terms of their completeness, correctness, and timeliness.

Failed to load widget object.
E:\construction-institute.org\CMS\CMSWebParts\cii\WatermarkImage.ascx.cs(9): error ASPNET: Make sure that the class defined in this code file matches the 'inherits' attribute, and that it extends the correct base class (e.g. Page or UserControl).
Reference: (RS320-1)

2 : Relative Frequency of Deliverable Quality Problems per Deliverable Type

RT-320 surveyed industry to identify the most problematic deliverables in terms of quality (N=67). The RT found similarities in the relative frequency of design quality problems encountered by owners (X-axis value) and contractors (Y-axis value).
Failed to load widget object.
E:\construction-institute.org\CMS\CMSWebParts\cii\WatermarkImage.ascx.cs(9): error ASPNET: Make sure that the class defined in this code file matches the 'inherits' attribute, and that it extends the correct base class (e.g. Page or UserControl).
Reference: (RS320-1)

3 : The 11 Most Problematic Design Deliverables

 
No. Deliverable
1 FEED Validation Deliverables
2 Level 3 Baseline Schedule
3 Constructability Inputs
4 P&IDs
5 Equipment Specifications & Data Sheets
6 Maintainability Inputs
7 Vendor Data
8 3D Model & Clash Detection
9 Piping Routing & Isometrics
10 Nozzles, Ladders, & Platforms for Towers/Vessels/Tanks
11 Misc. Pipe Support Drawings
 
 
From the scatter plot shown in Key Finding #2, RT-320 concluded that deliverables are “problematic” if quality problem frequency is between “Sometimes (3.0)” and “Too Often (5.0).”
 
Reference: (RS320-1)

4 : Analysis of 73 Significant Design Deliverable Defects (Deliverable Defects List)

The industry survey (N=36) identified 798 common defects associated with the 11 problematic deliverables. RT-320 consolidated and aggregated these common defects, developing a list of 73 significant design deliverable defects (6.63 defects per deliverable on average). Among the 73 defects, 24 percent pertain to completeness, 60 percent pertain to correctness, and 16 percent pertain to timeliness.
Failed to load widget object.
E:\construction-institute.org\CMS\CMSWebParts\cii\WatermarkImage.ascx.cs(9): error ASPNET: Make sure that the class defined in this code file matches the 'inherits' attribute, and that it extends the correct base class (e.g. Page or UserControl).
Reference: (IR320-2)

5 : Defects Analysis Table

RT-320 identified 349 causal factors associated with the 73 significant defects by utilizing a “5-Whys” approach. The table summarizes the defect type, impact type, and causal factors of each significant defect.
Failed to load widget object.
E:\construction-institute.org\CMS\CMSWebParts\cii\WatermarkImage.ascx.cs(9): error ASPNET: Make sure that the class defined in this code file matches the 'inherits' attribute, and that it extends the correct base class (e.g. Page or UserControl).
Reference: (IR320-2)

6 : Leading & Lagging Metrics (Metrics-Timing Table) 

The research team:
  • generated 118 leading metrics associated with the deliverable defects and causal factors.
  • generated 23 lagging metrics associated with the deliverable defects and defect impacts.
  • identified timing of measurement for each assessment.
Failed to load widget object.
E:\construction-institute.org\CMS\CMSWebParts\cii\WatermarkImage.ascx.cs(9): error ASPNET: Make sure that the class defined in this code file matches the 'inherits' attribute, and that it extends the correct base class (e.g. Page or UserControl).
Reference: (IR320-2)

7 : Deliverable Completeness Checklist

Based on prior published literature, four RT company models, and RT discussions, RT-320 developed a total of 266 completeness checklist items (approximately 24 items per deliverable type, on average). This checklist can help project teams seeking a high level of completeness for their engineering deliverables.
Failed to load widget object.
E:\construction-institute.org\CMS\CMSWebParts\cii\WatermarkImage.ascx.cs(9): error ASPNET: Make sure that the class defined in this code file matches the 'inherits' attribute, and that it extends the correct base class (e.g. Page or UserControl).
Reference: (IR320-2)

8 : Recommended Timing of Substantial Completeness by Deliverable 

RT-320 identified the recommended timing for application of the deliverable completeness checklist.
Failed to load widget object.
E:\construction-institute.org\CMS\CMSWebParts\cii\WatermarkImage.ascx.cs(9): error ASPNET: Make sure that the class defined in this code file matches the 'inherits' attribute, and that it extends the correct base class (e.g. Page or UserControl).
Reference: (RS320-1)

9 : Implementation Tool #1

Design Deliverable Quality Assessment (DDQA) Tool

The DDQA tool performs the following functions:
  1. addresses the 11 most problematic deliverables
  2. selects the appropriate leading metrics according to user input on targeted design deliverable(s) and relevant project timing milestone(s)
  3. provides design quality indices for each targeted design milestone and deliverable.
  4. provides a list of metrics that were responded to as "NO"
  5. provides a list of potential defects possibly associated with metrics answered as "NO"
  6. facilitates documentation of path-forward corrective actions (based on project team discussions) to eliminate/mitigate potential defects.
Reference: (IR320-2)

10 : Implementation Tool #2

Completeness of Design Deliverable Checklist (CDDC) Tool

The CDDC tool performs the following functions:
  1. focuses on the 11 most problematic deliverables
  2. facilitates assessment of completeness checklist items pertaining to the selected deliverable(s)
  3. provides completeness indices for the selected deliverables
  4. generates a list of items not currently substantially complete, for each selected deliverable.
Reference: (IR320-2)

Key Performance Indicators

Improved design, Improved cost, Improved schedule, Improved safety, Improved quality (reduced rework)

Research Publications

Tools for Enhancing the Quality of Problematic Design Deliverables - IR320-2

Publication Date: 12/2016 Type: Implementation Resource Pages: 123 Status: Tool

Study of Engineering/Design Deliverable Quality - RR320-11

Publication Date: 12/2016 Type: Research Report Pages: 244 Status: Reference

Engineering Deliverables: Get It Right the First Time - RS320-1

Publication Date: 12/2016 Type: Research Summary Pages: 25 Status: Supporting Product


Presentations from CII Events

Plenary Session - Engineering Deliverables: Get It Right the First Time

Publication Date: 08/2016 Presenter: Number of Slides: 20 Event Code: AC2016

Implementation Session - Engineering Deliverables: Get It Right the First Time

Publication Date: 08/2016 Presenter: Number of Slides: 16 Event Code: AC2016


Tags