Quality research as defined by CII must satisfy the six key criteria listed below:
I. The Topic (and RTS) is well structured and addresses a valid industry concern.
- High-value, high-impact topic.
- Clear and concise statement of topic in the Research Topic Statement (RTS)
- Very precise statement of the Essential Question (or Essential Assignment)
- Documentation of the topic as a significant industry concern in respected publications
- Board of Advisor members are vocal advocates of the research topic
- Something new or something that needs to be updated due to industry changes
Industry improvement or advancement
- Excites the industry and the academics
II. Team Dynamics: The research is competently done in the CII mold.
- The RT meets regularly, keeps minutes and maintains a forward momentum. It does not backtrack or lose its way
- The RT membership is relatively stable and committed to successfully undertaking a joint venture between industry and academia
- The industry chair (and vice-chair) and academics clearly establish their respective roles and responsibilities and closely collaborate each other to enhance team performance
- Participation is constant and active
- Team members have tapped the breadth of their collective experience and resources to think outside the box and—to the best of their ability—to produce breakthrough work. All believe they are pushing a frontier. Team participation is not a chore, it is an adventure
- Team members explore various and different perspectives yet focus on the agreed research direction through constructive alignment effort
- In the kick-off meeting, a high bar is set for the RT and a schedule-driven feedback loop is established with the RC
- Team meetings are effectively managed and operated to meet the research milestones as well as provide team members with a learning opportunity from each other
III. Research Methodology: Work is done in the classic research mode.
- Balance academic rigor and industry relevance.
- The academic team members possess and deliver the necessary quantitative and analytical research expertise (Process). The industry team members respect, understand, and appreciate this expertise and support the academics in achieving excellence.
- The industry team members possess and deliver the necessary domain expertise, influence, and access to resources to support the research. (Domain) The academics respect, understand, and appreciate this domain expertise and does not try to unduly influence this with preconceptions.
- The team pursues clear and consistent objectives, not merely ill-defined preferences.
- Essential questions are translated into a researchable format, without loss of the essence or impact of the original statement.
- Objectives are cast in the hypothesize-and-test mode, with multiple explanations having been explored and the most effective explanation selected.
- Further research needs are clarified by the work–the answer to this question inspires new, clearly stated questions.
- The research team understands and is committed to the research methodology; all team members know where the team is going and how to get there.
- The methodology follows the “Problem/Question → Hypothesis → Data Collection and Analysis → Validation → Implementation Guidance” process defined in the RFQ.
- The methodology is solid, committed to paper, and has the support of the whole team before substantial time and energy are spent on the work. The methodology supports the production of breakthrough work.
- The methodology is logically related to essential question and is doable within the time and cost constraints.
- The methodology will produce an innovative work product – it is not just a matter of cranking the handle and seeing what comes out.
- Data used for the work are appropriate and defensible; its provenance is clear, and its statistical parameters and significance are demonstrated.
- Data collected in the validation phase must be objective and validated; it should not simply be the result of a strictly opinion-based survey.
- Creativity is key to collecting objective data that is appropriate to the research topic. Beyond using surveys, teams are encouraged to consider using data collection methods such as interviews, workshops, field samples/case studies, and theoretical models, or combinations of these methods.
- The required quantity and quality of data can be collected given the time and other resources available.
- If a survey approach is used for data collection, it should comply with CII guidance on using surveys.
- Data are collected from multiple data sources rather than a single source improving data reliability.
- The work clearly stands on the shoulders of others.
- Relevant background research is outlined. Key work by others may be presented in some detail—supported, refuted, or extended.
- Intellectual property drawn from past work is properly cited.
- CII work and archival sources are heavily used.
- Conclusions are repeatable. Data and analyses are presented clearly with enough of an analytical framework that other researchers could repeat the study and come to similar conclusions.
- The team resists the pressure to conclude too much or reach too far.
- Encourage “breakthrough thinking,” discourage mediocrity.
IV. Product Design and Development: The research product answers the essential question and is of value to the CII membership.
- The entire team participates in planning and outlining the research summary but the document is clearly the responsibility of the industry chairs and the industry team members who have full responsibility for the delivery and quality of the final product.
- The entire team participates in planning and outlining the research report, but the time, cost, and quality of the final product is the responsibility of the academic.
- The research products clearly answer the essential question provided in the RTS.
- The research objectives described in the research product are aligned with the essential question.
- The research product addresses the need conveyed in the RTS, and conveys how the team has responded to the essential question.
- The research product conveys the context and existing information on the topic and considers various perspectives relevant to the topic.
- The research product:
- Is based on fact-based data – not opinions.
- Is validated by objective research.
- Presents results in ways that highlight critical findings.
- Provides an answer that can be readily implemented.
- Data and analysis are presented in a format that can be replicated by other CII members.
- Critical assumptions, contrary findings, and alternative interpretations are all discussed.
- The research product makes cautious conclusions and carefully discusses their implications.
- The research product can be readily implemented.
- Tools produced by the team lead to the solution.
- The research product offers a timely solution to or amelioration of a lingering problem.
- The research team offers a solution or innovation that can improve the industry.
- Industry adopts and widely uses the research product.
- The research product provides support for breakthrough thinking.
V. Contributes to the storehouse of knowledge.
- Team completes required documents—producing at a minimum a research summary and a research report—with the understanding that an implementation resource or implementation tool may not be appropriate.
- Work results in a minimum of one journal article attributed to CII.
- Work results in a minimum of one conference paper attributed to CII.
- Work is taught in CII professional development courses.
- Work is recognized as valuable by other professional development providers or curricula.
- Graduate or undergraduate courses are modified to include the material.
Last modified and verified on 3-25-16 by CII Research Webmaster