Participation level:
- High (Stakeholders participate in decision)
Innovation level:
- Medium (Some new elements)
Facilitator skill level, and other support required:
- Medium (Computer & other expertise)
Can be used for:
- Engage community
- Communicate an issue
- Build alliances, consensus
A Delphi study aims to engage a large number of experts and/or stakeholders in a process of coming to agreement without necessitating their leaving their usual domain. This usually involves circulating documents or options papers by email or post so that all comments and suggestions can be noted.
The Delphi study process should lead to an agreed set of guidelines and/or recommendations that includes the input of all relevant areas of expertise, regardless of how geographically far-flung this network might be.
- Allows sharing of ideas and consensus decision-making by a large number of stakeholders who are geographically distanced.
- Can be used when the issue is complex.
- Works well to produce a consensus decision.
- Provides a transparent and democratic technique.
- Can deal with quite technical issues.
- Offers convenience to participants, as they can contribute from their own office or home.
- The process can be expensive to run.
- Large amounts of data need to be assessed and distributed.
- Takes time for the organisers (can run for several months).
- Participant commitment may falter if the process takes too long or they have other commitments.
Organizing Delphi Study
How many people to organize?
- Large (> 12 people)
- Medium (2-12 people)
- Individual
Time required:
- Medium (6 weeks-6 months)
Cost:
- Low (< AUD$1,000)
- Identify a panel of experts or specialists by soliciting nominations from specialists or individuals appropriate to serve on the Delphi panel. Cooperation and participation is improved significantly when prospective panelists are told how they were nominated by their peers. The panelists' primary qualification should be their specialist knowledge. This knowledge can be gained through experience (for example, readers of a certain publication) or specialist knowledge (for example, safety engineers). Another key qualification is that panelists be willing to share their information (for example, non-competitors). The terms of reference of the study need to be described to the panelists at this time.
- Invite an appropriate number of panelists to participate. Thirty to fifty individuals should be members of the final panel. This is large enough to see patterns in responses, but not so large as to overwhelm the facilitator or researcher, who must sift through all of the responses individually. The invitation should explain what is expected from each panel member in terms of time and effort to complete each wave of the Delphi study.
- Prepare and distribute the initial survey instrument. The initial survey may contain open-ended probes or specific closed-ended questions, depending on the focus of the research.
- Receive and analyse the first responses. Compile the responses by question, with only minor editing as necessary for clarity and consistency. If open-ended questions were used extensively, then it may be necessary to analyse and present the first set of responses within an appropriate theoretical framework, typology, or outline.
- Prepare and distribute the second survey instrument. Most often panelists are asked, with this second wave enquiry, to clarify and rank order survey items suggested during the first wave. When the panelists receive the second survey instrument, it will be the first time they will have seen the responses of the other panel members. It is often appropriate at this time to ask for additional ideas, clarifications, and elaborations based on the initial survey responses
- Receive and analyze the second lot of responses (second wave of data). If the initial questions were open-ended and the second wave asked for clarifications and elaborations, the analysis of the second wave of data can be very challenging because it requires numerous subjective decisions about rewording and revising the initial responses. Care should be exerted to include all of the new ideas and suggestions, for the main purpose of the Delphi study is to generate new ideas.
- Prepare and distribute the third survey instrument. Most often, panelists are asked, with the third wave, to rank order and clarify the new set of revised survey items.
- Receive and analyze the third wave of data. Often by this stage, the analysis is less subjective and judgmental, and more quantitative and objective.
- Repeat the process with additional waves, if necessary. For example, sometimes certain priority items are selected for more in-depth treatment by the Delphi panelists, who may be asked to propose answers to questions or shortrange strategies for long-range goals, and so on.
- Prepare and distribute a final report to panel members. One of the motivations for participating in a Delphi panel, particularly for specialists, is to learn firsthand, before others, what the results of the Delphi study are.
- The final report is acted upon according to the initial terms of reference. (source: http://extmarket.ifas.ufl.edu/FOCUS.html)
References
Description
"The Delphi group approach is a technique for gathering data that is similar to focus groups. Its value is that unlike focus groups, Delphi groups do not have to physically meet. The Delphi technique is a method of generating ideas and facilitating consensus among individuals who have special knowledge to share, but who are not always in contact with each other. Delphi study carefully selects individuals who have knowledge necessary to analyse a specific problem.
"Most often, Delphi studies are conducted through the mail, by [email], telephone, and sometimes by personal interviews. However, this technique can also be used with faxes and e-mail. Initially, the participants do not interact with each other. Through the efforts of one [facilitator], who serves as a clearinghouse, the panelists see and react to each other's ideas. Through a series of surveys, they share and generate new ideas based on an emerging consensus among the panel members." (from Nehiley, see References)
Nehiley also writes, "the Delphi technique is an innovative way to involve busy experts and specialists who may not be able to come together to brainstorm, but who nevertheless need to interact with each other to generate new ideas." Using email, one central contact person (who may be conducting research) will send questions and background information to individuals who have been selected on the basis of the relevance of their expertise. These people will reply, stating their thoughts on the topic. The researcher or facilitator will then compile these ideas to develop a concrete proposal, set of guidelines, or wording for an agreement, and will send this out again for comment. The process is continued until agreement on the wording or process or action to be taken has been reached.
This page originally copied with permission from the Citizens Science Toolbox
