The Delphi method is a survey-based framework for estimating the likelihood and outcome of future events. The Delphi method is a survey-based framework for estimating the likelihood and outcome of future events. It was developed in response to military strategy formation during the Cold War. The Delphi method has been adapted considerably since the 1960s.
- Understanding the Delphi method
- Delphi method characteristics
- Strengths and weaknesses of the Delphi method
- Delphi method examples and case studies
- Delphi method forecasting
- Delphi Method vs. Starbursting
- Delphi Method vs. Affinity Grouping
- Delphi Method vs. Nominal Group Technique
- Key takeaways:
- What is the Delphi method used for?
- Is Delphi qualitative or quantitative?
- What are the steps of Delphi method?
- Other connected business strategy frameworks
Understanding the Delphi method
The Delphi method was developed during the 1950s and 1960s to forecast the impact of technology on warfare.
At the time, experts were asked to give their personal opinion on the probability, intensity, and frequency of enemy attacks during the Cold War.
Opinions could be offered anonymously, and the process was repeated until a consensus became apparent.
Today, the Delphi method remains a structured and systematic forecasting process based on multiple rounds of questionnaires sent to a panel of experts.
The method has been used to predict trends in automation, aerospace, and the use of technology in schools.
Delphi method characteristics
Although there is considerable variation in how the Delphi method is applied, there do exist some generally accepted characteristics in the form of best practices:
It must incorporate a group of participants, or panelists, selected for their relevant and specialized knowledge on a topic
A neutral facilitator with knowledge of research and data collection is also recommended.
An initial idea generation stage should be held to get a broad sense of the most important issues.
It is often conducted across a series of two or more sequential questionnaires.
Ideas collected from the first questionnaire should then be used to construct the second questionnaire, and so on.
After each questionnaire round, there is an evaluation phase
Here, the panelists are provided with the overall panel response and asked to re-evaluate their standpoint by the facilitator.
If a consensus is not reached, another round of questioning occurs.
Strengths and weaknesses of the Delphi method
Diversity of opinion
The Delphi method is an effective way to assemble a diverse range of experts and then aggregate their opinions.
The anonymity afforded by the framework also encourages each expert to share their true feelings.
As noted earlier, the technique can be used to tackle a wide variety of issues, subjects, or situations.
There is also no requirement that the experts meet in person.
The response of each expert is weighted equally.
This democratic process ensures dominant personalities do not hijack the discussion or shift the prevailing opinion of the group.
Lack of clarity
Many practitioners struggle with the lack of clarity around what constitutes consensus.
Since it is highly unlikely a panel will reach 100% agreement, the integrity of the method may be compromised if a cut-off level is not established beforehand.
The Delphi method is effective when the only way to generate insight is via expert opinion.
In an evidence-based scenario such as healthcare intervention, the method may have limited use.
Delphi studies can be complex and time-consuming, particularly if a consensus is not reached early.
Some experts may become disenfranchised and deliberately alter their views to conclude the process.
Others may shift their stance during the evaluation phase to comply with the majority view.
This phenomenon is called the bandwagon effect.
Delphi method examples and case studies
Consider the following hypothetical Delphi model examples.
In the first example, a company must decide whether to make a sizeable investment in acquiring another business.
A team of financial experts is assembled who then ideate and discuss whether the merger is in fact a good idea.
The panelists also discuss what steps the acquiring company should take if it proceeds or does not proceed with the deal.
Various elements of a successful merger are then discussed. It is pointed out that the merger should only proceed if both companies can create more value together than they could alone.
Someone else notes that the cultures of the two companies must also be similar to ensure harmony and collaboration once the process is complete.
The ideas are recorded and the first questionnaire concerning whether the deal makes sense from a financial point of view is completed by the group.
Most believe that the deal should go ahead, but a couple of individuals now share concerns about the synergies between both companies.
While each sells fast-moving consumer packaged goods, there is concern that most of the acquiring company’s products are sold in supermarkets while most of the target company’s products are sold in independent stores and gas stations.
A second questionnaire is then completed based on this point of difference with the panel once more asked to determine whether the acquisition should proceed.
Discussion should continue until there is a consensus that sufficient synergies exist between both companies.
One expert may sway the opinions of others by noting that the two companies have modular (resource-based) and sequential (value chain-based) synergies which make the acquisition more viable.
Subsequent rounds of questionnaires are then performed until a final decision is made on whether to proceed.
Consensus on the logical steps management should take in either case is also defined by consensus.
In the second example, a tech company is tasked with creating a software system that removes some of the inefficiencies that are common in research laboratories.
To do this, the company assembles a team of experts consisting of scientists, research assistants, university students, and business professionals.
Once assembled, the team is handed the first questionnaire that focuses on whether individuals believe efficiency can be increased, the extent of any subsequent revenue increase, and how the software will impact the industry.
The facilitator then reviews the answers provided and finds some significant discrepancies between different stakeholders.
Feedback common to each stakeholder group is then made available to be incorporated into the second round of questionnaires.
Business professionals, for example, may be required to review the project’s logistics based on hard data provided by the scientists.
Research assistants and university students may also influence the business stakeholders’ implementation timeline.
Healthcare treatment protocols
The Delphi method is primarily used in healthcare contexts to foster consensus around the proper development of treatment protocols.
This often occurs in situations where there is conflicting evidence or limited information on the most appropriate course of action.
In one example, a study involving expert physiotherapists collected data on the best ways to treat low back pain (LBP).
While clinical guidelines did exist prior to the completion of the study in 2008, there was no consensus on the management of low back pain among physiotherapists.
In any case, the results of the Delphi method would have notable implications for healthcare and indeed society itself, with over 90% of the adult population predicted to experience symptoms associated with low back pain in their lives.
To arrive at a consensus, a three-round Delphi study was conducted with a total of 34 physiotherapists involved.
The process started with a focus group that developed the key survey questions after conducting a literature review.
The panel of experts then provided their responses which were ranked in subsequent rounds of questioning using a five-point Likert scale.
Ultimately, the Delphi method indicated that it was possible to establish consensus between physiotherapists as to the best way to tackle LBP.
In fact, consensus was reached on 64 of the 95 responses (around 67%). In general, it was found that most LBP treatments adhered to the current, evidence-based clinical standards.
The panel of experts also identified the importance of the biopsychosocial model in treating patients.
Big data in obesity research
The Delphi method has also been used to build consensus around the definition (and use of) big data in obesity research.
While healthcare practitioners noted that obesity was a global challenge, there was a lack of clarity around the definition of big data and how it could be used in obesity-related research.
Some also believed that a lack of proper frameworks may be hindering progress toward solving the problem.
In response, a three-survey Delphi method was conducted to establish consensus on the best path forward.
In the first questionnaire, 96 participants were asked to either agree or disagree with 77 statements across seven domains related to the use of big data in obesity research.
At this point, participants were also called upon to contribute additional ideas that would be then used in subsequent survey rounds.
In the second and third rounds, participants reassessed their answers to facilitate consensus.
Consensus was achieved for 90.6% of the 77 statements and critically, there was 100% consensus around the definition of key terms such as big data, quality and inference domains, and data governance.
More specifically, it was agreed that big data was more complex and nuanced than the standard “volume, variety, and velocity” definition it is often attributed with.
Instead, the experts believed, big data should incorporate qualitative, quantitative, observational, and interventional data from a wide variety of sources.
Delphi method forecasting
The Delphi method is a qualitative forecasting method where a team of assembled experts makes a forecast based on their skills and knowledge.
This method is ideal for problems with no true solutions or where a wholly quantitative approach is not suitable.
Understanding the Delphi method forecasting process
Once the team of experts has been assembled to conduct a Delphi study, the facilitator asks each individual to submit a forecast based on detailed qualitative justification.
The integrity of the Delphi method depends on these steps since the individuals on the panel of experts must possess enough knowledge about a topic to:
- Forecast the outcome of a future scenario.
- Predict the likelihood of event occurrence, and
- Reach a consensus about the topic in question.
Collectively, the forecast submitted by each individual forms a summary report which is then discussed and reviewed by the experts.
Based on this discussion, the panel makes an updated forecast and hands it back to the facilitator who reviews the material once more and issues a second report.
This process repeats until a consensus is reached.
It is important to note that each expert has access to the forecasts other experts have made in each round, but the forecasts themselves remain anonymous.
This encourages the panel to share their opinions openly and revise their earlier predictions in light of information provided by their counterparts.
The Delphi method and demand forecasting
One popular application of the Delphi method is business demand forecasting.
In this scenario, each expert creates a demand forecast with a specific projection that is discussed and edited as necessary until consensus.
The demand forecast is then handed to another department within the organization for review.
After multiple rounds of interpretation, the forecast is reviewed by senior management or others with decision-making authority.
The final forecast is then constructed based on the aggregation of the experts’ predictions.
Where is Delphi method forecasting most useful?
Initially, the Delphi method was an effective way to forecast outcomes and trends in the science and tech industries.
As early as the 1960s, it was used in population control, war prevention, and weapons systems.
Other forecasts were subsequently made concerning industrial robots, broadband connections, vehicle-highway systems, and intelligent internet.
The method has also become useful as a way to forecast economic, educational, healthcare, and public policy outcomes.
In certain Caribbean and Latin American countries, for example, the Delphi method has been used in a partnership between the public and private sectors to identify the region’s most pressing economic and social issues.
When used in business demand forecasting, the Delphi method can be used by organizations to:
- Prepare their budget, make prudent financial decisions, and reduce risk.
- Ensure that order fulfillment is synchronized with marketing campaigns before launch.
- Forecast future sales numbers with 96-97% accuracy.
- Reduce costs associated with inventory purchase orders and warehousing, and
- Develop a pricing strategy based on demand, market competition, and other opportunities.
Delphi Method vs. Starbursting
Whereas the Delphi method is a structured and systematic forecasting process based on multiple rounds of questionnaires sent to a panel of experts.
Thus, the Delphi method is skewed toward getting answers from specific questions.
Starbursting is about asking the right questions in the first place.
Delphi Method vs. Affinity Grouping
Whereas the Delphi method looks into getting the opinion of experts on a topic with a structured set of questions.
Delphi Method vs. Nominal Group Technique
Both the nominal group technique (NGT) and the Delphi method are ways to determine consensus among groups.
Yet, the NGT is more focused on facilitating group consensus for small and controlled groups, while the Delphi method encourages diversity and equality of opinion and has no locational constraints.
- The Delphi method is a survey-based framework for estimating the likelihood and outcome of future events. It was developed in response to military strategy formation during the Cold War.
- The Delphi method has been adapted considerably since the 1960s. For best results, a facilitator must lead the panel through a series of iterative, reflective, and evaluative questionnaires until a consensus is reached.
- The Delphi method encourages diversity and equality of opinion and has no locational constraints. However, it does not provide detailed guidance on group consensus and may be complex and time-consuming to complete.
What is the Delphi method used for?
The Delphi method is a survey-based framework for estimating the likelihood and outcome of future events developed in response to military strategy formation during the Cold War. This method encourages diversity and equality of opinion and has no locational constraints.
Is Delphi qualitative or quantitative?
What are the steps of Delphi method?
- It must incorporate a group of participants.
- An initial idea-generation stage should be held.
- It is often conducted across a series of two or more sequential questionnaires.
- After each questionnaire round, there is an evaluation phase.
- After the evaluation phase, the Delphi Method will inform the likelihood and outcome of future events.
Other connected business strategy frameworks
Main Free Guides: