MountainScenarios

Category: Scenario Planning & Delphi Research

Scenarios Now and the Genius (hidden) within Crowd

It’s been about 10 years since the Great Recession of 2007-2008. (It formally started in December of 2007.) A 2009 McKinsey study showed that CEOs wished that they had done more scenario planning that would have made them more flexible and resilient through the great recession. In a 2011 article, Hall (2011) discusses the genius of crowds and group planning – especially scenario planning.

The Hall article spent a lot of time assessing group collaboration, especially utilizing the power available via the Internet. Wikipedia is one of the greatest collaboration – and most successful – tools of all time. It is a non-profit that invokes millions of volunteers daily to add content and regulate the quality of the facts. In this day of faus news, Wikipedia is a stable island in the turbulent ocean of content. Anyone who has corrections to make to any page (called article) is encouraged to do so. However, the corrections need to fact-based and source rich. Unlike a typical wiki, where anything goes, the quality of content is very tightly controlled.  As new information and research comes out on a topic, Wikipedia articles usually reflect those changes quickly and accurately. Bogus information usually doesn’t make it in, and bias writing is usually flagged. Sources are requested when an unsubstantiated fact is presented.

Okay, that’s one of the best ways to use crowds. People with an active interest – and maybe even a high level of expertise – update the content. But what happens when the crowd is a group of laypeople. Jay Leno made an entire career from the “wisdom” of people on the street when he was out Jay Walking. The lack of general knowledge in many areas is staggering.  Info about the latest scandal or gossip by celebs, on the other hand, might be really well circulated. So how can you gather information from a crowd of people where the crowd may be generally wrong?

It turns out that researchers at MIT and Princeton have figured out how to use statistics to figure out when the crowd is right and when the informed minority is much more accurate (Prelec, Seung & McCoy, 2017).  (See a Daniel Akst overview WSJ article here.) Let’s say you are asking a lot of people a question in which the general crowd is misinformed. The answer, on average, will be wrong. There might be a select few in the crowd who really do know the answer, but their voices are downed out, statistically speaking. These researchers took a very clever approach; they ask a follow-on question about what everyone else will answer. The people who really know will often have a very accurate idea of how wrong the crowd will be. So the questions with big disparities can be identified and you can give credit to the informed few while ignoring the loud noise from the crowd.

Very cool. That’s how you can squeeze out knowledge and wisdom from a noisy crowd of less-than-informed people.

The question begs to be asked, however: Why not simply ask the respondents how certain they are? Or, maybe, ask the people of Pennsylvania what their state capital is, not the other 49 states who will generally get it wrong. Maybe even put some money on it to add a little incentive for true positives combined with costly incorrect answers such that only the crazy or the informed will “bet the farm” on answers where they are not absolutely positive?

But then, that too is another study.

Now, to return to scenario planning. Usually with scenario planning, you would have people that are already well informed. However, broad problems have different silos of expertise. Maybe a degree of comfort or confidence would be possible in the process of scenario creation. Areas where a specific participant feels more confident might get more weight than other areas where their confidence is lower. Hmm… Sounds like something that could be done very well with Delphi, provided there were well informed people to poll.

Note scenarios are different from probabilities… Often scenarios are not high probabilities… You are usually looking at possible scenarios that are viable… The “base case” scenario is what goes into the business plan so that may be the 50% scenario; but all the other scenarios are everything else. The base case is only really likely to occur if nothing major changes in the macro and the micro economic world. Changes always happen, but the question is, does the change “signal” that the bus has left the freeway, and now new scenario(s) are at play.

The average recession occurs every 7 years into a recovery. We are about 10 years into recovery from the Great Recession. Of course, many of the Trump factors could be massively disrupting. Not to name them all, but on the most positive case, a 4% to 5% economic growth in the USA, should be a scenario that every business should be considering. (A strengthening US and world economy may, or may not, be directly caused by Trump.) The nice thing about having sound scenario planning, as new “triggers” arise, they may (should) lead directly into existing scenarios.

Having no scenario planning in your business plan… now that seems like a very bad plan.

Reference

Hall, E. (2009). The Delphi primer: Doing real-world or academic research using a mixed-method approach. In C. A. Lentz (Ed.), The refractive thinker: Vol. 2. Research methodology (2nd ed., pp. 3-28). Las Vegas, NV: The Lentz Leadership Institute. (www.RefractiveThinker.com)

Hall, E. (2010). Innovation out of turbulence: Scenario and survival plans that utilizes groups and the wisdom of crowds. In C. A. Lentz (Ed.), The refractive thinker: Vol. 5. Strategy in innovation (5th ed., pp. 1-30). Las Vegas, NV: The Lentz Leadership Institute. (www.RefractiveThinker.com)

Prelec, D., Seung, H. S., & McCoy, J. (2017, January 26). A solution to the single-question crowd wisdom problem. Nature. 541(7638), 532-535. 10.1038/nature21054 Retrieved from: http://www.nature.com/nature/journal/v541/n7638/full/nature21054.html

Outa Time, the tic-toc of Intel and modern computing.

Ed Jordan’s dissertation research looked at the future of computing. He was inspired by the thought that Gordon’s law (Moore’s law) of computing — 18 months to double speed (and halve price) — was about to break down because of the limitations of silicon chips as the go below the 14 manometer level. Since Intel lives and dies based on the silicon chip, his research was really a story into the future. When will the old chip die, and what will be the next technology?

Hall & Jordon discuss the application of this disruptive technology in their DoD procurement planning article in the Refractive Thinker related to the use of Integrated Product Teams.

His research showed that the death of the silicon chip computer would come sooner, not later. And that several options appeared likely including quantum computing.  Scientists have just made a huge breakthrough toward Quantum Computing: see the WSJ article about it here, as published in the journal Nature.

In the meantime, Intel’s approach for decades of hardware one year and software (for the new hardware) the next has broken down. The so-called Tic-Toc of Intel is now outa time. It seems to be more like 2 years (4 years, really) in the clock cycle.

So, will Intel die with the new technologies? Obviously Intel can simply invent the disruptive technologies internally, or buy it up wherever the viable invention wells up.

References

Debnath, S., Linke, N. M., Figgatt, C., Landsman, K. A., Wright, K., & Monroe, C. (2016). Demonstration of a small programmable quantum computer with atomic qubits. Nature, 536(7614), 63–66. doi:10.1038/nature18648

Jordan, Edgar A. (2010). The semiconductor industry and emerging technologies: A study using a modified Delphi Method. (Doctoral Dissertation). Available from ProQuest dissertations and Theses database. (UMI No. 3442759)

Jordan, E. A., & Hall, E. B. (2016). Group decision making and Integrated Product Teams: An alternative approach using Delphi.  In C. A. Lentz (Ed.), The refractive thinker: Vol. 10. Effective business strategies for the defense sector. (pp. 1-20) Las Vegas, NV: The Refractive Thinker® Press. ISBN #: 978-0-9840054-5-1. Retrieved from: http://refractivethinker.com/chapters/rt-vol-x-ch-1-defense-sector-procurement-planning-a-delphi-augmented-approach-to-group-decision-making/

The Conundrum of middle management, HR experts and Delphi research.

Here is the overview on the RefractiveThinker™ article by Lentz in 2009 that discussed some of her findings related to using HR experts in a single-round, quantitative, Delphi Study. See the prior blog discussion related to using a 1-round Quant Delphi method here.

The overview of the 2009 chapter by Lentz, The modified ask-the-experts Delphi method: The conundrum of human resource experts on management participation, is this:

“[The] Lentz Dissertation study … was … a quantitative correlational explanatory method, using a modified Ask-the-Experts Delphi technique to determine if the traditionally held view of the strategic management process where strategic decision making had once been entrusted solely to the organization’s top management was still valid. Historically, only those in senior leadership positions within the executive office were felt to understand and employ strategic literacy in order to possess the skill, knowledge, and expertise to most effectively formulate corporate strategy and make strategic decisions. The purpose of the present study was to extend the foundational work of Wooldridge and Floyd from their 1990 study, using the modified Delphi Technique to look at the significance of additional employee involvement in the strategic decision-making process as it correlates to organizational performance.”

Based on the works in the 1990 by Wooldridge and Floyd, this dissertation was able to skip over round 1 of a typical Delphi Study. She hoped that the HR experts would corroborate the findings of the “Floyd Boyz”, as she called them. Assuming that the prior research was corroborated, then she would feel comfortable extending the research further and obtain better understanding of the involvement of middle management in the strategic planning world.

But, she didn’t get that first round of confirmation in the statistical analysis she was expecting!? Maybe things have changed since 1990? That seems likely. Maybe the HR experts weren’t so expert after all? Hmmm…  Maybe Delphi doesn’t always do what it hopes to do? Hmmm….

Sounds like a conundrum?

In the meanwhile, it seems that middle management gets no respect like the late-great Rodney Dangerfield of strategic planning and decision making.

References

Lentz, C. A. (2007).  Strategic decision making in organizational performance: A quantitative study of employee inclusiveness. D.M. dissertation, University of Phoenix, Arizona. Dissertations & Theses @ University of Phoenix database. (Publication No. AAT 3277192).

Lentz, C. (2009). The modified ask-the-experts Delphi method: The conundrum of human resource experts on management participation. In C. A. Lentz (Ed.), The refractive thinker: Vol. 2: Research Methodology, (pp. 51-75). Las Vegas, NV: The Refractive Thinker® Press. Retrieved from: http://refractivethinker.com/rt-vol-ii/

Delphi in the DoD Procurement Team (IPT) process

Jordan & Hall published an article in the Defense Sector edition (2016, Edition X) of the Refractive Thinker related to augmenting the DoD procurement process with Delphi team planning (Jordan & Hall, 2016). Here is the summary.

Delphi Method, or Delphi Technique, is an established method for bringing teams of informed panelists, or experts, together to analyze complex and interrelated problems. Organizations use group decision-making techniques to make sound plans, plans that gain support for the decisions made and build consensus. The U.S. Department of Defense (DoD) requires the use of Integrated Product Teams (IPTs) to ensure all disciplines are well represented in acquisition decisions. IPT planning process has several limitations, including the biases and inefficiencies associated with face-to-face meetings. The IPT process could be augmented to include Delphi analysis in order to develop more robust and more flexible procurement plans. Using the Delphi Method to augment IPTs could minimizing the costs and limitations of more traditional group planning while also significantly improve the quality of the procurement decisions. Delphi teams could be used with experts (or even with crowds) to provide sound analysis in many situations where the IPT process is ill equipped to produce unbiased and long-term results. Delphi teams would have the ability, as well, to look at bigger picture issues, and thereby avoid the narrow-scope, tunnel-vision analysis where most of the IPTs operate.

Reference

Jordan, E. A., & Hall, E. B. (2016). Group decision making and Integrated Product Teams: An alternative approach using Delphi.  In C. A. Lentz (Ed.), The refractive thinker: Vol. 10. Effective business strategies for the defense sector. (pp. 1-20) Las Vegas, NV: The Refractive Thinker® Press. ISBN #: 978-0-9840054-5-1. Retrieved from: http://refractivethinker.com/chapters/rt-vol-x-ch-1-defense-sector-procurement-planning-a-delphi-augmented-approach-to-group-decision-making/

The Volume 10 book: http://refractivethinker.com/books/the-refractive-thinker-vol-x-effective-business-strategies-for-the-defense-industry-sector/

Delphi & Scenario Planning… Taking a closer looks at the future.

This site is devoted to Scenario Planning and looking forward types of analysis. Delphi Method/Technique is a great tool for this.

Page 3 of 3

Powered by WordPress & Theme by Anders Norén