2025 SDP Conference

2025 SDP Annual Conference, In-Person, March 25-27

Presentations

Day 1

Keynote Speaker || Eric Horvitz - Chief Scientific Officer, Microsoft

March 25, 2025 8:30am - 9:30am PT

►Click Here to Watch Recording

Natalie Daniel | Making Decisions Under Deep Uncertainty and Connecting Policymakers with Stakeholders: The Colorado River Basin Post-2026 Operations Exploration Tool

3/25/2025 10:00 AM PT - 3/25/2025 10:20 AM PT

►Click Here to Watch Recording

Speaker: Natalie Daniels

Abstract:

The Colorado River Basin is the lifeblood to 150 at-risk species, nearly 40 million people, and is a driver of economies, agriculture, and recreation. The operations of the two main reservoirs, Lakes Powell and Mead, impact all stakeholders. The operating agreements of these reservoirs are set to expire in 2026, and the U.S. Bureau of Reclamation is currently leading the NEPA Process to replace them. This decision-making process is especially challenging given current outpacing of supply by demand, often conflicting stakeholder objectives, and deep uncertainty in future hydrologic conditions and water demands. Enabling a wide range of stakeholders to engage with the technical information is key to creating successor guidelines that are robust to the effects of climate change and balance diverse resource priorities (e.g.  environment, hydropower, and water supply). 

To support these objectives, Reclamation partnered with the University of Colorado and Virga Labs to create a publicly available web-based platform on which stakeholders can create and evaluate operational strategies through a Decision Making under Deep Uncertainty framework based on their priorities. The tool features over 100 evaluative metrics, including water quality, invasive fish population growth, and economic value of rafting. This tool represents an advancement in the ability of policymakers at Reclamation to collaborate with stakeholders in the generation and analysis of technical information. The platform is also an example of a successful years-long partnership between a government agency, academia, and private industry to create an innovative tool that is supporting an impactful and transparent long-term planning process. 

Philip Halteman | Principles for Incorporating Indigenous Perspectives and Decision Analysis Approaches in Natural Resource Management

3/25/2025 10:20 AM PT - 3/25/2025 10:40 AM PT

►Click Here to Watch Recording

Speaker: Philip Halteman

Abstract:

Meaningful inclusion of Indigenous perspectives in resource management decisions isincreasingly recognized as a required component of good decision process design andreflects many governments’ commitments to active reconciliation. However, Indigenous and western perspectives can often differ with respect to key aspects of a decision, which can lead to poorly understood impasses and, ultimately, stalled progress. In the Peace Athabasca Delta in Northern Alberta, enhancing ice jam flooding through spring pulse flows has long been identified by Indigenous governments as a key action for supporting broad ecological and cultural restoration goals in the Delta. However, concerns related to flooding in upstream communities have presented barriers to implementing the action.We supported a project involving Federal, Provincial, and Indigenous governments to overcome key barriers to implementation. Through a “decision-sketching” process, we helped the group work quickly and constructively through key barriers related to considering trade-offs and technical uncertainties in deciding whether and when to release a spring flow pulse. Key elements of the decision-sketch approach that enabled success included: encouraging mutual recognition and appreciation of all parties’ concerns, generating and openly evaluating creative (and sometimes controversial) alternatives, building shared understanding of important technical information, clarifying key policy questions and choices, and identifying critical engagement and governance processes.This work demonstrates that these principles and approaches can help overcome barriers in water management decisions through better incorporating Indigenous perspectives alongside decision analysis approaches.

David Martin | Establishing Decision-Making Roles and Responsibilities at a Conservation Organization

3/25/2025 10:40 AM PT - 3/25/2025 11:00 AM PT

►Click Here to Watch Recording

Speaker: David Martin

Abstract:

Clarifying decision making roles and responsibilities is difficult, especially in a matrix organization where teams are dynamic. Likewise, decision making roles and responsibilities are not often recognized as an important part of decision analysis or element of decision quality (DQ). In this presentation, I will reflect on experiences about this topic at The Nature Conservancy, a global nonprofit conservation organization. We implemented two approaches to decision making based on clarifying roles and responsibilities, while considering the elements of decision quality. The first approach was to create lists of possible decisions that different teams might encounter. The second approach was to create Recommend-Agree-Perform-Input-Decide (RAPID) roles and responsibilities for each possible decision. Although using RAPID to identify roles was useful to structure many decisions, we found that it did not cover all possible roles that our decisions required. We also found that standard RAPID responsibilities could be improved with quality inspection features. We made two adjustments based on the limitations. First, we amended RAPID with a ‘counsel’ role and responsibility. Second, we added a DQ scoring rubric for the decision maker to complete with the recommender as well as questions for each role to answer during the decision process. These modifications improved the way we thought about decisions, although with added effort.

Lonnie Chrisman | Advancing Model-Driven Decision Making with AI Assistance

3/25/2025 10:00 AM PT - 3/25/2025 10:20 AM PT

►Click Here to Watch Recording

Speaker: Lonnie Chrisman (Lumina)

Abstract:

AI language models show promise for reshaping how organizations build and refine decision models. In this presentation, I will examine how an AI assistant helps streamline model-driven decision making by guiding problem formulation, structuring influence diagrams, and reducing the modeling expertise required. Through an illustrative, pre-recorded demonstration, I will showcase the potential for AI-based guidance to accelerate model creation, enhance collaboration, and reveal new insights.

Tom Keelin | My AI Friend

3/25/2025 10:20 AM PT - 3/25/2025 10:40 AM PT

►Click Here to Watch Recording

Speaker: Tom Keelin (Keelin Reeds Partners)

Abstract:

My generative AI friend is smarter, more capable, and faster with answers on a broad range of topics than any human I have ever known. We converse daily. I am smarter and more capable as a result. Of course, even one’s best friend can be wrong. So, I still use my own judgment. In this talk, we will discuss which generative AI platform (Apple Intelligence, Chat GPT, Claude, Gemini, …) is best for practical uses. We will also demonstrate and criticize my friend’s decision-support and problem-solution effectiveness over a wide range including: investment decision – should I invest in bitcoin and, if so, how much and through what vehicle; custom image decision – developing and selecting a new website home-page image for the Society of Decision Professionals; sensitive interpersonal decision with long-term consequences – what should a mother do if her daughter is rudely disinvited by her son’s bride-to-be from attending their upcoming wedding; “how to” coding and debugging – what if I don’t know how write the computer code to accomplish my need, or what if my code keeps bombing; mathematical concepts – how can I determine whether an objective function is convex; problems with appliances – how can I stop my home thermostat from heating my house two hours earlier than scheduled; medical advice – efficacy vs side effects of cold remedies or pain relievers. Unlike traditional web or documentation searches, my friend recalls our previous conversations, correctly interprets my questions, and answers them directly.

Jan Beranek | Employing AI Agents to Transform the Future of Work

3/25/2025 10:40 AM PT - 3/25/2025 11:00 AM PT

►Click Here to Watch Recording

Speaker: Jan Beranek

Abstract:

AI agents are transforming the way businesses innovate, operate, and solve complex challenges. This talk explores how Generative AI and autonomous technology are reshaping industries—not just automating tasks but enabling entirely new ways of thinking and creating value.We are going to discover how tools like autonomous innovation apps are replacing traditional consulting models, empowering internal teams to focus on high-impact work, and driving breakthrough innovations. Drawing on real-world examples, we’ll explore how companies are leveraging AI agents to save millions, accelerate decision-making, and stay ahead in a rapidly evolving landscape.Key Takeaways:– Generative AI in Action: Companies are solving complex challenges, driving creativity, and streamlining workflows like never before.– Autonomous Innovation Apps: Tools like FifthRow’s Due Diligence and Regulatory Sensing apps are replacing traditional consulting costs with fixed-price, scalable solutions.– Empowering Teams: AI agents are enabling internal teams to focus on high-value work, automating repetitive tasks and accelerating decision-making.

Lee Failing | Let’s Talk About Values: Raising the Bar for Better Decisions

3/25/2025 10:00 AM PT - 3/25/2025 10:20 AM PT

►Click Here to Watch Recording

Speaker: Lee Failing

Abstract:

Gaining clarity about values and objectives is widely recognized as a foundation of good decision making. However, in the messy, increasingly polarized multi-party decision making processes that are common in resource and environmental management, decision professionals face some unique challenges in getting this clarity. This talk aims to offer both high level insights and practical skills related to:- understanding value-based decision making, why it matters, and how to balance this need with the equally compelling imperative to make evidence-based decisions- developing a shared set of objectives with people who have fundamentally different values, and using this to guide a collaborative decision process- leveling the playing field by hearing all voices and including all relevant values – including intangible values that are typically overlooked- making a dedicated space in the decision process for deliberating about value trade-offs and why that’s so critically important- using decision analysis tools and practices to keep the essential complexity in the conversation - fostering the mindsets that help people work together across difference- the critical role of co-learning and shared understanding - about both facts and values.Our experience is that people with wildly different values can work together and agree on solutions. But only if all relevant values are recognized, respected and addressed in a rigorous way in the decision process. As decision analysts and facilitators, we can learn to apply the principles and tools of our craft to help groups have richer and more productive value-based conversations that support better decisions.

Pat Leach | Insights on Integrating People and Process Quality to Empower Great Decisions

3/25/2025 10:20 AM PT - 3/25/2025 10:40 AM PT

►Click Here to Watch Recording

Speaker: Pat Leach

Abstract:

Throughout the sixty-or-so years of Decision Science/Decision Quality/Decision Analysis as a discipline, its practitioners have often found it difficult to persuade executives, subject matter experts, and other key individuals of the value of a structured approach to decision making. And without the right people, any effort at decision making is doomed to failure. How to convince those people – many of whom have never heard of Decision Science – to become active participants in the process is a challenge for us all.Several concepts are key. First, really listen. People are far more likely to work with you if they believe you understand their problem and their perspective. Second, fit your process to their situation, rather than trying to shoehorn their situation into your process (and maybe don’t even call it a process). Third, understand that your job is not to show the decision maker what the correct decision is; your job is to give her insights that are otherwise difficult to perceive, so that she can make the decision on as well-informed a basis as possible.

Audrey Del Vescovo | A Better Dialogue for Better Decisions

3/25/2025 10:40 AM PT - 3/25/2025 11:00 AM PT

►Click Here to Watch Recording

Speaker: Audrey Del Vescovo (Pragmatic Decisions)

Abstract:

While decisions are controllable, the outcomes are not. Therefore, making quality decisions is critical to improving the chances of good outcomes. The decision dialogue is the final, crucial safeguard against poor quality decisions. The Decision Quality framework, combined with simple priming behaviors, can boost the efficiency, effectiveness and quality of the decision dialogue.

Somik Raha | Values Behind the Value Metric

3/25/2025 12:30 PM PT - 3/25/2025 1:10 PM PT

Speaker: Somik Raha

Abstract:

One of the six requirements for great decisions is clarity on values. In this fireside chat, we will explore why it is important to get clear on the values behind value metrics, how metrics and values are related, and how we can uncover values.

Michelle Florendo | Emotional Intelligence in Decision Making: Turning Perceived Foes into Strategic Allies

3/25/2025 1:10 PM PT - 3/25/2025 2:00 PM PT

Speaker: Michelle Florendo

Abstract:

This interactive session explores the often-misunderstood role of emotions in professional decision-making environments. We'll examine why emotions get a "bad rap" in corporate settings and reveal how they can actually serve as valuable signals pointing to underlying values and needs. Through frameworks, practical tools, and group discussion, participants will gain insights on harnessing emotional awareness to enhance collaborative decision processes rather than suppressing these critical inputs.

Thomas Kehler | Generative Collective Intelligence

3/25/2025 12:30 PM PT - 3/25/2025 12:50 PM PT

►Click Here to Watch Recording

Speaker: Thomas Kehler

Abstract:

This paper describes the result of a long-term effort to create an AI architecture that combines the science of collective intelligence and AI for multi-criteria decision models. Early work on the application of developing causal models of investment decisions was published in a paper accepted for publication in NIPS 2018.1 That work was extended to a general AI architecture for decision intelligence.The system iis based on a Partially Observable Markov Decision Process POMDP using variational Bayesian mechanics as the generalized learning mechanism. The basic structure is to infer a casual decision process model using an adaptive learning strategy. The learning data is obtained via a single-blind, online collaborative process. The model aligns with work done in Active Inference and the Free Energy Principle. The system is learning the collaborating groupʼs (human and AI Agents) Free Energy Minimum—the most likely path to a successful outcome—for any given decision context.The learning model offers a Bayesian approximation model to the law of comparative judgment, commonly known as the A/B test. The system learns and generates a probability distribution relevant to the outcome, specifically a Pareto distribution. This effectively narrows down the choice alternatives by learning the collective preferences. This solution addresses the priority learning problem outlined in Brookʼs law, where the number of communication channels increases with the group size (n*(n-1)/2).The preference learning algorithm builds a Markov model from a sequence of agent prioritization events - agents are presented with a sample and allowed to rank their preferences in response to answers to a question. The evolving Markov model is used to guide the sample selection process. The diagonalized Markov model matrix trace represents the group's ‘resonance modesʼ of choice.

Steve Stein | AI for Organizational Decision Quality 101

3/25/2025 12:50 PM PT - 3/25/2025 1:10 PM PT

►Click Here to Watch Recording

Speaker: Steve Stein

Abstract:

As organizations reach greater levels of maturity in planning and investing in improving the decision process organization-wide, it is becoming more and more important to incorporate a strategy around analytical systems. In order for organizations to excel in decision quality, incorporating AI as a tool has become a standard. Now organizations are employing methods to address specific topic areas that can incorporate AI effectively across the decision cycle. Corporate standards in decision quality now include criteria as to whether AI was employed in the decision process. Therefore decision scientists need to be familiar with categories and mechanics of AI, some of its common uses and how it gets weaved into a more complex business process, even when technical level in the AI programming is novice. It is also valuable to understand some practical examples of how AI has made a difference in organizations.Decision professionals will take away from this presentation a strength in creating strategies for improving the organizational decision process utilizing cutting-edge tools that are available in the AI category of technologies that are critically needed for decision quality to be effective today and moving forward.

Yong Tao | A Decision-Based Approach to AI Governance

3/25/2025 1:10 PM PT - 3/25/2025 1:30 PM PT

►Click Here to Watch Recording

Speaker: Yong Tao

Abstract:

The advent of artificial intelligence (AI) offers tremendous benefits but also causes widespread societal unease. The public is deeply concerned about AI because we have not found a robust solution to rein in AI in case of needs. Recent AI legislations are mostly risk-based, they are adequate at identifying and assessing AI risks but fall short in effectively controlling such risks.This research will arm legislators through the lens of decisions to require AI developers with deep knowledge to build minimum but necessary brakes inside AI to prevent and reduce AI risks, educate users to apply AI wisely, and calm down public fear through a fundamentally newapproach to effective solutions to AI risks we urgently need to address. By examining the core decision elements and processes of both humans and AI and exploring potential human intervention mechanisms based on the solid foundations of decision sciences, we expand the solution space for controlling AI risks to include the crucially important subspaces within the AI system itself. This allows us to develop a systematic framework forcomprehensive AI legislation that fundamentally controls AI risks at the decision steps where the danger originates. Together, the controlling mechanisms inside AI, the AI governance infrastructure, and the mitigation of spillover AI risks form the pillars of a sound AI legislation that can effectively and efficiently rein in AI risks to the greatest extent humanly possible.

Peter Wood | Simple, Scalable Tools & Techniques to Define an Appropriate Frame

3/25/2025 12:30 PM PT - 3/25/2025 12:50 PM PT

►Click Here to Watch Recording

Speaker: Peter Wood

Abstract:

Without an appropriate frame in place ‘any path will do’ and teams will find it harder to make choices between alternatives. With a clear Frame that communicates the purpose, perspective and scope it makes decision-making efforts quicker and easier.We must recognize and effectively implement the art of achieving alignment on a well-defined frame, one that is commonly understood by the business sponsors, stakeholders, and the team. Only then can we reliably evaluate the opportunity or problem.

Reidar Bratvold | Impacts of Uncertainty on Decision-Making

3/25/2025 12:50 PM PT - 3/25/2025 1:10 PM PT

►Click Here to Watch Recording

Speaker: Reidar Bratvold

Abstract:

Uncertainty is inherent in every decision—whether in business, personal life, or public policy choices. Many organizations invest heavily in data collection and analysis to reduce uncertainty, believing that less uncertainty leads to better decisions and, consequently, better outcomes. However, effective decision-making is about ranking alternatives based on a criterion (such as expected NPV), not about making precise predictions. We only need enough information to choose the best option, which rarely requires a precise forecast.There is also confusion between predictions and decision criteria, such as expected value. Decision-makers think they need a single prediction to make a decision and thereby often confuse that decision criterion with a prediction of what will happen – they ‘expect’ the expected value to occur, even though there is an infinitesimally small chance that it will – and because they fail to recognize the uncertainty associated with the ‘prediction’ they under-value plans and designs to react to uncertainty as it is resolved over the course of a project.This talk will illustrate these challenges and demonstrate how to make consistent, high-quality decisions under uncertainty.

Kent Burkholder | Decision Focused Project Management

3/25/2025 1:10 PM PT - 3/25/2025 1:30 PM PT

►Click Here to Watch Recording

Speaker: Kent Burkholder 

Abstract:

Delivery problems in large projects are well documented. Many individual decisions need to be made, and the number of decisions and their connectedness can make the assurance and delivery of those decisions time consuming and complex. A decision-focused project roadmap can be used (1) to map out the complexities between decisions and build a more achievable delivery plan and (2) to agree the project governance and assurance plan to reduce the burden on both decision-makers and the team. What are the steps? First, map the project decisions in order, noting dependencies. Then identify the deliverables required for each decision, note the activities needed to create the deliverables, and update the project schedule accordingly. Then layer your organisation’s governance policies onto the timeline and identify constraints. We are looking for situations where “everything goes to the CEO” and/or where the team is burdened with extra assurance steps that can be combined or eliminated. Lastly, agree specific changes to the project governance to alleviate those constraints, reduce the burden on the organisation, while maintaining a focus on decision quality.

Reframing Decision-Making in Uncertain Times: Indigenous Knowledge Systems, Reciprocity, and Relational Science

3/25/2025 12:30 PM PT - 3/25/2025 12:50 PM PT

►Click Here to Watch Recording

Keynote Speaker: Shandin Pete (Assistant Professor, of Teaching in the Earth, Ocean and Atmospheric Sciences Department at the University of British Columbia)

Abstract:

In an era of increasing uncertainty, the decisions we make regarding our environments carry profound consequences. There is a call to challenge conventional approaches to strategy and decision-making by examining the perspectives of systems grounded in land-based knowledge. Specifically, an expanded examination of Indigenous understandings of relationality and reciprocity may offer valuable insights into navigating complexity, fostering resilience, and highlighting ethical and sustainable choices.

Through stories of land, people, and ecosystems, an exploration is engaged to offer a more complete look at Indigenous communities that have long engaged with uncertainty through adaptive practices and a deep understanding of interconnected systems. By recognizing the nuanced exchanges that shape ecological relationships, we can expand our frameworks for relating to environmental and strategic planning.

An invitation is offered to decision-makers to reflect on their own approaches, exploring how principles of reciprocity and relational science can inform corporate, governmental, and global strategies. An attempt is made to broadened perspective on collaborative decision-making while providing a consideration of Indigenous knowledge, not only as a source of insight but as a transformative guide for navigating today’s challenges.

Day 2

KEYNOTE SPEAKER | CHRIS O'RILEY:   CEO, BC Hydro

March 26, 2025 8:30 AM-9:30 AMPT

►Click Here to Watch Recording

TITLE: How Well Does Decision Analysis Support Decision-Making: A CEO’s Perspective

ABSTRACT: BC Hydro must navigate multiple, and often competing objectives when making long-term capital investments amid uncertain electricity demand, a shifting legal landscape, and evolving market forces. Chris O’Riley, CEO of BC Hydro, shares his reflections on how decision analysis presented to the executive team does - and sometimes doesn’t - help them tackle complex decisions and value trade-offs.

Community Capital Dashboards and Digital Twins for Sustainable Cities

►Click Here to Watch Recording

Speaker: Mark Roseland

Abstract:

Community capital frameworks have been used with resounding success in various community types around the world — large, small, rural, urban, developed, developing. These frameworks resonate with very different communities because they encourage people to think strategically and systemically about values, existing capacity, and potential long-term impacts of specific policies, programs, and projects – a critical advance in sustainability innovation.  Furthermore, they help communities with few financial resources to recognize their wealth in other forms and become inspired to organize for community change.  Roseland have introduced the Community Capital Compass as a guide to navigating community change. Focused on sustainable community development, our Community Capital Lab is operationalizing the Compass as a decision-support dashboard available for every US state and county.Recent innovations in digital twin technologies add exciting new possibilities for the Community Capital Compass.  However, there is a growing digital divide between a relatively few larger, well-resourced cities and the more numerous smaller cities, towns, villages and tribes that cannot afford to access these technologies.  How can we use these tools to promote sustainable community development for all?  We are incorporating pilot digital twin initiatives in AZ and in FL, with the aim of democratizing access to these digital technologies and thus greatly expanding access to civic tech solutions that help communities address pressing community sustainability challenges.  Our efforts are designed to result in outcomes that amplify digital proficiency and inventive solutions, heighten community involvement, and bring about enduring sustainability initiatives.

Lyle Walker | Using the RAPID� Framework to Enhance Collaborative Decision-Making for Shared Transportation Objectives

►Click Here to Watch Recording

Speaker: Lyle Walker

ABSTRACT: 

The RAPID� framework, developed by Bain & Company, helps streamline decision-making by assigning clear roles: Recommend, Agree, Perform, Input, and Decide. TransLink, the regional transportation authority for Metro Vancouver, has begun using the RAPID� framework in several processes. RAPID� improves transparency, reduces churn, addresses conflict and issues before going for a decision and ensures that decisions are made more efficiently, even in complex, multi-stakeholder projects.We have found RAPID� to be instrumental in development of workplans and execution of decision processes and working more effectively both internally and with external partners.This session will explore key lessons learned from using the RAPID� framework in a public sector setting, including:-  Why focusing on the ""Recommend-Agree-Decide"" roles (or RAD) for the focus decisions is usually sufficient for high-level work planning-  How clear decision roles and use of a Structured Decision Support approach inform development of engagement strategies with the inputers.-  How identifying agreers reduces churn and avoids expectations of consensus-  When to adapt decision making roles as the process and nature of some of the alternatives evolves-  How to build capacity for decision making role clarityBy clarifying roles and using structured processes, the RAPID� framework supports more efficient and collaborative decision-making processes.

Max Henrion | Wildfires and Gas Explosions: Helping California Utilities Mitigate the Risks

►Click Here to Watch Recording

Speaker: Max Henrion

Abstract:

California utilities have been in the news for the wrong reasons. The 2010 San Bruno gas pipeline explosion killed 8 people and destroyed 38 houses. The 2018 Camp fire ignited by a faulty electric transmission line, destroyed 18,000 structures including the town of Paradise, killed 85 people, and bankrupted PG&E. What should utilities do to reduce these risks? Is it cost-effective to underground 10,000 miles of line, as PG&E has proposed?The California Public Utility Commission required utilities to use a measure called Risk-Spend Efficiency to prioritize risk mitigation projects, based on a complex multi-attribute decision framework. We created a simpler and more transparent framework to represent the preferences of ratepayers’ rather than the utilities. It offers a cost-benefit framework with clearer tradeoffs between safety, reliability, and cost – for example, using the value of a statistical life used by Federal agencies and perceived customer cost of outages for reliability. The new framework driven by benefit-cost ratios was developed in an extended public collaborative process involving utilities, intervenors representing ratepayers, technical consultants, and the Commission. The Commissioners voted the new framework into law. It now guides utilities on how to select the most cost-effective portfolio of projects to mitigate risks to California ratepayers.Key insights include:· A cost-benefit approach is sometimes simpler and easier to justify than a conventional multi-attribute framework· Even on fraught issues with major socio-technical complexity and conflicting stakeholders, an effective collaborative process can produce effective

Geoff Osler | Framing, Framing and Re-Framing! Framing Overall Goals in the Association of Canadian Mountain Guide’s Training and Assessment Program

►Click Here to Watch Recording

Speaker: Geoff Osler

Abstract:

Mountain Guiding is fraught with uncertainty and risk due to exposure to changes in weather, conditions, and human factors. Furthermore, the number of important decisions over a day of guiding can be overwhelming. A sound process that is underpinned by a clear frame is critical.Training mountain guides in Canada presents the same challenges, along with others. Ultimately, instructors teaching on the courses are responsible for the safety of all the participants in an exam group. Still, they are not in the lead and must give the student leader the space they need to demonstrate their abilities. In other words, the instructor is driving from the backseat and has to choose carefully when, how, and if to intervene. In addition, there is the need to provide good training and ensure that standards are being met. You can see how the decision-making process can be unique and challenging!Instructors must be adaptable, adjusting the frame course to course, day to day, and even decision by decision. This adaptability is crucial, but it must always align and be anchored with the overarching goals set by the Association’s leadership to ensure consistent risk management and curriculum delivery. This can be a tricky balance.We’ll illustrate the framing process that we’ve been using and discuss some of the challenges we’ve had implementing it.

Ellen Coopersmith & Sam Vardy | To Pilot or Not to Pilot - Making the Business Case for New Technology Pilot Plants in the Circular Economy

►Click Here to Watch Recording

Speaker: Ellen Coopersmith & Sam Vardy

ABSTRACT: 

As new technologies are developed, how can companies best decide whether to pilot, and if so, at what scale? Historical data of new technology plants suggests a high risk of underperforming. Gaps in Basic Data and the characteristics of the technology are key factors in deciding technology development requirements. Without complete consideration of these factors, the process development may lack critical tests to close the gaps in Basic Data and undermine the commercialization effort. Building a pilot plant is a big decision. Pilot plants are purpose-built facilities designed to gather basic data for a process that is not commercially proven. Even relatively simple pilot plants are expensive and take many months to design and build before the first data is produced. However, forgoing a piloting step and going directly to commercialization scale may result in major performance shortfalls of the full-scale facility. This presentation discusses the results of a jointly developed IPA – Decision Frameworks case study which evaluates the impact of different pilot designs using a classic value-of-information approach and IPA new technology plant performance data. The case study focuses on a new technology process with two new steps. Different pilot designs, from a small-scale pilot to a fully integrated pilot provide basic data at different levels of reliability. Value of Information analysis was used to evaluate the benefits of derisking the technology with the different pilot designs. IPA’s database includes measures of success for commercially launching new technology with and without pilots.

Laura Keating Elske | Tips and Tricks to Help Go Fast

►Click Here to Watch Recording

Speaker: Laura Keating Elske

Abstract:

When collaborating for better decisions, it is important to make the best use of everyone’s precious time. Rapid prototyping, a well-established technique for structured decision making (SDM) in natural resource management, offers a powerful approach for accelerating SDM processes, and its benefits extend beyond this field. Decision-making is inherently iterative, and demonstrating the value of SDM early through rapid prototyping helps stakeholders quickly see tangible outcomes. This not only boosts engagement but also increases the likelihood of continued participation and the future application of SDM processes. By showcasing quick, actionable insights, rapid prototyping fosters trust in the process and enhances decision-making efficiency, making it an invaluable tool for a wide range of decision professionals.

Amy Day & Michelle Florendo with Lee Failing, Brian Putt & Bruce Judd | Decision Education Across the Spectrum: A Panel Discussion

►Click Here to Watch Recording

Speaker: Amy Day & Michelle Florendo with Lee Failing, Brian Putt & Bruce Judd

Abstract:

This panel will explore the expansive and often unrecognized landscape of Decision Education, highlighting how many professionals are already contributing to this field without explicitly realizing it. The discussion will cover approaches ranging from K-12 touniversity settings, extending into personal, societal, and professional development, to illustrate how pervasive and integral decision-making skills and education are across various domains.Highlights:1. Recognition of Existing Contributions: Emphasizing how attendees might already be involved in decision education through their current roles and activities, potentially without their explicit awareness.2. Diverse Educational Settings: Insights into decision education initiatives in K-12, higher education, and professional development.3. Real-World Applications: Examples of successful decision education strategies that have led to measurable improvements in decision-making skills.4. Broadening Impact: Discussion on how decision education can be evangelized and expanded beyond traditional educational settings to reach a wider audience.Objective: To showcase the breadth of decision education and inspire attendees to recognize their own roles within this critical field, encouraging them to consider how they can intentionally incorporate these strategies into their own contexts to maximize impact.

Amy Day & Michelle Florendo | How to Talk So They Will Listen: Interactive Session

Speaker: Amy Day & Michelle Florendo

Abstract:

This 40-minute interactive workshop, led by Amy Day and Michelle Florendo, will focus on improving how decision-making professionals communicate with diverse audiences to enhance understanding and engagement. The session is designed to help participants refine their approach by emphasizing empathy, understanding pain points, and adapting their language to resonate with their listeners effectively. It addresses a critical gap in decision-making: the need for meaningful conversations that highlight the necessity of tools for effective decision-making. Highlights: 1. Identifying the Communication Gap: Discussion on how the primary challenge isn’t the lack of decision-making tools, but rather the crucial conversations that make stakeholders realize they need these tools. 2. Interactive Format: The session will engage attendees in practical exercises to practice real-time adjustments in their communication strategies. 3. Audience Engagement: Techniques to identify and address specific audience needs, focusing on creating compelling narratives around decision-making processes. 4. Empathy and Connection: Strategies to foster empathy with stakeholders to ensure communication is not just heard but also appreciated and acted upon. Objective: To empower decision-making professionals to bridge the communication gap by conveying the value of decision tools effectively, leading to better understanding, cooperation, and implementation of decision-related initiatives. Participants will leave with their next step in bridging the communication gap.

Elayne Ko | When Inputs are Hard to Come By

►Click Here to Watch Recording

Speaker: Elayne Ko

Abstract:

The use of decision analysis is frequently accompanied by a quantitative cashflow-based evaluation to inform late-stage pharmaceutical drug development investment decision. Currently, cashflow-based decision analytic models rely on subject matter experts within cross-functional teams to provide and/or to approve the quantitative inputs such as revenue from commercial, development costs from finance, risks (probability of technical and regulatory success) from clinical, and timelines from project management.To strive towards decision quality, the decision analysts make a concerted effort to 1) ensure the quantitative inputs are consistent with the decision frame, such as, the target medicine profile, the clinical development plan and 2) collaborate with the cross-function team members to obtain the inputs. However, several factors may contribute to the challenges of obtaining much-needed inputs to complete the quantitative evaluation, which may be a required component of the business case to be reviewed with management at the investment decision-making meetings.The decision analysts can explore various approaches to resolve the input gaps, e.g., leverage previous projects as analogue in combination with sensitivity analyses, to make progress towards completing the cashflow-based decision analytic models to facilitate the decision to fund a late-stage project.

Brian Putt | Knowing Chance of Critical Paths Enable Managing your Project Better

►Click Here to Watch Recording

Speaker: Brian Putt

Abstract:

A Cost and Schedule Risk Analysis (CSRA) tells the PM  the range of uncertainty in the cost and schedule, but doesn’t necessarily assist in identifying what is important for management to focus on. Management needs the chance (probability) that a task is on the critical path and the sensitivity of that task. A tornado diagram can help management understand the sensitivity of the overall completion time using P10 and P90 of the uncertainty of each task. The Chance of being on the critical path and the sensitivity of each variable  are then plotted on an XY graph. Management can then focus on those tasks with the highest chance of being on the critical path with the highest sensitivity.

Juan Ribes | Stochastic Multicriteria Decision Making

►Click Here to Watch Recording

Speaker: Juan Ribes

Abstract:

When considering stochastic multicriteria decision problems, analysts are interested in solutions that consider the decision maker profile including the decision maker's attitude towards Corporate risk.The most frequently used method to consider this part of the decision maker profile is Utility Theory. While this theory is perfect from a theoretical context, it is difficult to use when real decision problems arise. This difficulty comes from the effort required and validity of the utility function determined for the decision maker. This is by nature personal and changeable. Stochastic Multicriteria Optimization offers several approaches for solving problems, starting with stochastic efficiency concepts that can be aligned with situations and the degree of risk aversion of a decision maker. Using a stochastic approach allows the association of each aversion degree/reason towards risk, from risk neutrality to extreme risk aversion, a stochastic efficiency. In so doing, we save the individual education/evaluation process for each individual's utility function. This method provides a simpler, faster way to incorporate Risk Utility into our decisions.

Justin Schell | All Roads Meet at the Capital Model

►Click Here to Watch Recording

Speaker: Justin Schell 

Abstract:

Existing methods for measuring financial capital capacity and assessing risk-return trade-offs in the healthcare industry are inadequate. They fail to accurately capture enterprise uncertainty, limiting the ability to make informed investment decisions and hindering strategic planning for growth and risk management. Regulator risk-capital regimes in particular fall short of properly measuring uncertainty within an enterprise financial plan.The challenge comes from the need to build a financial model where all the roads of uncertainty in an organization meet.  One that incorporates uncertainty information from across an enterprise (and even external to the enterprise) into one comprehensive view.  There is an additional challenge of building a model that is flexible & scalable enough to examine strategic decisions and avoid it collapsing under its own weight.Building modular financial models powered by Coherent Stochastic Data in the Open SIPMath Standard is a method to overcome these limitations; allowing organizations to measure financial capital capacity and risk-return trade-offs. These “Lego Block” financial models are constructed from packets of stochastic data representing Lines of Business (LOBs) along with a Required Economic Capital (REC) framework allowing organizations to accurately measure enterprise uncertainty.  Furthermore, they can seamlessly integrate external data from business partner models to incorporate the best of their modeling into enterprise uncertainty.Ultimately, this modular approach allows organizations to build a comprehensive view of financial risk capacity in the form of an economic capital (ECap) model that allows them to power enterprise-wide strategic decisions with rick-conscious decision-making.

Sri Vaidyanathan | Leveraging Decision Quality for Effective Circular Supply Chains: A Decision-Led Approach

►Click Here to Watch Recording

Speaker: Sri Vaidyanathan

Abstract:

 In today's world, resources are becoming scarcer, and the burden of using these limited resources needs to be reduced. To address this, a shift from linear to circular supply chains is essential. These systems are complex, involving many stakeholders, reverse logistics, and changes to product design and business models. Circular supply chains aim to eliminate waste, use resources efficiently, and create closed-loop systems where materials and products are reused, refurbished, or recycled. This requires a new way of thinking about value creation in businesses.A structured and practical decision-making approach is essential to manage these complexities. Decision Quality (DQ) principles provide a systematic method to accelerate the transition to circular supply chains. DQ encompasses several key elements: reframing problems to uncover innovative solutions, balancing competing objectives, and improving data quality for better decision-making.Reframing can reveal new opportunities in the circular economy. For example, instead of viewing end-of-life products as waste, they can be seen as valuable inputs for new production cycles. This shift encourages business models and design strategies that focus on resource recovery and reuse. Balancing competing goals in circular models is also crucial. Clarifying values related to environmental impact, economic viability, operational feasibility, and social responsibility supports better decisions.Critical data needs for circular supply chain decisions include information on material flows, lifecycle impacts, and stakeholder engagement. Improving data quality involves addressing data collection challenges in complex, multi-stakeholder environments and finding innovative solutions for supply chain transparency.Case studies from the EU-funded DiCiM project, such as pay-per-use washing machines and circular automotive parts (e.g., tires, steering wheels, headlights, and sprockets), illustrate how DQ principles can be applied in real-world scenarios. These examples demonstrate how a decision-led approach can drive the transition to circular supply chains, benefiting both businesses and the environment

Michelle Wellsbury | The System Dynamics of Power to Liquid Projects

►Click Here to Watch Recording

Speaker: Michelle Wellsbury

Abstract:

The Challenge: Power-to-liquid (PtL) fuels and products (e.g. Sustainable Aviation Fuel, e-Methanol, Green Ammonia) are produced via combination of green hydrogen (created from electrolysis of water using renewable energy) with waste CO2. These projects are a key component of the energy transition but face significant commercial and technical hurdles which require innovative solutions and a robust decision-making process.Unlike traditional energy projects, PtL developers often start with a blank sheet of paper in terms of the facility design, product pathway, and even choice of the final product. This presents a significant challenge, in terms of decision quality, since the answer to these questions is not immediately apparent. The decisions involved are complex, inter-linked and affected by factors both within and outside the developer’s control, and even by the rapidly changing regulatory landscape.io consulting will present how they are solving the intricate dynamics of PtL projects, supported by innovative system modelling and Decision Quality.DQ Embedded in System Modelling:- io’s dynamic emerge software allows developers to analyse and screen the entire PtL value chain solution space, including energy source optimisation, hydrogen production sizing and design, hydrogen storage, energy storage, PtL pathway(s) and product storage and offtake.- Inherent in the design of emerge is collaboration in the technical, commercial and environmental aspects of a project. Technical modules simulate and optimise the flow of electrons and molecules. The commercial module uses a large database of facility and component costs. The environmental module simulates the emissions performance across the facility lifecycle ensuring RFNBO compliance. A system solver links the three modules, which optimises the design for the lowest levelised cost of production.By embedding fundamentals of Decision Quality within our tools and processes, we are helping to unlock more projects and accelerate the energy transition.

Mike Benefiel & Mauricio Davidovich | Minimum Functional Objectives for Value of Information

►Click Here to Watch Recording

Speaker: Mike Benefiel & Mauricio Davidovich 

Abstract:

Participants in Value of information (VOI) exercises often focus on maximizing uncertainty reduction over the value of the learning opportunity.  A simple, yet effective, pathway for assessing value while preserving mathematical rigor uses Bayes’ theorem to compare S-curves without new information (prior) to those with new information (posterior).  This allows visualization, understanding, and validation of accuracy assessments.  The result is a more informed discussion of trade-offs.  The proposed pathway leverages the Minimum Functional Objectives (MFO) approach to decision-making.  This cost-disciplined, value-focused approach leverages the knowledge and experience of subject matter experts (SMEs) and encourages iteration and the use of incremental economics to support information gathering decisions.For many VOI opportunities, two decisions are critical:  “go/no-go?”, and, if “go”, “small or bigger?”  MFO is well suited for prioritizing what is most important.  By initially focusing exclusively on the “go/no-go” question, participants and decision makers can clearly see the value of opportunities to inform that decision.  The second question is only essential when “go” is always the decision.  Our example considers drilling an appraisal well to inform development decisions.  Multiple well locations are considered along with potential learning opportunities at each location.  SMEs from several disciplines work to agree on assessments and how different information outcomes have the potential to change future decisions. Focusing on the “go/no-go” decision first, our approach encourages thinking about starting small and staging to capture value more quickly and efficiently – or stopping if outcomes are negative.  Visualizing prior and posterior S-curves help SMEs to test their logic and to understand the consequences of what different outcomes will imply.  This approach not only improves decision quality but also promotes stakeholder alignment and makes the decision-making process more transparent.

Walter Kosi | Adopting Decision Quality: OMV’s Integrated PowerApp for Effective Decision-Making in Exploration

Speaker: Walter Kosi

Abstract:

In 2024, OMV significantly advanced its Decision Quality (DQ) and Analysis practices, establishing them as essential tools for addressing complex exploration challenges. DQ involves an iterative dialogue process to achieve high-quality decisions, engaging various stakeholders from diverse disciplines. This structured and transparent framework ensures comprehensive stakeholder involvement, regardless of their familiarity with DQ principles.OMV views DQ primarily as a cultural initiative, with tools designed to support rather than drive the process. Effective workshops with decision makers and project teams are crucial, and the orchestration tool facilitates this efficiency. Historically, OMV utilized applications like Treetop, DTrio, and PetroVR for decision quality, but also relied on static Excel sheets and PowerPoint presentations, which were administratively burdensome to maintain. To streamline and standardize the decision-making process, OMV developed a PowerApp integrated with Microsoft Office applications, complementing the existing DTrio workflow.This process orchestration tool includes a project and decision register, automatic decision worksheet creation, an action item register, and orchestrates the main steps of a decision dialogue process. It supports the evaluation of the six elements of decision quality and centralizes input from decision facilitators and the project team, e.g. through a hosted issue solicitation form. Additionally, it visualizes projects, decisions, action items, and decision milestones on an automatically generated Gantt Chart. By keeping all information evergreen in one place, it simplifies look-back analysis, avoiding the dispersion across various documents.The implementation of this app has proven beneficial in refining DQ processes, offering flexibility and structure, and facilitating high-quality decision-making within OMV.

John Mark Agosta | The Bayesian Promise: Integrating Decision Analysis and Data Science through Bayesian Methods

►Click Here to Watch Recording

Speaker: John Mark Agosta

Abstract:

Decision Analysis (DA) and Data Science  teams often operate at cross-purposes,  using distinct frameworks.  This work demonstrates how current machine learning methods can be applied in a principled way to Decision Analysis. For example, machine learning methods do not make the prior explicit, but directly estimate posterior predictive distributions. Estimating likelihoods instead avoids this confounding.  Extending well-known textbook examples, such as value of information analysis, with estimation of likelihoods illustrates how this is possible. The result is a novel analytical approach that combines software tools that solve influence diagrams with Bayesian statistical methods. This advances the computational aspects of  Decision Analysis, aligning it with contemporary evidence-based practices.

Max Henrion | What's the Real Decision? Electrifying Trucks via Telematics Data

►Click Here to Watch Recording

Speaker: Max Henrion

Abstract:

As data scientists and decision analysts our job is often to help our clients find more useful decisions. A truck manufacturer wanted an analytical tool to help fleet managers decide how to electrify their fleets. They shared large volumes of telematics data recording for each truck and wanted to know which trucks are best suited for replacement by electric vehicles. But, that turned out to be a useless question. Rather, they must decide which trips are best suited for electric vehicles.

Eva Roa | Make Better Decisions With Data: Using Decision Analysis to Grow Analytical Maturity

►Click Here to Watch Recording

Speaker: Eva Roa

Abstract:

Deciding the right projects for your DS team is crucial for the growth of your team and to increase the analytical maturity of the teams you support. We’ll go over a few frameworks that lay out how you can better structure the work load of your DS teams in a way that increases the value of DS within your organization.

Discussion: Integrating Data Science and Decision Analysis in Today’s Tech

Day 3

KEYNOTE SPEAKER | STEVE BEGG:   Emeritus Professor, Decision-Making & Economic Evaluation, University of Adelaide

►Click Here to Watch Recording

TITLE: Biases: identification, mitigation and their value-destroying impacts

ABSTRACT: Uncertainty, novelty and complexity lie at the heart of many decisions, and DA offers a range of “tools” for dealing with them. But these “tools” are only as good as their inputs. Years of behavioural research show that our brains are just not wired for good reasoning in these situations. We are subject to a variety of hidden biases, rules-of-thumb and judgmental errors that lead to poor decisions and thus worse outcomes than might otherwise be achieved. In particular, uncertainty is not a major problem per se, rather, it is the range of biases and flawed judgements that it opens the door to. This talk will highlight some of the most common, value-destroying biases and show how a cognitive science perspective can offer practical suggestions for avoiding or mitigating them. It will be illustrated by the results of research on 250+ technical professionals, whose jobs have a large element of uncertainty/risk, novelty and complexity. Subject matter expertise does not offer any protection from bias, and in some cases can even amplify it.

Reidar Bratvold & Tom Keelin | A Bayesian Reference Class Forecasting Approach Using Joint Metalog Distributions

►Click Here to Watch Recording

Speaker: Reidar Bratvold & Tom Keelin 

Abstract:

Probabilistic forecasts often suffer from biases, typically leading to optimism and overconfidence. This results in benefits being overestimated, schedules and costs underestimated, and an overly narrow range of forecasted outcomes. In decision analysis, unbiased probability assessments are essential, as biased forecasts result in biased decisions, ultimately reducing the value promised when the investment decisions are made.Reference Class Forecasting (RCF) has been proposed as a solution to these biases. RCF, by adopting an "outside view," is effectively de-biasing forecasts compared to traditional, model-based methods, thereby supporting high-quality decision-making. However, despite its proven effectiveness and simplicity, the adoption of RCF has been limited. Many experts prefer more complex model-based approaches such as Monte Carlo simulations, ensemble methods, and machine learning, which are perceived as more rigorous because they use well-established numerical approaches and account for project-specific details (the "inside view").To address this challenge, we introduce a Metalog-based Bayesian approach that integrates reference class information with model-based forecasts. In this approach, the Bayesian prior is informed by the reference class, while the project-specific forecasts serve as likelihood functions, reflecting detailed project data. The Metalog distribution offers virtually unlimited shape flexibility, allowing for close matching of empirical distributions and generating continuous forecast updates as new data becomes available. This methodology was tested on real-world oil mega-projects, demonstrating that it removed bias from the original forecasts.Our findings suggest that the Bayesian RCF approach performs as well as, if not better than, classical RCF. Moreover, it offers distinct advantages, including increased transparency, flexibility in balancing the reference class with project-specific information, and a consistent statistical framework. We believe this approach may bridge the gap between those who rely on more complex model-based approaches and the benefits of adopting RCF, encouraging broader adoption, unbiased forecasts, and reduced bias-driven value destruction.

Marc Bond | Cognitive Biases and the Value of Exploration Assurance to Mitigate

►Click Here to Watch Recording

Speaker: Marc Bond

Abstract:

The human brain is a wondrous but flawed instrument. The ability of one’s brain to problem solve is immense. However, research has shown that, it is an imperfect engine. This adaptation has led to instinctive, intuitive, and emotional based techniques for problem solving and decision-making.These heuristic methods speed up the process of finding a satisfactory solution with little effort. Many times, these methods serve us well and lead to a satisfactory outcome. However, they also can lead to irrational behaviours, misguided interpretations, and poor decisions, otherwise known as cognitive biases. These biases allow for simple conclusions but often introduce systematic and repeatable errors. Due to the complicated nature of many businesses, several situations require more thorough analysis and critical thinking rather than the simplest and fastest route to a decision.The oil and gas industry, for example, is full of highly creative and intelligent people, leading to some outstanding successes. As decisions are often made in highly complex and uncertain situations, cognitive biases have occasionally led to costly decisions. Although some of this can be credited to technical failings, motivational biases, or circumstances beyond our control, often they can be attributed to cognitive biases.There are several mitigation strategies. One of significance is adopting and adhering to an assurance process. Exploration assurance helps to ensure consistent, objective, and independent evaluation on exploration project characterization and decisions. Left to the individual assessor or team, the predicted outcomes are often inconsistent and inaccurate. While the assurers themselves certainly can fall prey to cognitive biases, their independence from the work and wider perspective can shield them from some of the biases associated with prospect ownership or local management influence. Validation of technical assessments by exploration assurance has been shown to contribute to consistent and predictive portfolio management, and thus improved business performance.

Michael Doane | NLP-based Optimization of Success Estimates for Neuroscience Programs

►Click Here to Watch Recording

Speaker: Michael Doane

Abstract:

Return on investment in the pharmaceutical space has declined over the past two decades. Pharmaceutical R&D organizations are highly reliant upon measures of probability of success (POS) to calibrate value expectations for programs in development. However, it can be very difficult to adjust POS in a consistent and objective manner in order to appropriately calibrate risk expectations. The situation is compounded in the field of neuroscience, where unique risks such as blood-brain barrier penetrance and unique toxicological concerns exist. While organizations may employ expert elicitation as a tool for these adjustments, those activities require significant time and resources. This project, completed in partial fulfillment of requirements for the Doctor of Engineering degree at George Washington University, seeks to streamline this process and remove subjectivity in the development of estimates of POS for neuroscience indications. Comprehensive trial information data sets from ClinicalTrials.gov were matched to their respective individual trial outcomes based on the Clinical Trial Outcome dataset developed by Gao, et al. Natural language processing was then employed to develop a predictive model of POS across phases, training on both broad and neuroscience-only indications. POS predictions for neuroscience indications were then made on subsequent trials that were not part of the training sets, and these were evaluated to determine the level of prediction improvement relative to industry benchmarks, using accuracy, recall, precision, and F1 score.

Jeff Joyce | A Socratic Approach to Decision Making – A Modern Tool-based Approach

►Click Here to Watch Recording

Speaker: Jeff Joyce

Abstract:

Decision making is often undermined by confirmation bias, that is, a tendency to search for, interpret, choose, or recall information in a way that supports a particular conclusion.  The quality of decisions can be improved using the methods of Socrates, a philosopher of ancient Greece who relied on probing questions to explore and guide the critical thinking of his students. Known as the Socratic method, the teachings of Socrates foreshadow a modern approach called Eliminative Argumentation for countering the influence of confirmation bias. This is especially beneficial in the case of collaborative decision-making involving multiple individuals/ organization whose stake in a decision might not be entirely aligned.Eliminative Argumentation is a method invented by researchers at Carnegie Mellon University to improve the quality of decisions made about safety risk associated with complex technology such as driverless cars. This method can be used for other kinds of decision-making in business, government and industry. A graphical notation is used to represent decisions in a tree-like structure called an argument, where this argument is developed in support of a particular decision.  Arguments capture the threads of critical thinking that connect a decision with supporting evidence that cover multiple facets of the decision-making process.  At the heart of this approach is Socratic thinking that challenges elements of this structured argument with doubts or uncertainties that are often framed as “what if ?” questions.  The decision-making process is completed by additional argumentation to eliminate doubts and uncertainties, as much as this is possible.A software tool called “Socrates” is used to operationalize this approach to decision-making.  Use of Socrates relieves stakeholders of the tedious and error-prone burden of sorting through email inboxes and multiple copies of spreadsheets to understand the real-time state of a decision in progress.

Carl Spetzler | DQ at the Heart of Civil Discourse

►Click Here to Watch Recording

Speaker: Carl Spetzler 

Abstract:

In our current highly fractured society, Civil Discourse on controversial topics is a rarity. Our field provides a paradigm that can be the heart of civil discourse: Clear separation of preferences from alternative points of view; dedication to unbiased information; prediction of consequences based on sound reasoning; and a systematic dialog process to reach clarity before making up our mind. The skills to facilitate Civil Discourse are the same as those needed to be an effective Decision Professional. The need and hunger for such discourse seems palpable all around us. This presents an opportunity for us to be of service beyond our traditional decision consulting activities.

Nathan Block | Willful Wisdom: Building Practical Wisdom for 21st Century Challenges

►Click Here to Watch Recording

Speaker: Nathan Block

Abstract:

Effectively addressing issues such as climate change and rapid deployment of AI requires not just better decisions, but wiser decisions – decisions that better account for the broad range of considerations inherent in world’s use of energy.  A scientific study of wisdom has emerged and is providing educational models and practical tools that can promote wiser decisions. Making higher quality, more ethical, and wiser decisions about global challenges is of such import that it is time to fulsomely integrate the insights of these sciences.  To this, we must add an orientation toward a common good and a long-term, future focused perspective — generativity.  With that structure, wisdom can become phronesis – practical wisdom - and translate to an ability to encounter new situations and make high quality, wise decisions. The base is formed from a cognitive-focused model grounded in an awareness of the multiperspectival nature of complex situations, the limitations of one’s own knowledge, and the unpredictability of the future.  From there, insights from decision sciences are blended with those from the academic study of wisdom to outline a model for making wiser, more ethical, high-quality decisions.   This talk is based on a paper entitled, “Willful Wisdom: Harnessing Insights from Decision Science Toward Wiser Decision-Making on Climate Change and Energy Transition”  54 St. B. Tex. Envtl. L. J. 1 (Spring 2024).   https://www.texenrls.org/wp-content/uploads/2024/09/telj_54n1_text_low.pdf

Jennifer Harrington & Jim Driscoll | Decision Leadership: Insights, Opportunities, and Implications

►Click Here to Watch Recording

Speaker: Jennifer Harrington & Jim Driscoll

Abstract:

As decision professionals, we speak constantly about Decision Quality and Decision Analysis. Both DQ and DA are well-defined within our community and the benefits of using them are clear, however many leaders remain unaware and/or unmoved. In debating what to do about this at Intel, a group of decision professionals had a key insight: it was necessary to move ""upstream"" and redefine the very concept of leadership against the backdrop of decision-making. From this foundational work, a distinctive view of the meaning of leadership emerged that includes such points as:-  Decision making is a fundamental unit of leadership-  Leaders have to not only work in the “system”, but also on the system of decision making-  Decision leadership connects with organizational healthBy sharing their insight with other SDP members, Intel’s DA’s have helped the idea of “Decision Leadership” gain traction within our professional society. But SDP still lacks a common view of what Decision Leadership actually is, what it takes, and the implications of embracing it. Intel's Center for Decision Leadership shares their unique perspective on Decision Leadership, how it can help both leaders and their teams, and the surprising new opportunities and challenges it creates for our profession.

Eric Johnson | Litigation DA Case Study

►Click Here to Watch Recording

Speaker: Eric Johnson

Abstract:

An analysis was performed for the senior management team of "Queens", which was facing issues concerning IP litigation in various venues, alliances, M&A, and business operations. 100 interviews were conducted with C-suite members which encoded their expertise in a belief net with dozens of variables.  Assessment of legal expertise was difficult because explicit specification of a numeric probability might lead to liability issues, the outcomes of some variables are "soft" and not well defined, and assessment of future enterprise value in a variety of possible situations was complex and information-intensive.Methodologically, we found that:Modeling the value implications of ultimate outcomes explicitly and then analyzing such valuations from the point of view of information known at a previous time point gives a helpful assessment of stock values along the way.Using verbal terms for probability and asking that they be situated along a line that we interpret probabilistically allows quantitative analysis without requiring explicit numeric assessment.Using constructed verbal scales with simple point-count scoring attached to the terms gives a useful way to characterize soft concepts like management distraction or distributor concerns.Using discretized conditioning scales allows two-dimensional assessments to be tractable and comprehensible.Substantively, we found that Queens' operational and balance-sheet strength gave substantial negotiation leverage, but that timely settlement was necessary.Informed by this analysis, Queens settled the litigation promptly and tripled the value of its stock.

Ulf Andresen, Subhas Das & Oro Awaritefe | Navigating Dynamic Environments in the Execute Phase of the Whale Deepwater Mega Project

►Click Here to Watch Recording

Speaker: Ulf Andresen, Subhas Das & Oro Awaritefe

Abstract:

Whale is a multi-billion dollar deepwater mega project that entered its execution phase after the Final Investment Decision (FID) in 2021, aiming for startup late 2024. While the ideal scenario is to maintain a "no change mindset" post-FID, external dynamic factors can necessitate changes to manage risks and preserve project value.Traditionally, the Management of Change (MOC) process governs changes during execution, involving a small team that ensures safety, compliance, and operability through a formal review and approval process. Practiced for decades, this piecemeal approach is efficient in delivery but often leads to limited articulation and ownership of ideas potentially leaving value uncaptured.For the Whale project, the MOC process was enhanced by integrating the Decision Quality (DQ) framework, involving a broader participation across disciplines. This inclusive approach expands the range of alternatives and ensures comprehensive decision-making taking risks and inter-dependencies into consideration, whether changes are reactive or elective. Despite initial challenges originating from cultural resistance and unfamiliarity, the DQ process has proven effective in minimizing rework and fostering value-based decisions beyond mere cost and schedule considerations.As the project neared its final year, a significant risk emerged, prompting the team to adapt quickly to protect the startup date and resolve conflicts. The DQ mindset, practiced throughout the project, made critical decision-making elements—like framing, identification of alternatives and value trade-off analysis—second nature. This facilitated data-and logic-driven discussions for critical decisions.The presentation will highlight practical examples, such as prioritizing pipelay vessels across overlapping offshore construction activities under uncertain weather conditions, where nominal burn rates can reach up to $2 million per day for offshore vessels. This approach underscores the importance of robust decision-making in complex project environments.

Phil Bradshaw | But What Did We Learn? Mapping the Process and Products of Collective Learning from Collaborative Planning

►Click Here to Watch Recording

Speaker: Phil Bradshaw 

Abstract:

As a decision-aid, collaborative planning has proven successful in getting disparate groups and organizations to work together to select management actions that address the wicked problems that come with water management. Once management actions are implemented, monitoring programs then collect the data that are used to inform and update these management actions over time. One of the assumed benefits of the collaborate-monitor-update prescription is that collaborative groups learn collectively about aquatic ecosystems and how to improve management decisions. However, collective learning in water planning has been understudied and requires more research if we want to realize the full potential of collaborative processes. Collective learning is both a process and a product and is influenced by factors inside and outside the control of water managers. We follow a collective learning framework to identify, analyze, and map the process, products, and influential factors of learning that occur when groups follow a collaborate-monitor-update pathway. We use BC Hydro’s Water Use Plans (WUPs) as our case study context. BC Hydro’s WUPs have followed the collaborate-monitor-update process for the past 20 years. Our findings from 31 semi-structured interviews with WUP participants suggest that participants are more likely to learn about institutional processes and the actors involved under conditions of collaborative planning, but are less likely to learn about social-ecological impacts of management actions. Further, even with sufficient financial resources and supportive legal conditions, turnover in personnel and changing environmental conditions alter carefully designed monitoring programs and their intended results. Water managers can increase collective learning by encouraging informal communication practices and embracing adaptive management as a journey not a destination.

Steve Begg | Accurate Football Tournament Outcome Probabilities Through Monte Carlo Simulation

►Click Here to Watch Recording

Speaker: Steve Begg

Abstract:

Have you ever wondered what Monte Carlo simulation is or why you should use it?  Or thought that it might be difficult or time consuming?  Let's “lift the lid” on the (oft-called) black-box of Monte Carlo simulation (MCS), to show that there is nothing much there, and dispel some misunderstandings.  But what is there, is very useful and robust.  Key takeaways, illustrated by the application to football tournaments, are:- MCS calculates the uncertainty in model outputs as a function of your uncertainty in its inputs.  For many complex, “real world” situations it is often the only, or most-practical, way to do so.- The method is very simple and quick - essentially “brute force and ignorance” and, as such, it is very hard to make mistakes.- For many models, “best estimates” of inputs will not produce the correct “best estimate” of their output!  Similarly for percentiles, expected values, etc.  You need to take account of the input uncertainty.- You do not need data (frequencies) to assign input probabilities for MCS.  It could be most useful when you don’t have any!- You cannot judge the accuracy of a probability from the actual outcome of the event it refers to – multiple events of similar probability need to be compared against a reliable, observed frequency.- Simple models of uncertainty, even of complex systems, can produce accurate probability of their outcomes.

Erik Schneider & Diana Del Bel Belluz | Advancing Decision Quality: The Decision Capabilities Benchmarking Model

►Click Here to Watch Recording

Speaker: Erik Schneider & Diana Del Bel Belluz

Abstract:

The post-COVID reset, culture wars and the advent of generative AI have all impacted how organizations make decisions. How have these changes impacted organizational decision-making? Our Decision Capabilities Benchmarking Model is a novel framework designed to evaluate just that. Successfully tested with clients pre-COVID, we’re updating it for use by decision-making professionals in the new era. Comparative Analysis and Model Differentiation Our model goes beyond traditional frameworks to examine decision factors such as decision dialog, quantification, external stakeholders and lookbacks. This multidimensional approach results in practical insights across diverse organizational settings, including: ● Risk Management vs. Bias Awareness (balancing analytical assessments against psychological decision factors) ● Framing vs. External Stakeholders (revealing gaps between internal focus and external engagement) ● Collaborating to Align vs. Decision Governance (assessing governance in regards to collaboration) ● Learning Organization vs. Lookbacks (highlighting unfit training and gaps in feedback mechanisms)● Decision Dialogue vs. Risk Quantification (showing relative emphasis between data and discussions around it)Collaboration and Benchmarking InitiativeCentral to our initiative is a collaborative benchmarking effort, and we seek the support of SDP in distributing the survey to its members to ensure the robustness and accuracy of its findings. A comprehensive analysis would benefit all facets of the decision-making community, ensuring the model's relevance and effectiveness. We further invite SDP attendees to engage with the model's conceptual framework and potential applications, encouraging contributions that will refine and enhance its utility.

Wayne Borchardt | Empirical Evidence for the Relationship Between Company Profitability and Decision Quality

►Click Here to Watch Recording

Speaker: Wayne Borchardt 

Abstract:

Empirical evidence for the relationship between decision quality and company performance has been elusive. Our regression results now show a robust, statistically significant confirmation of what we all suspected: Decision quality is indeed positively related to company performance.PwC’s 28th annual Global CEO Survey was conducted in late 2024 and collected the responses of 4,701 CEOs across all major industry sectors and 109 countries. The survey findings yield a strong connection between the profitability of companies and their mindsets and practices for strategic decision making. Specifically, our regression analysis found that companies who score in the top quintile of a decision-quality index created from the survey data have almost 30 percent higher industry-adjusted profitability than the others.Although we cannot make a causal claim, these findings have implications for CEOs who are likely unaware of the extent to which decision quality mindsets and practices are associated with better performance. Their leadership in instilling decision quality in their organizations might have profound effects.

Jim Driscoll & Jordan Stephens | Enabling DQ/DA Skill-At-Scale

►Click Here to Watch Recording

Speaker: Jim Driscoll & Jordan Stephens

Abstract:

Acquiring the skills of a decision professional isn’t easy. Many of us “never went to school for this,” and instead have had the good fortune to learn our craft from gifted colleagues, via intense self-study, and/or through years of trial and error.After over a decade teaching DQ/DA skills via traditional classroom methods - only to see those programs disrupted by the pandemic - the team within Intel's Center for Decision Leadership asked a critical question "how can we develop true DQ/DA skills in as many others as possible, at scale, and with limited resources?" Their answer is an innovative skill-building program that: Leverages the research on what makes learning “sticky” and promotes the acquisition of new skillsUtilizes automation to reach as many Intel employees as possibleHelps many individuals who wouldn’t or couldn’t take advantage of more traditional teaching methods get started on their DQ/DA learning journey Keeps learners active, engaged, and feeling supported.

Charles Persinger | Collaborating With and Leveraging Others at Lilly to Enable Decision Quality

►Click Here to Watch Recording

Speaker: Charles Persinger

Abstract:

The number of “Decision Professionals” is limited compared to the vast number of decisions that could benefit from achieving “Decision Quality.” At Eli Lilly and Company, a small group of trained Decision Professionals has successfully broadened their impact within the Research and Development organization by leveraging collaboration. This approach includes training, tool development, embedding best practices into business processes, and fostering a decision-making culture. As a result, the group has significantly extended their reach, enabling Decision Quality for a higher volume of decisions and achieving Organizational Decision Quality. This success was recognized with the Raiffa-Howard Award from the Society of Decision Professionals.

Tobias Muller | Optimizing Decisions in Equinor: an Approach to Collaborative Subsurface Decisions

►Click Here to Watch Recording

Speaker: Tobias Muller

Abstract:

High-quality decision making is crucial to Equinor, a leading international energy company with deep roots in the oil & gas industry and with growing development into the energy transition. To deliver on our strategy “always safe – high value – low carbon”, decision makers are confronted with conflicting objectives. Additional challenges and complexities arise from uncertain outcomes, a vast amount of data and dispersed teams. In this context, we need efficient methodologies to make robust and structured decisions while correctly handling uncertainty. Equinor has acknowledged the challenge and recently initiated a research project to support decision making for subsurface area development using Decision Quality.Equinor’s Decision Optimization R&D project is on a journey to embed Decision Quality within the subsurface domain. This is not just about adopting a methodology and tools, but also about shifting towards an integrated, efficient and collaborative decision-making process based on well-established concepts of Decision Quality. During our first pilots, the application of framing and structuring in decision-making processes has shown clear benefits of organized collaboration and communication. The need for a new software tool to support the implementation of the Decision Quality framework and the structured decision-making process in a collaborative environment was identified. The tool aims at facilitating collaboration, knowledge sharing, and benchmarking, ultimately modernizing decision deliveries and is currently under prototype development by Equinor.

Ben Cattaneo | Decision Quality in the Polycrisis Era: Rethinking Organisational Decision-Making Practices

►Click Here to Watch Recording

Speaker: Ben Cattaneo

Abstract:

Today’s world is defined by interconnected crises (geopolitical upheaval, climate change, technological disruption, and societal polarisation). This makes many traditional organisational decision-making practices inadequate. The concept of a “polycrisis,” where multiple, interconnected crises unfold simultaneously, requires organisations to transform their decision-making practices to navigate this landscape.This session explores the essential role of Decision Quality (DQ) in reshaping organisational frameworks to meet the demands of the polycrisis era. Many current practices, grounded in linear, symmetric, and discrete approaches, fall short in addressing the asymmetric, complex, and interconnected nature of modern challenges. This includes traditional risk management, strategic planning, and more worryingly, newer approaches to ESG and sustainability.By contrast, this talk will advocate for changes in decision-making practices, integrating both quantitative and naturalistic methods with experimental mindsets. It will also address the cultural and structural barriers organisations face in adopting these more holistic approaches. It will advocate for DQ to become far more accessible to individual leaders and policy-makers.Through real-world examples and case studies, this session will demonstrate the pitfalls of outdated decision models and highlight actionable steps for overcoming organisational resistance, mitigating biases, and embedding decision quality at the core of transformation efforts. Attendees will leave with practical insights on how to build robust, adaptive decision practices suited to today's volatile world.The urgency of the polycrisis era demands a shift in thinking. This talk will provoke new thinking and share practical approaches. It is appropriate for the areas of Innovation and Organisational Transformation/Evolution.

Chris Spetzler | Meeting Ron Howard's Challenge in Delivering Decision Skills

►Click Here to Watch Recording

Speaker: Chris Spetzler

Abstract:

Ron challenged us to teach more than just "DQ light”, to help every individual understand powerful concepts like conditional probability. Common sense DQ is accessible, even inspirational, in a short session  of 60-120 minutes. Stretching for deeper lessons, such as probabilistic reasoning in the face of uncertainty, requires greater time and intention. Decision Professionals can rely on high quality media, materials and delivery models developed by DEF to meet the rewarding challenge of working with educators, parents and youth.

Jeremy Alexis | Building a Decision Quality Capability at Illinois Tech

►Click Here to Watch Recording

Speaker: Jeremy Alexis

Abstract:

Illinois Tech is pioneering a Decision Quality (DQ) capability to enhance institutional decision-making, integrate DQ principles into the curriculum, and extend expertise to external stakeholders. This initiative is structured around three key workstreams: Internal Capability Development, Curriculum Integration, and External Outreach and Services. Internally, we have started intensive training, with a two-day session for academic leadership and a 12-week course focused on analysis, with participants spanning faculty, administration, and industry partners. A major case study on the future of graduate housing is underway, engaging top university decision-makers to demonstrate the DQ process. Additionally, DQ principles are being embedded into committee facilitation, strategic planning, and faculty decision-making processes. Curriculum integration efforts include the development of three structured DQ modules—DQ Overview, DQ Analysis, and DQ Consulting—to support Illinois Tech’s core curriculum redesign. To further strengthen applied learning, DQ tools are being created for integration into project-based courses such as interdisciplinary workshops, capstones, and co-ops. Externally, Illinois Tech is expanding its impact through an esteemed Board of Advisors, a webinar series, and online DQ learning resources in collaboration with leading organizations. The Center aims to achieve key milestones, including embedding DQ into high-level university decisions, securing financial sustainability, integrating DQ modules into undergraduate programs, and establishing Illinois Tech as a national leader in decision-making excellence. By measuring our success against benchmarks such as webinar engagement, institutional partnerships, and strategic planning outcomes, we are positioning DQ as a transformative force in education, leadership, and decision science. Finally, we will measure our success against benchmarks of the Raiffa-Howard award, charting our progress over the next three years as the center becomes embedded in our culture and systems.

Ali Abbas & Carl Spetzler | Integrating Ethics into Decision Curriculum

►Click Here to Watch Recording

Speaker: Ali Abbas & Carl Spetzler

Abstract:

Frequently, Decision Analysis is taught as an amoral subject. However, Illinois Tech is committed to teach Ethical DQ as an integrated subject. We start with the framework presented in Ethics for the Real World by Ron Howard and Clint Korver and then extend it to Societal/Organizational behaviors as developed in Ethical Decision Quality by Ali Abbas. With nine student contact hours we will cover the basic distinctions of legal/ethical/prudential and help students identify their own ethical codes. In addition, we will teach them how to assess the ethical quality of a decision, how to do identify common ethical decision traps, and how to assess and build an ethical decision culture . The course segment will increase student awareness of the most common ethical failures and how to make decisions that avoid them. Numerous real life examples will be presented.

Laura Keating Elske | The DQ Curriculum at the U.S. Department of the Interior

►Click Here to Watch Recording

Speaker: Laura Keating Elske

Abstract:

The U.S. Department of Interior's Decision Analysis Certification Program was co-developed by the Fish and Wildlife Service and the U.S. Geological Survey in an effort to raise awareness about the importance of decision quality in natural resource management (NRM) and build agency-wide capacity in the skills and tools of Structured Decision Making. This talk will provide an overview of the program and the associated Community of Practice, with particular emphasis on how the curriculum has been uniquely shaped by its scientific and NRM roots within the U.S. Federal Government. Success, challenges, and future opportunities for the program will be presented through the perspectives of both student and instructor.

SDP Hero Awards

Each year, the society awards a select few individuals or teams Hero awards in acknowledgement of their achievements in transforming and growing our profession and society. We therefore ask that you please take a moment to nominate candidates for the following awards:

Pioneer Award
Inspirational Achievement Award
Early Career Excellence Award
Community Service Award
Distinguished Service Award

Ron Howard Dedication

Ron Howard’s unparalleled contributions to the field of Decision Analysis and his profound impact on countless lives deserve a heartfelt tribute. This reflection honors his remarkable journey and celebrates the enduring legacy he leaves behind.