CAN SPECULATIVE EVIDENCE INFORM DECISION MAKING?

BY: Anab

Our work investigating potential and plausible futures, involves extensively scanning for trends and signals from which we trace and extrapolate into the future. Both qualitative and quantitative data play an important role. In doing such work, we have observed how data is often used as evidence, and seen as definitive. Historical and contemporary datasets are often used as evidence for a mandate for future change, especially in some of the work we have undertaken with governments and policy makers. But lately we have been thinking if this drive for data as evidence has led to the unshakeable belief that data is evidence.  


“Evidence is just a special kind of data. Data becomes evidence when it stands in a particular testing relationship with a hypothesis.”

Brendan Clarke. Lecturer in History and the Philosophy of Medicine at University College London.

 

So, why is data being consistently conflated with evidence? As new business models have emerged which commodify data; from Google to Facebook, Uber and Amazon, the paradigm of data capital has firmly rooted itself in our collective consciousness. Big data can be a powerful tool for the good of society, but data is not evidence, and the rise of the use and misuse of big data in policy has risen in parallel with its more commercial deployment.

The drive to collect data and our increasing ability to not just draw connections and analysis from it, but to use the data to train systems, means we need to think through this carefully. With the best of intentions, we may programme our biases into these new systems. By conflating data with evidence, and forming important decisions based on that data, many challenges emerge. Some quick questions that come to mind: 

 

  1. What about what we cannot measure? e.g. The failure of political polling to adequately account for “shy voters” and measure voter preference in the run up to the recent American presidential election and the Brexit referendum.
  2. We have the information, so why are we still not doing anything about it?
  3. Where is the data generated, who generates it, and what are the generator’s and the interpreter’s inherent biases?
  4. Can we rely on using data as our main source of evidence while surrounded by so much uncertainty and change?

 

We know evidence comes in a variety of forms. Legal and forensic evidence, or perhaps scientific, anthropological or ethnographic evidence easily spring to mind. We are aware of the terms evidence based policy (EBP) or evidence based medicine (EBM), but outside of the disciplines and professions that utilise these practices, how can more organisations and companies utilise evidence to determine their policies, products and futures?

Practitioners from anthropology, ethnography, social sciences and many other disciplines often practice using qualitative data as a research tool. Here, lived experiences, artefacts, and the stories of people’s lives become evidence. These disciplines and their forms of evidence acknowledge the messiness of reality, they acknowledge the difficulty of having to rely on an analysis that is more challenging to quantify. We need to take the risk to listen to and embrace anecdotal evidence, and confront what is happening on the ground floor.

If the examples mentioned previously can be used as evidence to inform policy, and product development today, to what extent can this evidence also help inform decisions we make about the future? In our work we think a lot about evidence, and “make, create, and construct” evidence that is speculative in nature.

These speculative forms of evidence are created not only from deductions taken from data, but from weak signals, ethnographic observations, and the stories of people’s experience. Based on this rich tapestry we create “speculative evidence” from multiple futures, that people can see, touch, listen, and even breathe. For instance we have literally created speculative evidence for a fictional court case Dynamic Genetics vs Mann in which a body of evidence is used to build a case focused on the “theft” of genetic material. For the Future Energy Lab we worked with the Government of the UAE we created air, products, and services from the future in response to econometric data supplied by the Ministry of Energy.  And for our project Muto Labs we collected anecdotal evidence from professionals within the finance and investment industries to determine a potential future for data trading, roboadvisory and the blockchain.

In each of these cases, speculative, yet concrete forms of evidence have become powerful catalysts for directly informing energy policy, product innovation, and new business models. Invariably, these forms of evidence also lead to organisational reflection, and an opportunity to understand the implications of an increasingly accelerated world.

Based on our learnings from this kind of work, we are developing methods for generating frameworks that help extrapolate from such future-facing evidence back into the present, to help transform decision making today.

We want to develop mechanisms for constructively translating speculative and experiential evidence into adaptable policy and systems change.

 

If you are interested in exploring this with us, we would love to hear from you.

SUPERFLUX

Somerset House Studios, London UK
hello@superflux.in
All rights reserved © 2017. No. 6601242

Web Design > SONIA DOMINGUEZ
Development > TOUTENPIXEL

We'd love to hear from you

New projects
Internships
General enquiries

Studio M48,
Somerset House Studios,
New Wing, Somerset House,
Strand, London, WC2R 1LA

Title By Date
TED 2017: WHY WE NEED TO IMAGINE DIFFERENT FUTURES Anab Autonomous systemsBiotechCity & InfrastructureClimate ChangeIoT, Data & Civics 19.06.2017
CAN SPECULATIVE EVIDENCE INFORM DECISION MAKING? Anab IoT, Data & Civics 31.05.2017
STUDIO NEWS: TED, MAPPING, FOOD COMPUTERS, AND THE FUTURE OF WORK. Jake Autonomous systemsCity & InfrastructureClimate ChangeIoT, Data & Civics 21.04.2017
BACK TO THE FUTURE: WHAT WE DID IN 2016 Jake Autonomous systemsCity & InfrastructureIoT, Data & Civics 31.01.2017
REALITY CHECK: PRESENTING AT UNDP SUMMIT Jon IoT, Data & Civics 06.12.2016
MITIGATION OF SHOCK JOURNAL Jon Autonomous systemsBiotechClimate Change 12.07.2016
STUDIO HAPPENINGS Anab Autonomous systemsClimate ChangeIoT, Data & Civics 04.07.2016
PROFESSORSHIP AT THE UNIVERSITY OF APPLIED ARTS VIENNA Anab 28.06.2016
HIGHLIGHTS FROM 2015 Anab Autonomous systemsCity & InfrastructureIoT, Data & Civics 30.12.2015
SUPERFLUX MAGAZINE, ISSUE 1. Anab Autonomous systems 21.04.2015
THE DRONE AVIARY JOURNAL Anab Autonomous systems 09.04.2015
IOT, DRONES AND SPACE PROBES: ALTERNATE NARRATIVES Anab Autonomous systemsIoT, Data & Civics 01.03.2015
AUTUMN NEWS Jon City & InfrastructureClimate ChangeIoT, Data & Civics 08.11.2014
ASSISTIVE TECHNOLOGIES AND DESIGN: AN INTERVIEW WITH SARA HENDREN Anab 07.11.2014
A QUARTERLY UPDATE FROM THE STUDIO Anab Autonomous systemsBiotechCity & InfrastructureIoT, Data & Civics 11.05.2014
IN THE LOOP: DESIGNING CONVERSATION WITH ALGORITHMS Alexis Autonomous systems 04.04.2014
IOTA WINS NOMINET TRUST FUNDING Jon IoT, Data & Civics 25.10.2013
SAILING THE SEAS OF SUPERDENSITY: GUEST POST BY SCOTT SMITH Scott City & Infrastructure 19.10.2013
DNA STORIES: GUEST POST BY CHRISTINA AGAPAKIS Christina BiotechClimate Change 30.09.2013
PRESS RELEASE: DYNAMIC GENETICS VS. MANN Jon Biotech 01.08.2013
AN INTRODUCTION TO INFRASTRUCTURE FICTION: GUEST POST BY PAUL GRAHAM RAVEN Paul City & Infrastructure 24.06.2013
SUPERNEWS, VOL 1. Jon 08.04.2013