Connecting scientific evidence to policy-making is a non-trivial process. Evidence can be conflicting, incomplete, or inconclusive, obscuring the ability of policy-makers to apply this information. Likewise, policy-makers may not be receptive to information, or can be constrained in the choices that they are able to make. More than this, scientific evidence almost never compels any particular policy direction, rather providing insights into potential benefits, costs and risks of action. This difficult but important relationship is well recognised by UK Government, with many organisations in place to help facilitate conversation between researchers and policymakers.
One of these organisations is the Government Office for Science (GO-Science), who make sure that UK government departments have access to scientific advice and evidence to inform their policy-making. An important part of this is the Foresight programme, which looks forwards to identify opportunities and challenges that might affect the UK in the near future. Every year GO-Science chooses 2 or 3 different topics to investigate, producing a report and raising awareness of how government could use evidence to positively influence the UK.
One of Foresight’s most recent projects is ‘The Future of the Sea’, which is due to be published this year. The project is looking to understand the ways in which the UK interacts with the sea, how that might change in the future and how Government can act to sustainably support the people, organisations and industries involved.
Early in the project GO-Science approached us to understand if we could work with them to organise and rationalise their initial research, and to design a stimulus that visualises the responsibilities of different UK Government departments and agencies in relation to the Sea. The idea being that by synthesising and presenting research in an engaging and accessible way, interactions between foresight researchers and policy-makers would be more focused and fruitful, easing the relationship between policy and evidence.
Our starting point for this work was the initial research that GO-Science had done into the different interests that the UK has in the sea. This includes a diversity of concepts such as maintaining biodiversity and supporting coastal tourism, marine industries, port infrastructure, shipping, and the development of new technologies for ocean mapping. All of these related but distinct interests needed to be represented, with meaningful links being highlighted wherever possible. As important was finding a way to represent the responsibilities of different government departments and organisations.
Our goal was to produce something that would simplify the complexity of the interactions between people government, and marine, maritime and coastal activities without dumbing down or removing important detail. The aim was that this would facilitate conversations about how government is currently organised and how it could change, but also stand alone as a picture of UK sea governance.
Draft illustrations showing ideas for visualising links between concepts
We began by organising the interests into those that were more similar to one another or more different based upon different guiding principles. For example we experimented with grouping by the geographical location of the interests - in, across or by the sea. Another principle was the intended purpose of the interest such as extracting resources, or protecting biodiversity. We then drew and defined connections between groups, such as dependencies or beneficial relationships.
After a few iterations trialling out different organising principles, we decided with GO-Science to use a simple structure based around a flow of interests grouped into understanding, planning and working. Each group is dependent on the activities of the previous one.
Understanding — Interests with a purpose of monitoring and research on the sea, coastal and marine environments, climate or human activities related to the sea. These activities also include efforts to analyse this data.
Planning — Interests related to planning and regulating economic, environmental or security activities based upon the information gathered in ‘Understanding’.
Working — Diverse marine, maritime and coastal interests to sustainably benefit from the sea, and to protect the UK’s ability to continue to do this. The flow begins once more as there are efforts to monitor and understand the impacts of these activities.
This structure allowed the UK’s interests to be described as collectively working towards one of 3 high level goals: Marine and Coastal Environments and Mitigating Climate Change; Providing Marine, Maritime and Coastal Security to the UK; and Sustainable Marine and Maritime Economic Growth. For each of these goals we produced a visualisation showing the major industries, regulations, departments and people involved.
We then tested out the diagrams with representatives from different government departments. Based upon their feedback we iterated and improved the designs. Most significantly we made sure that it was possible to use the three diagrams together to show a whole picture of UK sea governance.
Cover and overarching structure from our Future of the Sea report
As our first experience designing a tool to facilitate science policy discussions, this project proved to be a really useful learning experience for us.
Government is an enormous and complex organisation, with numerous ways of dealing with cross departmental topics such as the sea. To have a full understanding of this requires significant effort. We found that attempting to communicate this visually can serve a useful purpose in helping people to access the topic, and to discuss ways in which governance can be proactive to future challenges and opportunities.
One of the biggest challenges was in pitching the level of detail correctly. Different departments have different levels of interaction with the sea, as well as different understandings of whose responsibility certain activities are. It is likely near impossible for a representation to be perfect from all perspectives.
We found that it is precisely this difference of opinion that this type of work can help to bring out in the open. The process of presenting people with a picture of what we thought they and others do resulted interesting discussions around governments role in the sea. The diagrams give people a chance to react to something, focusing discussion and highlighting opportunities for relationships between departments.
This blog post is part of a series on our Good Problems team. Each post looks at a different step in the process of designing a funding programme and makes suggestions about how to optimise to achieve a greater impact.
If you work at a funding organisation, this question should be familiar to you. Do you set up a funding call, launch a challenge prize or run a hackathon? Do you hold a workshop to familiarise people with the problem or use a crowdsourcing platform to reach a broad range of potential solvers?
In the first post of the series we talked about the advantages of identifying a good problem. In the second post we looked at the added value of understanding the skills, resources and motivations needed to solve the problem. This third and final post is about using this knowledge to design a suitable incentivisation approach.
There are many ways to incentivise problem-solving. Some more common than others. The suitability of each approach will depend on the problem and the community of solvers.
An incentivisation approach is a way of trying to motivate and support people to come up with solutions to a problem.
If people are not aware of the problem, they will need time to understand it and develop the motivation to work on solutions. If they are already working on solutions, they may need extra resources to achieve a breakthrough. That is why incentivisation approaches are so diverse. Here are a couple of examples:
Funding Calls / Grants: These are funding mechanisms that involve organisations offering financial support – and increasingly feedback and mentoring – to those interested in developing solutions to a specific problem. The problem can be defined either by the funder or the applicant (see the Humanitarian Innovation Fund’s open Core Grants or specific WASH funding calls).
Challenge prizes / Inducement prizes: These are prizes that offer a reward to the person or team who can first or most effectively meet a defined challenge. The prize can include a monetary reward, mentorship, or access to facilities and investors (see Nesta’s Challenge Prize Centre or InnoCentive).
Sandpits / Idea Labs: Sandpits (or Idea Labs in the US) are residential interactive workshops that bring together participants from across disciplines to work on addressing specific research challenges. The outcomes of a sandpit are not pre-determined, but are defined during the event (see EPSRC’s approach to designing sandpits).
Workshops / Conferences: These are a little bit different. While neither are funding mechanisms per se, they can help raise awareness of a problem and generate interest in solving it. Conferences tend to be larger and focused primarily on encouraging an exchange of ideas and forming new collaborations. Workshops can be more hands-on, with time allocated to working in groups to explore a problem and develop ideas (see our lessons from designing a workshop on Surface Water Drainage for the Humanitarian Innovation Fund).
Hackathons: Short and intense events where designers, developers, entrepreneurs and people with specific domain expertise collaborate on building projects that can help solve a defined problem (see Startup Weekend).
Crowdsourcing platforms: Online platforms where people can contribute with ideas, collaborate on projects, provide feedback and help shortlist top ideas to solve a problem (see OpenIdeo).
Innovation Labs / Accelerators / Incubators: Programmes designed to support entrepreneurs or teams develop their early-stage ideas into fully-fledged products and services that can solve problems. The support offered can include mentorship, money, co-working facilities, training, and access to potential partners and investors (see Bethnal Green Ventures or UNICEF Innovation Labs).
These approaches are not mutually exclusive, nor are they the only ones available. You can launch a funding call through a workshop or have the top ideas coming out of a crowdsourcing challenge attend an accelerator programme. The important thing is to choose an approach that matches the problem that you want to focus on.
How do you know which approach to use and when?
In our previous post we outlined three roles a funding organisation can play – help build a community of solvers, expand it by bringing in new people and ideas, or support it by giving solvers relevant resources. Each of these roles will require a different incentivisation approach.
Here’s our interpretation of how the above incentivisation approaches map onto these three roles:
If a funder is looking to build a community of solvers, then workshops, hackathons, or crowdsourcing platforms can be relevant approaches. Although different in form and structure, these approaches are useful at drawing attention to little known problems or significant emerging ones, encouraging conversations around them and motivating people to work on solutions.
If the aim is to expand a community of solvers, funders can explore the possibility of setting up challenge prizes, sandpits, workshops, or make use of crowdsourcing platforms. Core to these approaches is encouraging collaborations between people or teams with different backgrounds and skills. Their aim is to bring on board new perspectives or domains of expertise that can challenge held expectations and provoke new ways of thinking.
If a funder is looking to support a community of solvers, approaches like funding calls, innovation labs, incubators or accelerators can help them achieve this goal. These approaches focus on offering wide ranging support to problem-solvers such as funding, mentorship, access to facilities, users and investors, as well as partnerships or contracts.
Having a rough idea of what your funding organisation needs to incentivise – whether it’s building, expanding, or supporting a community of solvers – represents an important starting point to designing an approach that can have a genuine impact.
It’s also useful to know that the boundaries between these approaches are very loose. It is often the case that in the process of ‘choosing’ a suitable approach you end up creating a new format – one that is tailored to the problem and its solvers.
Any incentivisation approach you choose will need to be adapted. This is where knowledge about the problem and the community of solvers comes in.
The motivations of solvers, their available resources and the level of risk they’re willing to take should all shape the approach.
For example, if you’re designing a challenge prize, this information can help you define the criteria for a winning solution or the size of the reward. If you’re designing a crowdsourcing call, it can help you understand how to best articulate the problem to ensure a broad reach and diverse response. For a workshop, it can help you define the goals of the event and identify key attendees who need to be part of the conversation.
Each incentivisation approach will have its own defining features. The design of these features should reflect the problem, as well as the needs of its solvers.
In the end, an incentivisation approach is not just a way of flagging up a problem that needs to be solved. It’s about creating an engaged and adequately resourced community around that problem.
After creating an initial version of the approach, it’s time to test it with potential solvers. The aim of this step is to find out whether the approach is appealing, supportive and relevant.
Appealing: Is the approach engaging and motivating? Is it likely to attract the people and collaborations needed to build impactful solutions?
Supportive: Does it offer problem-solvers the necessary support to start developing impactful solutions? Is it inclusive and accessible to those who could add value to this process?
Relevant: Will this approach and the resulting ideas actually help solve the problem?
A quick way to figure out the above is to ask likely participants: ‘Would you take part in this?’. If the answer is ‘No’, understand why not and keep iterating the approach until the answer is ‘Yes! Where do I sign up?’.
Measuring and demonstrating the impact of a funding programme is never going to be an easy or clear cut process. But being open, transparent and deliberate about the process of designing such a programme can help maximise its potential for impact. To support this claim, we highlighted three areas where funders should focus their efforts:
Identify a good problem. Focus on problems that are real, worthwhile, timely, engaging and suitable for your organisation to prioritise.
Understand the skills and collaborations needed to come up with constructive ideas. Understand who are the people and communities able to work on solutions, what motivates them and what might limit their involvement. This will help you define your role in this process – are you building, expanding or supporting a community of solvers?
Design an incentivisation approach that motivates and supports people to build solutions. This is not just about choosing an approach that best meets a set of criteria, but about building an environment where people can think in different ways and explore new ideas and collaborations.
We introduced the above as three separate phases. In practice, they’re most likely to occur in parallel and shape and inform each other. For instance, it’s not unusual to have clients ask us to find good problems that can be solved through a specific incentivisation approach or in a given timeframe. ‘The problem’ may not always be the starting point for the design of funding programme, but it is a core component.
The aim of this series is to encourage funding organisations to design programmes that address real problems and actively engage with solvers as part of this process. Organisations able to deliver such considerate funding programmes are not only improving the likelihood of getting problems solved, but they are also creating a community of solvers who are motivated, engaged and feel part of a valuable and impactful process.
Science Practice’s interest in synthetic biology goes back to the Arsenic Biosensor Collaboration, and recently we were back in Jim Haseloff’s lab to learn about a new development called cell-free synthetic biology. This technology made headlines when it was used to create a low-cost, paper-based diagnostic test for the Zika virus. We’re interested in paper-based diagnostics (see SoilCards) and portable technology that could enable lab analysis in the field, like the MinION. Because of our work in this area were we asked to co-convene a workshop called “Programmable biology in the test tube”, which was organised by Jenny Molloy from the Strategic Research Initiative for Synthetic Biology at Cambridge.
Traditionally, synthetic biology has involved genetically engineering bacteria to do our bidding: producing a useful protein (for example a protein that is fluorescent) from a blueprint (DNA in the form of a plasmid). Cell-free synthetic biology means extracting the machinery that bacteria like E. coli use to produce protein from the DNA blue-print (the machinery for transcription and translation), and leaving the cell behind. There are numerous technical reasons why this is preferable, but the real-world consequences that we’re most excited about are that devices that use synthetic biology sensors 1) don’t need to be kept refrigerated, which means they can be transported long distances to reach rural places, and 2) are not restricted in use in the same way as whole genetically modified organisms.
Our day in Cambridge University’s Department of Plant Sciences included talks and a workshop. True to the open, collaborative, multi-disciplinary spirit of the OpenPlant initiative, there was a diverse group of attendees from the bio-hacking community, and even those in software engineering and economics.
Vincent Noireaux presents his cell-free synthetic biology work at the workshop: Programmable Biology in the Test Tube
Things you see in a plant lab. Department of Plant Sciences, Cambridge University.
The workshop was led by Vincent Noireaux (University of Minnesota), and hosted by Jim Haseloff and Fernan Federici. We worked from Vincent’s paper, “The All E.coli TX-TL Toolbox 2.0: A Platform for Cell-Free Synthetic Biology.”
Just add water...we're making GFP in a test tube! #cellfree #synbio @synbioSRI pic.twitter.com/sGiunJHwzV
— Science Practice (@sciencepractice) 19 October 2016
Each group of attendees was given a different cell-free gene-circuit to create. In the end we reviewed whether our gene-circuit was behaving correctly by using a microplate reader to look at the kinetics of expression of green fluorescent protein.
Kinetics of expression of green fluorescent protein produced by our gene-circuit
Groups gather round and discuss their results with Vincent.
It was easy to construct these gene-circuits on the lab bench, even for non-experts. We’re really excited to see a new generation of paper-based diagnostics that use cell-free synbio sensors. Thanks to Jim, Jenny, and Fernan for having us!
In November this year I was lucky enough to be flown to Irvine, California for “the Woodstock of conferences” – the 2016 National Academies Keck Futures Initiative (NAKFI). I was invited in order to bring my biomedical engineering perspective to a diverse group of artists and scientists discussing ocean exploration.
For each of the 15 years it has been running, the conference has had a different team, from prosthetics to nuclear technology and in it’s final year, the team was Discovering The Deep Blue Sea. About 65% of the 150 or so attendees were ocean scientists of one kind or another. The rest were outsiders, like myself, coming from other scientific fields and various streams of art and design such as film and music. Attendees were selected not only because of achievements in their own fields, but because they had demonstrated a deep appreciation for multidisciplinary work. It was wonderful to be at a conference where it was the norm for every scientist/engineer to have other interests such as a semi-professional dance career or running a public-engagement project.
What was unique about the NAKFI conference format was that the cohort spent almost every waking moment together over the 4 days. The atmosphere was similar to a school outing. By the end I felt like I knew at least half the people there and the intensity of the schedule meant that everyone felt a connection because of their shared experience.
The conference kicked off with a welcome reception at our swanky hotel in Huntington Beach, with lots of speculation and trepidation about how this improbable sounding conference would unfold:
Opening reception for #NAKFI2016, meeting ocean scientists, engineers, artists. Waves from the Pacific ocean behind us pic.twitter.com/ExBAOv3oVK
— DrTempest van Schaik (@Dr_Tempest) November 10, 2016
The first day opened with introductory talks about multi-disciplinary work, including talks by David Edwards from the Wyss Institute, artist and film maker Doug Aitken, and Oliver Morton from The Economist:
Amazing opening panel at National Academies #NAKFI2016 incl artist Doug Aitken, & David Edwards from @LeLabCambridge @wyssinstitute pic.twitter.com/JrTxUuwPRO
— Science Practice (@sciencepractice) November 10, 2016
Next, attendees split off into multi-disciplinary groups based on their particular interest in the ocean, such as climate change, biodiversity, energy or aquaculture. I chose the technology group because of my interest in sensors. (At Science Practice we’re interested in sensing technologies, whether that might be soil tests or cognitive assessments.)
We were told that the conference would culminate with each group presenting their proposal to improve some aspect of the ocean, and that these proposals could be developed into funding applications for the Keck Futures Initiative.
In our groups, we explored some of the challenges and opportunities in our areas. Groups spontaneously resized and reorganised. Ideas that were explored in my technology group ranged from the fantastic (biodegradable cameras made out of jellyfish), to the imminently feasible (a citizen science scavenger hunt for lost oceanographic measurement instruments).
1 min pitches: leverage existing networks to rescue abandoned argo floats &the data they hold #NAKFI2016 pic.twitter.com/1jyfKSuGt9
— Science Practice (@sciencepractice) November 12, 2016
By the end my group had settled to include impressive ocean scientists Melissa Omand, Ken Buesseler, Anela Choy, Anna Michel, and students Joshue Molina and Kristen Torralba from the ArtCenter College of Design.
If NAKFI is the perfect Science Practice conference, then the next activity was the perfect Science Practice brief: putting scientific concepts into practice. My group identified a need for improved ocean monitoring, as well as a promising new measurement technique inspired by Melissa’s recent trip to a photography exhibition. Over the remainder of the conference, we developed our pitch for a small, low-cost device to measure the falling rate of marine snow.
Marine snow is not something I knew existed before the conference but I learnt an incredible amount from my group. In turn, I tried to relate our project to approaches and challenges in the healthcare domain. For example, flow cytometry which is used for counting cells could also be useful in oceanography. There were a surprising number of common concepts: the fact that both the human body and the ocean are harsh environments for sensors with the common problem of bio-fouling. There were also a couple of approaches from Science Practice which I found helpful while working in our groups:
Back of the envelope calculations & a model copepod #NAKFI2016 pic.twitter.com/SdOWGMd1xH
— DrTempest van Schaik (@Dr_Tempest) November 12, 2016
The intense brainstorming sessions were also punctuated with refreshing activities like a visit to an exhibition called The Trouble With Jellyfish, and an outdoor poster session, where I presented SoilCards. I worried that SoilCards might seem too terrestrial a topic for the conference, but many ocean scientists are interested in chemical measurements and low-cost, portable technology for remote sensing. Ocean scientists are also appreciative of technology which prevents run-off of excess fertiliser into rivers and ultimately, the ocean.
Jellyfish TV #NAKFI2016 "jellies are not a species, they're a lifestyle" pic.twitter.com/DlsSrqUlnV
— Science Practice (@sciencepractice) November 11, 2016
SoilCards presented at #NAKFI2016 on a sunny day in California. All poster sessions should be outdoors! pic.twitter.com/wKvxMsu2w5
— SoilCards (@soilcards) November 12, 2016
The final presentations were a very clear reminder that NAKFI is no typical scientific conference. With the lights turned off in the auditorium, one group used the illumination of their phones to act out the lives of deep-sea luminescent fish. Another group entangled the entire audience in a ball of string and instead of Powerpoint slides overcrowded with graphs, there were illustrations that unrolled on a scroll of butcher paper. Through all this, the main team that emerged was an interest in using technology to create a multi-sensory, immersive experiences that engage more people with the otherwise intangible deep sea.
Thanks to the amazing @designmattersCA students for bringing the presentations about ocean innovation at #NAKFI2016 to life! pic.twitter.com/K7kvjrbFNH
— Science Practice (@sciencepractice) November 13, 2016
With my background in engineering for human health, I never expected to find myself presenting on stage at an ocean science conference. However, feedback from other ocean experts was that our group’s project is worth pursuing.
My group on the final day of NAKFI2016 when we pitched our idea for a small, low-cost device to measure the falling rate of marine snow.
The conference not only taught me about ocean science, but gave me a new appreciation for ocean conservation. I loved working with scientists in a completely different field, which made me think that scientists in seemingly disparate fields may have more in common than they think. Many attendees remarked that it was an incredibly productive 4 days of research. This was partly due to not having any distractions, the wonderful selection of people and the very experienced organising committee. But mostly it was an amazing conference because working in inter-disciplinary teams can produce pretty amazing results.
To everyone who participated in #NAKFI2016, cheers! Thank you for making this conference a success. 📷: @prk111 pic.twitter.com/hf8ztEvLbY
— NAKFI (@KeckFutures) November 13, 2016
This blog post is part of a series on our Good Problems team. Each post looks at a different step in the process of designing a funding programme and makes suggestions about how to optimise to achieve a greater impact.
After identifying a good problem it’s natural to start thinking about how to solve it. Or in the case of a funding organisation, how to incentivise the right people to solve it.
The first step is to understand the skills, resources, and collaborations needed to solve a problem. This takes time and consideration. It’s not only important to understand the needs of those already working on the problem (or closely related problems), but also to understand how new sets of skills, ideas, and perspectives could be brought together to create new solutions.
In this post we talk through some of the tools that help us make sense of a community of solvers, from identifying relevant skills and resources, to understanding blockers, motivators, and risks.
By ‘solver’ we mean anyone who is currently working or could be working on building solutions to a problem. To identify them, we start by asking what makes a good community of solvers, rather than who they are:
Emphasizing the skills or perspectives required to come up with impactful solutions is important because people rarely identify with a problem if it’s outside of their line of work or interest. But there are many problems that would benefit from an outsider’s perspective. An example of this is our work with the Humanitarian Innovation Fund (the HIF) around gender-based violence (GBV) prevention in humanitarian emergencies.
The HIF were looking to raise awareness of problems in the area of GBV prevention by communicating them as challenges to be solved. They were specifically interested in engaging a broader community of solvers, beyond GBV practitioners. To encourage collaborations, at the end of each designed challenge, we highlighted different skills and perspectives that would be valuable when developing solutions. Depending on the challenge, required skills ranged from tech development and user experience design, to organisational psychology, behaviour change, or advocacy. All of these are areas that are not directly associated with GBV prevention, but that could provide valuable insights and suggestions on how to develop impactful and engaging programmes. More on this project here.
After we answer the what question, we focus on the who. The aim is to start identifying individuals, teams, or communities that match the skills, perspectives, and resources needed to come up with valuable ideas. The initial research into identifying a good problem should have already generated a long-list of people working on solutions or developing new approaches.
As part of the process of understanding a community of solvers, we try to grasp three things – what’s holding back progress, what would motivate potential solvers, and whether there’s any risk involved for them.
Blockers – what’s holding back progress or preventing the development of solutions? We have narrowed it down to three main causes:
Motivators – what drives solvers to work on solutions? These may include a combination of the following:
Risks – are there any risks problem solvers could be exposing themselves to by working on solutions? Some of these may include:
In the process of designing an impactful funding programme, understanding the community of solvers plays a dual role. It helps ensure that the people, collaborations, and communities who are most likely to come up with valuable ideas are correctly identified, and it provides important insights into how to motivate and support them along the way.
In addition to this, focusing on solvers helps funders develop a more nuanced understanding of their own role as part of the problem solving process. Depending on the type of problem and maturity of the community of solvers, the role of a funding programme may be to:
Build a community – Raise awareness of the problem and create a community of solvers that are motivated, well resourced, and recognised as working on a worthwhile problem.
Expand a community – Engage new people with different skills and perspectives, nurture opportunities for collaboration and/or constructive competition, and encourage idea exchange.
Support a community – Supply the community of solvers with relevant resources such as funding, access to facilities and equipment, feedback from mentors, users, industry, or investors.
These categories are not only useful in helping funders define their objectives and priorities, but they provide a framework for thinking about different approaches to incentivise problem solving.
In the last post of the series, we will take a closer look at existing incentivisation approaches, from allocating grants to launching challenge prizes, and we share some of the things we’ve learned about designing approaches that both motivate and support a community to solve a good problem.