Cense

Innovation to Impact

After-Action Review: Learning Together Through Complexity

by

Complexity science is the study of how systems behave when under conditions of high dynamism (change) and instability due to the number, sequencing, and organization of actors, relationships, and outcomes. Complex systems pose difficulty drawing clear lessons because the relationship between causes and consequences are rarely straightforward. To illustrate, consider how having one child provides only loose guidance on how to parent a second, third or fourth child: there’s no template.

An After-Action Review is one such way to learn from actions you take in a complex system to help shape what you do in the future and provide guidance on what steps should be taken next.

The After-Action Review (AAR) is a method of sensemaking and supporting organizational learning through shared narratives and group reflection once an action has been taken on a specific project aimed at producing a particular outcome — regardless of what happened. The method has been widely used in the US Military and has since been applied to many sectors. Too often our retrospective reviews happen only when things fail, but through examining any outcome we can better learn what works, when, how, and when our efforts produce certain outcomes.

Here’s what it is and how to use it.

Learning Together

An AAR is a social process aimed at illuminating causal connections between actions and outcomes. It is not about developing best practice, rather it is to create a shared narrative of a process from many different perspectives. It recognizes that we may engage in a shared event, but our experience and perceptions of that event might be different and within these differences lie the foundation for learning.

To do this well, you will need to have a facilitator and a note-taker. This also must be done in an environment that allows individuals to speak freely, frankly, and without any fear of negative reprisals — which is a culture that must be cultivated early and ahead of time. The aim isn’t to point blame, but to learn. The facilitator can be within the team or outside the team. The US Military has a process where the teams undertake their own self-facilitated AAR’s.

To begin, gather those individuals directly involved in a project together in close proximity to the ‘end’ (e.g., launch, delivery of the product, etc..). As a group, reflect on the following three question sets:

  1. The Objectives & Outcomes:
    • What was supposed to happen?
    • What actually happened?
    • Practice Notes: Notice whether there were discrepancies between perceptions of the objective in the first place and where there are differences in what people pay attention to, what value they ascribe to that activity (see below), and how events were sequenced.
  2. Positive, Negative, and Neutral Events:
    • What created benefit / what ‘worked’ ?
    • What created problems / what ‘didn’t ‘work’?
    • Practice notes: The reason for putting ‘work’ in quotes is that there may not be a clear line between the activities and outcomes or a pre-determined sense of what is expected and to what degree, particularly with innovations where there isn’t a best practice or benchmark. Note how people may differ on their view of what a success or failure might be.
  3. Future Steps:
    • What might we do next time?
    • Practice notes: This is where a good note-taker is helpful as it allows you to record what happens in the discussion and recommendations. The process should end with a commitment to bringing these lessons together to inform strategic actions going forward next time something similar is undertaken.

Implementing the Method

Building AAR’s into your organization will help foster a culture of learning if done with care, respect and a commitment to non-judgemental hearing and accepting of what is discussed in these gatherings.

The length of an AAR can be anywhere from a half-hour to a full-day (or more) depending on the topic, context, and scale of the project.

An AAR is something that is to be done without a preconceived assessment of what the outcome of the event is. This means suspending the judgement about whether the outcome was a ‘success’ or ‘failure’ until after the AAR is completed. What often happens is successes and ‘wins’ are found in even the most difficult situations while areas of improvement or threats can be uncovered even when everything appeared to work (see the NASA case studies with the Challenger and Columbia space shuttle disasters).

Implementing an AAR every time your team does something significant as part of its operations can help you create a culture of learning and trust in your organization and draw out far more value from your innovation if you implement this regularly.

If your team is looking to improve its learning and create more value from your innovation investments, contact us and we can support you in building AAR’s into your organization and learn more from complexity.

Design for Living: A Day in the Life

by

Product and service developers can easily be fooled into thinking all they need to focus on is the moment of engagement with their product. The design method “A Day in the Life” can help us put our potential audience (customer, client, or “user”) into a clearer perspective.

A Day in the Life is a simple activity that seeks to catalogue the activities and contexts that your audience might engage in within a typical day to help shed light on the life circumstance and situations that could influence your product.

Begin at the Beginning

Let’s illustrate this simple method with an example: education and training. When we design for education and training, the actual service might be a class, webinar, or workshop. However, the total experience of learning may involve much more than that.

Rather than assume your service starts at the moment people sit down (in person, at the computer etc..) go back to the start of their day.

Start with imagining a ‘user’ — be as specific as possible about this person with as much detail as you can provide that reflects a ‘typical’ or a particular (e.g., specific segment) service or product user.

Then ask: What happened the moment they woke up?

This question tells you a lot and invites other questions: Did they get a good sleep? What were the conditions that they slept in? What time did they wake up?

This matters because one of the assumptions behind your education and training service might be that people are attentive, able to listen and process the material, participate when necessary, and able to codify what’s learned into their brain and apply that later to whatever problem is at hand.

If you want your service to be useful, it needs to fit the circumstances of your user. If your participants didn’t sleep well, had to get up early to commute, are living in a state of fear or violence, or have no good place to sleep at all they are already facing some challenges before they start.

Continue the Story

The first question will lead you to a series of other questions that continue with: What happened next?

You continue this story as you progress through the day in the life of your participant up to and through the actual service event you’re involved in. After that? Continue the story through to the end of the day.

Along the way you will identify such things about your audience like:

  • Demographics
  • Social life and network
  • ‘Touchpoints’ with other systems and services
  • Preferences
  • Social and psychological circumstances.

These are imaginations of sorts based on what you think is a ‘typical user’. To increase the likelihood of reflecting the experience of a diversity of users it is best to conduct some background research to ensure you are reflecting the true characteristics of your audience. This method also works for identifying qualities about non-typical or non-users to help you understand why they might not use or desire your product or service.

Putting it into Practice

This exercise is best done as a group and can be conducted within 2 hours comfortably with more time for more granular exploration. It is meant to be participatory, engaging and allow for some creative reflection.

Materials include:

  • Whiteboards or large flipchart paper
  • Markers
  • Sticky notes
  • Stickers (optional)

Over the course of a morning or afternoon, you can bring your team into a place of greater understanding of your users — current and potential — and help set the context for your service. If we consider our example of education and training, the lessons we learn from this might be that we break programming into different chunks, change the distribution model, provide additional or alternative means to access content, or perhaps follow-up with reminders and tips to aid memory or application.

This simple, engaging and powerful method will help you tell better stories about your product or service and those of the people you wish to influence and serve.

A Day in the Life is one of the methods that we teach as part of the Design Loft Experience pop-up held as part of the annual American Evaluation Association annual conference each year. It’s one of many methods we use to help our clients understand the bigger picture and gain new insights into their work. Want help implementing it? Contact us — this is what we do.

Chief Learning Officer

by

C-suite leadership roles focus on an organization’s most important functions. Time to introduce the role of the Chief Learning Officer.

Learning — easier said than done. Yet, learning is vital to the success of an organization that seeks to innovate to gain advantage or merely survive – which is most human service organizations these days.

Learning opportunities abound, yet these require energy and attention in order to take advantage of them. Organizationally, this requires leadership and resources to support people across the organization to learn within their areas of focus and across the institution and networks.

Everyone is responsible for learning and there are some great resources to support that effort, but without someone taking explicit leadership on making sure learning happens within the institution, it’s less likely to happen — at least happen in a way that is designed for innovation.

Introducing: the Chief Learning Officer.

Leading Learning

With the alphabet soup of C-s that we are seeing among organizations’ leadership teams adding another might not seem helpful. What we propose is less about formalizing the title of CLO and more about creating the function of what they can do within an organization.

We envision a CLO role as one that does the following:

  • Establishing a learning plan for the organization and the data structure to support that learning. This means instilling and building a culture of evaluation across the organization, which provides data and feedback on what is happening to allow staff at all levels to learn from what is being done. It involves showing what evaluation can do and co-creating ways to do it across the enterprise to add learning value.
  • Ensures that staff roles and functions include the ability to study and reflect on the work being done and its impact. This means establishing practices and procedures that link evaluation data to program activities. It also involves creating the means to bring in insights from outside sources (e.g., published research and reports, networks, professional communities, customers and clients). Structuring what we do and how and when we do it is part of this function to ensure that roles and learning needs are fit-for-purpose.
  • Organizing the evaluation of program activities and ensuring that staff at all relevant levels of the organization close to each program have access to the information about those programs and can make decisions about those programs without having to go through cumbersome layers of bureaucracy.
  • Create sensemaking channels and opportunities throughout the organization. This allows intra- and cross-departmental/unit collaboration to understand the bigger picture of what’s going on in the organization and industry.
  • Supports the development of self-sustaining communities of practice or learning groups on topics relevant to the organization, yet without specific roles or functions. Topics might include emerging technologies, leadership, creative thinking, or professional development.

Creating your CLO Office

A CLO would link the activities of the organization to the monitoring and evaluation data about those activities with the literature and trend data from outside the organization into a culture of learning within the organization.

This could be a full- or part-time position or something like a fractional CLO role like we can play at Cense.

Whether you create a CLO within your organization or choose to recruit learning support from outside, having a dedicated person shepherding your culture into a learning organization is something that will increase your innovation capacity exponentially.

For more information about how you can build this learning culture within your organization or the fractional CLO role, contact us. We’d love to help you out.