Resource Guide to Learning Delivery Methods

resource guide to learning

What learning delivery methods are there and how do you consider them? In 2014 Scott Leslie and I supported an analysis for decision making on training strategies for the International Labour Organization’s Microinsurance Innovation Facility, now the Impact Insurance Facility (http://www.impactinsurance.org/ ).

As I moved on to other related works, I kept drawing on these initial documents. Finally, I’ve gotten around to a) getting permission from the ILO to share (THANK YOU!) and trying to pull out some of the domain specific stuff so it might be more widely useful.

The Resource Guide to Learning Delivery Methods  (pdf for now) is a version of one of the outputs of our work, shared with permission from the Facility with the hope that it adds value to your work. (The other elements include a Glossary and a Strategic Options documents.) We hope to also put these online for crowd-sourced critique and revisions. (TBA!) In the meantime, I just want to get this OUT THERE!

From the Introduction:

This document is a version of one of the outputs of our work, shared with permission from the Facility with the hope that it adds value to your work. (The other elements include a Glossary and a Strategic Options documents.) We hope to also put these online for crowd-sourced critique and revisions. (TBA!)

The Facility team was evaluating their e-learning options to expand capacity building for microinsurance for the poor. An early identified need was to understand elearning in the wider context of delivery mechanisms.

The basic content can be useful when starting to consider capacity development, training or specifically an e-learning strategy. It is not exhaustive, and some things have become dated since it was written. Understanding that, it can help you understand the range of learning options, and where they might be most effective.

We surveyed 20 different learning delivery methods across five major categories:

  • Face-to-face delivery methods
  • Online delivery methods:
    • Traditional online courses
    • MOOCs, communities & self-directed learning
    • Synchronous methods
    • Mobile delivery methods
  • Offline delivery methods
  • Blended and hybrid methods

This guide is the detailed analysis of these methods in the context of the Facility’s domain. It includes a general description, domain-related examples, and provides insight and comparisons on these methods based the qualities the organization identified as key to assessing any proposed solution. These qualities include:

  • the implications of this method on scalability and adaptability of content
  • implications on quality control
  • any effects the method may have on motivating learners’ completion of training and achievement of learning objectives
  • the ease and costs of implementing any of these methods

Your qualities may be different, so you may wish to consider your needs and how the methods may or may not meet your needs. This document is offered as a Free Cultural License as defined by the Creative Commons https://creativecommons.org/licenses/ .

Learning While Building eLearning: Part 1

F2FtoONlineIntroduction

This is the first in a short blog series based on conversations with a colleague who is “learning while doing” as he is building an eLearning offering. Disclaimer: I’m an adviser to the project and my condition of participation was the ability to do this series of blog posts, because there is really useful knowledge to share, both within the colleague’s organization and more widely. So I said I’d add the blog reflections – without pay – if I could share them. So here we go! Over time it will probably include some additional comments from other members of the team working on this project. (Edit: Part 2 and Part 3.)

The reason I wanted to share this story is time after time I hear people state “Hey, let’s just convert our face-to-face (F2F) training into elearning” without a real sense of what that process might entail. What really happens when you decide to convert your face to face training to an elearning offering? What types of offerings lend themselves to conversion? What would that conversion look like? What should you consider?  I’ve done piles of research for clients in the past (and I’m working on getting permission to share some of it.) But nothing in the research is surprising. What is surprising is that it is not considered before diving in!

There are many paths to answering the questions about converting F2F learning to online or blended learning. The most important starting point is to ask some important initial questions, explore the options, and learn from others. Then, if you still want to proceed,  you can hire a firm to fully convert materials, do it yourself or work with a few others.

Regardless, the “conversion” process asks us some fundamental questions about learning: what and why we want to learn and what the impact of that learning might be. Looking at our assumptions around these fundamental questions can inform any initiative to “convert” something to elearning.

Meet Emilio  

Emilio is a technical officer at a large international development organization. He is an expert in his domain with years of knowledge and experience. Over time he has been asked to share his expertise and has developed a set of materials and practices to offer face to face (F2F) workshops around his area of expertise. He is passionate about his topic and his depth of experience brings richness to every conversation he has with people who want to learn more. Now he has been asked to reach more people by teaching online. That “elearning” thing.

The first decision Emilio faced was to understand what elearning really means. What are the options? What does it take to convert his offline materials into online opportunities? In our first learning conversation, Emilio shared his discovery that there is a large range of types of elearning courses and that they are difficult to categorize. He started out thinking that this is simply presenting his F2F lectures in a real time online space, augmented with the materials he had developed. But he discovered there was more to it than that.

Matching the Material With eLearning Options

multimediaAn early insight was that what you choose to do depends on your target audience and what they want or need to learn. (Or what YOU want them to learn!)

From conversations with other colleagues at work, Emilio learned some forms of elearning that have been produced in his organization. For example packages were created to introduce ideas, concepts and general information to government officials. Emilio now sees these can be less interactive, self-paced, and can potentially reach hundreds in unfacilitated courses. His colleagues have handed material over to consultants who have converted them into self paced offerings – quickly and efficiently.  This form fits with a goal of information dissemination. The value added to the learner, as compared to doing an internet search or picking up a book, is that the material is chunked and sequenced into digestible chunks and because of the reputation of the agency, people have confidence in what they are learning.

Emilio’s existing  training courses focus on a variety of complex policy issues and practices.  The material is more about converting concepts into practice, which is far more challenging than introducing ideas. Learners need to wrestle with the material, practice its application, consider their contextual differences and get the kind of feedback experts like Emilio have in their heads – the kinds of stuff that is rarely included in the slide deck or readings. Subtle. Contextual. Experienced. This is more challenging than converting basic or introductory materials into elearning.

As the volume of complexity of the material grows, there are other issues to consider. How do you keep the learner’s attention? How do you know if they are falling off course and what do you do? What and how do you customize for different contexts?

An early implication of these differences was that Emilio’s colleagues and bosses may have been thinking that he was doing the same thing as the people making introductory courses. The might expect it would take the same amount of time and resources to implement. Like him, his colleagues were not familiar with the range of elearning options. Add to that the fact that a strong organizational driver towards elearning is the idea of efficiency and reach, you can fall into a trap assuming that elearning is just about low-cost content distribution to many people, and that it is always easy or effective to implement.

Sometimes we can and do reach thousands with introductory material. But how do we really build capacity for more complex topics at a distance? What does “cost per student” really mean for deeper learning?

Emilio discovered that the reality is quite different than he thought. There is a mountain of jargon. Even thinking about the course learning objectives in a more complex offering is much more challenging (and we’ll talk about this with Emilio in a later blog post). All his tacit information that is easily available when he is present in a F2F training needs to be identified and reconsidered. What needs to be made explicit? What can come out through the facilitation of a course, with direct online interaction with learners? What has to be packaged into knowledge products? What is REALLY important amongst the vast possibilities of the content?

The adventure has begun. Stay tuned for the next part!

“Finely calibrated moments of risk”

sunburstI’ve had this snippet in my queue for a while and decided to just BLOG it. I love the idea of “finely calibrated moments of risk.” Sounds like my life! This is the space of learning, of innovation. Can I get an “amen!?”

The quote is from Molly Melching in a piece by Courtney Martin,  The Reductive Seduction of Other People’s Problems — The Development Set — Medium   The context was “development tourism,” which is an interesting issue on its own. Here is the context for the quote.

“Don’t go because you loved studying abroad. Go because, like Molly Melching, you plan on putting down roots. Melching, a native of Illinois, is widely credited with ending female genital cutting (FGC) in Senegal. But it didn’t happen overnight. She has been living in and around Dakar since 1974, developing her organization, Tostan, and its strategy of helping communities collectively address human rights abuses. Her leadership style is all about finely calibrated moments of risk — when she will challenge a local leader, for example — and restraint — when she will hold off on challenging a local leader because she intuits that she hasn’t yet developed enough trust with him. That kind of leadership doesn’t develop during a six-month home stay.”

For my international development friends, you might want to peek at The Development Set. Many of us continuously wonder if we are adding value in our work. 😉 Here is the “about.”

Finally, a word about journalistic ethics. The Development Set is made possible by funding from the The Bill & Melinda Gates Foundation. Please know that the Foundation’s involvement with this publication stops there. They are interested in cultivating a dynamic space to explore the question, “How do we do the most good?” They do not have any sway whatsoever in our editorial decisions.

Collaborating for Impact in Large Development Organizations

km4devimage1What feels like a long time ago and far far away, Rachel Cardone of Red Thread Advisors, Aldo de Moore of Community Sense and I decided to wrestle with some questions that were cropping up across our diverse work. We kept having clients say “we want to collaborate with our distributed teams,” and “what software should we buy.” Time and again, we saw so many of these initiatives fizzle out. It was our sense that we needed to look at the problem differently, with an appreciation for complexity and the diverse contexts across large international development organizations.  That really interesting things were happening on the edges, but they didn’t seem to penetrate deeply into the organizations.

Thanks to some support from IFAD (thanks, Helen!), we had some seed money to begin thinking together, along with friends/volunteers from five development organizations (listed below). What resulted is the following paper from the KM4Dev Journal.

Learning 3.0: collaborating for impact in large development organizations

Nancy White, Rachel Cardone, Aldo de Moor

Abstract

This discussion paper builds on the body of research and practice about technology stewardship originally explored in Digital Habitats, and on the findings from an initial probe into the experiences of five development agencies using collaboration platform technologies. The probe was conducted from September 2013 through February 2014. We propose a framework for looking at productive practices in selecting, configuring and supporting use of collaboration technologies in international development organizations by focusing on the opportunities that exist in the boundaries between different parts of a development organization and different kinds of interactions that lead to learning and development impact. We suggest that there is a very useful opportunity to expand this initial probe using collaboration pattern language and a complexity lens to develop a useful repertoire of technology stewarding practices for collaboration in international development with the goal of supporting greater impact of development work.

via KM4Dev Journal.

This snippet gives a bit of the context for the action learning agenda:

We worked with key staff from the International Fund for Agricultural Development (IFAD), Oxfam International, German Federal Enterprise for International Cooperation (GIZ), the World Bank Institute, the UN Development Programme (UNDP – special thanks to the ever enthusiastic Johannes Schunter!), and the Bill and Melinda Gates Foundation (BMGF). Our objective was to determine if common patterns or dynamics exist across international development organizations that could suggest models, approaches or methods organizations could use to increase value for money when making investment decisions in support of collaboration. We drew on the collective experience of our action research partners, and our own experiences working to establish, advise and manage collaboration technology platforms. Through a series of discussions, we developed an analysis of the contextual factors relevant to the international development sector.

You can find the full text PDF here. I’d love to hear your thoughts and feedback!

Beyond the Webinar

The earthLet me confess right up front: I really don’t like webinars. Too often they feel “done unto me.” I am powerless, at the mercy of the organizers. I may have access to a chat room (Thank Goodness!) But more often than not, these are content delivery mechanisms with token participant interaction in the form of crowded Q&A segments or polls with varying degrees of relevance. What is worse is that I have been a perpetrator of these practices so I continue to try and change my evil ways.

Changing ingrained habits requires some reflection – of self and of the state of the practice of these so-called “webinars.”  Recently I had the chance to offer feedback on a webinar I experienced as a recording.  I’ve edited/generalized my thoughts to share. In a follow up post I’ll reflect on my own practice — this is where I need to cut to the bone!
1. Us/Them: It is logical for an organizer or organizing agency to want to  appear well prepared for sharing their work. We all like folks to know we “did our homework.” We get our slides spiffed up and appropriately formatted for the webinar tool we are given. We time our remarks. We practice speaking clearly and at an appropriate pace.

The challenge this presents is that the end product puts the speaker and/or the organization at the center. We create an us/them dynamic before the event even starts. Think about set ups where the only ones who can use the voice tool to communicate are the organizers. Those who bear the presentation file are in control of the message. The tool administrator(s) control the process (i.e determining that they speak for 60 minutes, then there is Q&A.)

The use of a one way style of presentation reinforces the power dynamics of the speaker/expert/organization as central, and everyone else as “audience.” All too often, the audience is never heard. Is that a good use of precious synchronous time? Why not send out a video or narrated PowerPoint? An online gathering is time better spent as a multi-directional mode of “being together” — even online. This does NOT diminish the importance and value of content we “deliver” to others. Here are some options to consider.

Options:

  • Move away from meetings that are primarily broadcast which holds control with the presenter. Sharing information is essential, but synchronous time should always have significant multi directional interaction. For my colleagues in international development, I think everyone has values of inclusiveness and shared participation. We have to “walk this talk” in webinars as well.
  • Small things can create or break down us/them.  For example don’t just show where you are on a map at the start of a webinar, add dots for all the participants and their locations. Better yet, use a tool that allows them to add their own dots. Help the group see not only you,  but “we” – all the people working together about something we all care deeply about.
  • Because we lack body  language online, it is useful to really scrutinize our language.From the wording in the slides and by the speaker, consider changes in language so that it is more inclusive of the participants.

 

2. Strive for  good practices for learning/engaging online. Webinars in general run the risk of being even less engaging than a dark room face to face with a long PowerPoint. There is a saying in the online facilitation world “A bad meeting F2F is a terrible meeting online.” So we need to be even more attentive to how we structure online engagements to reflect a) how adults learn b) the high risk of losing attention (especially due to multi tasking) and c) the cultural and power diversity inherent in your group. Quality content is important, but it alone is not a reason to use an interactive platform — you can deliver content in many ways. Choosing a synchronous mode, to me,  implies interaction.

Options:

  • Consider keeping online meetings to 60 minutes. If not, do a stretch break every at 30 and 60 minutes. Say “let’s take a 60 second break.” Stand up, stretch, look away from the screen and give your body a moment of respite. We’ll call you back in 60 (90-120) seconds (sometimes a bio break is useful!)
  • A useful rule of thumb is to break up information presentation with some means of audience engagement/participation every 7-15 minutes. Use polls, chat, “red/green/yellow” feedback mechanisms, hand raising, checking for understanding, etc. This may mean you have someone facilitating these other channels if it is too distracting for the host and speakers. (Over time it does get easier, but practice is critical!)
  • Take questions approximately every 15 minutes vs holding at end. People stop listening carefully and are thus less prepared to ask questions after longer periods of time. (They are also more prone to multitasking, etc.)
  • Don’t just deliver information – use narrative. Stories hold our attention better than a series of bullet points. In fact, ditch those boring slides unless you are using the printed information to make it easier for people coming from a different first language.
  • Deliver the useful content in a different manner and use the webmeeting entirely for questions and interactions. Send a recording introducing the team. Send a narrated PowerPoint about the topic. Keep these content packages smaller. For example, if you were trying to give an overview of a portfolio of projects, you could break it up into some sub packages. 1) about the team 2) strategy, 3) project descriptions, 4) monitoring and evaluation strategy, etc.
  • Secondary tip: Do not think of these information products as polished products — don’t waste energy overproducing. That sucks the human element out of it. Imperfection is a door to engagement… seriously. Moments of uncertainty, tough questions — these engage the participants.
  • Stay relaxed as a narrator and speak at useful pace for understanding, particularly for those who have English as a second (or third, fourth) language. Keep that human touch. Add little bits of personal information and affect. Be human.
  • Let participants ask question verbally, not just in chat if possible. While there are many technical complications and sometimes the burden of accents on unclear audio channels, voice brings again brings in that human element. (Video does too, but there are bandwidth considerations. When you can, consider using it.)
  • Encourage collective note taking in the chat room or with complementary tool. When people share this task, they listen more carefully and the begin to learn about each others strengths and insights as people add additional information or annotations.
  • When someone asks a question, note who asked the question. This helps everyone see that people are heard, even if the audio option is not practical (for various reasons, no mic, etc. )  At the end of the call, specifically thank by name those who asked questions to encourage the behavior for future interactions.
  • In Q&A sections, consider a visual to help people pay attention. Use the whiteboard for noting the questions, answers, links that refer to what has been spoken about, etc.

There are a few ideas. What are yours?

Also, here are some previous posts about similar issues: