Ask Me Anything: Knowledge Sharing Through Peer Interviews

This is the third post in a series about how we learn from our work. The first one is here and the second here.

The popular Internet discussion site, Reddit.com has a practice called “Ask Me Anything.”(http://www.reddit.com/r/AMA/) It is a discussion thread where either some notable is invited in or a member offers their expertise and the other members can ask them, well, anything! It is so popular it even has a mobile app so you can follow the AMAs. Some of the AMA’s are amazing… the insights that emerge when someone asks us a question seem to leap over anything we can prepare. I’ve done a ton of keynote talks, and the best ones have been when someone interviews me. They pull out things I had no idea I knew, and I was able to express them naturally and easily.

What is it about someone asking us questions that surfaces great, sharable knowledge?

This is the question that is part of the second of two experiments we are running with the of Bill and Melinda Gates Foundation grantees of the Water, Sanitation and Hygiene program. (Read about the first one here.)We have started interviewing ourselves on the KM team, and have offered to interview any grantee to help tease out and share their insights with other grantees and stakeholders. It is a simple, low risk experiment to learn together and share knowledge

Our hypothesis, or Theory of Change, for the peer interviews is fourfold.

  1. HSLWe are often unconscious about what we know (see Dave Snowden’s great piece on “we know more than we can say and we say more than we can write.”) When someone asks us to “tell them a story” about our work, we are able to on the spot reflect, surface and share insights that might otherwise just stay stuck in our heads.
  2. We are short on time so we are reluctant or unable to stop, reflect, write and share. For whatever reasons. If someone can ask us and even help us write it up, we may be able to jump over that barrier.
  3. Pithy write ups of the insights can be valuable ways to cross pollinate learning in a grant portfolio, particularly if they come in small bites in greater frequency than the formal knowledge sharing instruments of regular reports and journal articles.
  4. Interviewing each other is a generative practice. This is because people like to know they have been heard. Not to freak out my dear science brethren and sisters, but the Dalai Lama once said that human beings “need to be heard, seen and loved, and in that order.” (As quoted in a story from Mark Jones, told to Peggy Holman and noted in her book, “Engaging Emergence.”) In the work world, we often swap in “respected” for loved, because talking about love at work seems taboo in many of our cultures. 😉 All the same, when we take the time to interview each other, to listen and to capture the insights, two things happen. One is the person who speaks often makes concrete, as they speak, thinking that was not yet fully formed or articulated. The second is that when people are heard, they are more likely to offer their knowledge in the future. So interviewing becomes a generative practice.

So far I have interviewed our KM team leader, Pete Cranston. On my to do list is to interview our client, the BDS portfolio lead (who is a pretty freaking amazingly open guy, so I look forward to this), and, after our last call (see blog post 2) I want to follow up with one of the grantees who is asking this same question: how do we surface and share our learnings more effectively. He calls it “process learning.” Some folks call it “working out loud.”

So another experiment has begun. I’ll keep you posted. In the meantime, do you have any stories or insights about peer interviewing as a learning and knowledge sharing method? Please, share them in the comments!

You Can Observe a Lot By Watching – Yogi Berra

watchingbyAliaQunhuaFlickrCCThis is the second post in a series about how we learn from our work. The first one can be found here.

The great American baseball player/philosopher Yogi Berra, said “You can observe a lot just by watching.”

That quote popped into my mind when I was on a phone call with a group of Bill and Melinda Gates Foundation grantees of the Water, Sanitation and Hygiene program. We were on a great 90 minute call with those working on projects in Africa when one participant shared this story. The following is a total paraphrase!

I received this drawing of a septic tank from one of our colleagues in India. Looking at it, I saw it was a great design, but I closed the email and moved on. A few months later I visited and saw the remarkable tank and realized what a breakthrough it was and thought, why did I just close that email a few months ago? Why didn’t I share it with a colleague in Africa who I knew would be interested? What was it about that face to face moment that crystallized the learning for me?

“You can observe a lot just by watching.” All humor aside, I’d like to greet that with a rousing “Yes, AND…” The AND is that we are getting so programmed for efficiency, and addressing every little blip on the radar screen that we miss the importance of the things we are ostensibly “watching.” When we go into the field, many of those distractions are electronically de-tethered. We focus, focus, focus on what we actually see in front of us. We ARE watching with all of our attention and thus can reflect on the importance of what we are seeing.

So is the solution to simply go into the field? Well, not so practical. Not so sustainable. Sometimes not even possible, especially for anyone lower on the project hierarchy. It is not equitable.

So what do we do?

We are currently initiating two experiments to try and solve this problem. I’ll share the first here, and save the second for a follow up post. (Focus, focus, focus!)

Shared, Open-Topic Conversations

One is the semi-regular, open agenda telephone calls with subgroups of BDS grantees. The calls were initiated by the portfolio leader, as a response to working with the KM team and hearing needs from grantees. By walking the talk, our client is using his leadership position to invite conversation, versus disseminate requirements or content.

So far it feels like having between 8-12 people on the call is a good size. There is enough diversity, but not too many voices so everyone can have some air time and attention. We use a telephone bridge line and a shared note taking/chatting space. (Our “community technology configuration.”) Currently we’ve been experimenting with Meeting Words (http://www.meetingwords.com).

We do a quick check in, then each person is invited to share some insight about their current work. People use chat or voice to ask questions, answer, look for possible collaboration opportunities, but more importantly, pay attention for 90 minutes to thinking across the portfolio, not just within their project.

Because there are others there “listening” to us, we speak and pay attention differently than a quick scan of an email. My sense is that the more we can recreate the sense that we are together, the more this behavior shows up, rather than paying attention with half an ear whilst doing email and reading a note someone in the office just set in front of us. The shared note taking space helps focus attention and offer different means of engagement. We didn’t have it the first call and I personally felt less coherence. (That could just be me.) When we added it for the second call, people did not have to wait for “airtime” to talk – they could type. In addition, I did live note taking in the wiki side of the page and invited others to improve my note taking. In when the links! In went the correct spelling of a report. And we had very useful, collaborative notes ready by the end of the call. Boom!

The turn taking helps stimulate our past experience of being in a room, in a circle together sharing a beer or coffee, and simply talking with each other.  It helps the shyer people know there will be a space for them, even if they want to pass. It evens out some of the inevitable power dynamics of funder/grantee, boss/team member.

At the end of the second call we asked ourselves if we found value in the call and the meeting words and the quick informal feedback was very positive. I was even surprised at how positive. What did we do right? What could be improved? We still need to answer these questions.

The final piece of these calls is just starting up – following up with sharing of mentioned resources, setting up follow up actions for pairs with shared needs or interests, and development of asynchronous discussion threads of topics identified as useful for more depth.

My key questions going forward on this include:

  • How often do these calls need to be to build sufficient trust and practice to be, and be perceived as valuable and worth the time spent? In other words, what is the heartbeat of this practice? Time is always the scarce resource, so value MUST exceed time spent. This raises the question of what metrics help us understand received and perceived value. Is it important to have metrics or is informal feedback enough?
  • How will the proposed follow up items emerge and how will we discern the value of these experiments? Will we succeed in sustaining asynchronous interaction or is that even another step away from the “face to face attention.” Again, what are our metrics?
  • Finally, if these calls continue to provide value, who else would benefit from/want to attend? How far away from those in charge of the grants should we go? I personally think we miss a LOT by not having these conversations with front line staff, but it becomes increasingly logistically challenging and time is that darn choke point.

Have you done informal, regular knowledge sharing calls? What have you learned about convening them? Measuring their value? Let me know and I’ll share it back around! Because, after all, you can observe a lot by watching, right? J

Mirror Mirror, On the Wall: Learning in a Crowded Life

mirrorbyPhotoComiXonFlickrCC14 years ago I did my first overseas gig in Central Asia. I stayed with the project over three years including a number of trips to Armenia to work with the team on the ground. (See White-2005-Little) Ostensibly I was there to help facilitate learning around using online tools for community development, particularly in rural towns being connected via a school connectivity project. But in the end, what I realized was that my role was as a mirror for the team to see itself.

As we had our final closing circle for an After Action Review before the project began its transition away from the organization to the Ministry of Education, we started with the first question “What did we intend to do?” That was pretty easy. The project had a clear mandate, goals, and measurable intermediate outputs. We transitioned quickly into “What did we actually do.” There were the things we had dealt with, change, reformations of assumptions and operating conditions, etc. No big surprises.

When we got to the third question, “What did we learn?” we sat for a moment in silence, pondering. You could feel something change in the room. The concern that the Ministry would muck it all up, unspoken, but present. The acknowledgement of grief of having to let the program grow was palpable. Maybe even a sense of failure, fearing the transition was untenable.

Then one of the amazing women of the program opened her mouth and helped us begin. She said something to the effect of “Nancy Jan, you have helped me realize how much we have grown in our ability to really support change in our communities.” Then it began to flow, and the group unearthed first changes in themselves, the lessons they learned. From there insights about structural and environmental factors emerged in ways that were constructive for subsequent work – for the Ministry’s and their own. Something broke open. It was no longer a laundry list of things done.

The ability to learn lessons about projects, to surface them and analyze them with sufficient clarity starts with the ability to learn about ourselves. To reflect on our ways of working, of perceiving the work we do, of our assumptions and blind spots. This team had started with little appreciation of their own skills, their ability to influence their partners and stakeholders, and their deep creativity sprung from their even deeper commitment to their work. If anything, they hid their own light.

I’m currently working on two projects that are, in essence, about how we learn from our work. One is the development of a self-paced eLearning module on Experience Capitalization, which is a process for describing project work, extracting lessons and recommendations, creating communications products and channels for those lessons so they can be seen, adapted and used by others with similar interests and goals. How do we build our individual and organizational capacity to do that? My mirror role is to try and understand and interpret the content created by subject matter experts, and see it through novice eyes.

The second project is as a very peripheral participant helping a knowledge management initiative pick up clues to what is being learned about the learning in the project. How do we notice useful bits, pick them up, reflect on them and share them? The team leader has expressed a very open willingness to start with himself, which is rare and wonderful. So mirrors up!

I keep going back to that moment in Armenia, and the same element emerges. We often don’t (or can’t) see what is right in front of us, mostly because we are too busy, working too fast, and can’t seem to find the “mirror” to stop and look ourselves in the eye and reflect. We may lack some basic structure or affordances TO reflect. What if we took time to reinsert reflection and these affordances into our work? Would something change?

Is it that simple?

I don’t think it is that simple, or that learning from doing IS simple. But this pattern of finding a moment to “be heard” – even if by our own selves, is critical to both identifying and internalizing/applying learning. It is that moment of taking a breath before we do something new, something technical or challenging. Focus. Attention.

So back to the mirror. When you ask someone, heck, when you pay someone else to help you learn, you take the time to learn. One of those odd incentives that seem silly because of course we want to learn. But we don’t. That’s when the mirror role comes in very handy.

As much as I LOVE being the mirror (it is a fantastic role), it is not a sustainable strategy when learning becomes a matter of importance as it is in my work in international development. Think of the learning that is, or SHOULD be going on now with the Ebola epidemic.

I am going to write about this a few more times in the coming weeks and months to try and whittle down one or two things that are actionable, doable and can be motivated from within to leverage more learning from our work, and helping it connect with others who may be able to use our learning.

Image by PhotoComIX on Flickr, Creative Commons

Where is the Cooperation in International Development and Cooperation

Warning: The following was written in haste, has repetition and can very much stand a good edit. But if I don’t hit post, this won’t go out. Life is busy.

Earlier today my friend and respected KM/KS practitioner Ian Thorpe Tweeted a link to a consultancy announcement.

kmtoolkittweet

I blithely responded:

Now, I was pretty tough on Ian and did not offer any context. Later this morning he posted a really thoughtful blog post on the thinking behind his organization’s desire to have their own internal Knowledge Exchange Toolbox. I started to post a comment, but the comment grew so large I decided a post here was called for.

I’m going to quote a sizable chunk of his post and then my response. But if this interests you, please go read the whole thing.

But, I think there are actually a few good reasons to reinvent or at least adapt.

People working in an organization tend to have more trust, and are thus more likely to use something that has been specifically created for them and has some form of official endorsement. This sounds like “not invented here syndrome” – but it’s not quite that.

The advantages of developing your own toolkit (or platform, strategy, bibliography, taxonomy etc.) include:

  • It can be written in the kind of language (and jargon and buzzwords) people in the organization understand
  • It can include tools selected to meet the specific needs of the organization, and the tools selected (even when sourced from elsewhere) can be adapted and tailored to the organizational context.
  • The tools can be tested on real organizational problems and the feedback obtained can be used to improve them and help communicate them better.
  • The tools can go through a quality review and sign off process that the organization understands and respects.
  • The fact that the toolbox is developed together with internal as well as external expertise means that staff know who they can follow-up with for advice and support on when and how to use them.

Overall these points mean that there is a sense of organizational ownership of the toolbox meaning not only is it officially sanctioned, but also officially supported and adapted to what the organization needs.

Thanks for adding really useful context, Ian. I find your reasoning totally logical. I have also heard it many times at other organizations.

First, can we connect usage to the factors you noted above in the context of ownership? Has anyone objectively looked at how usage of such a tool matters if it is internal or external?

I strongly suspect usage is driven by other, less visible, more informal things like seeing other peers use the tools, having colleagues they value endorse or role model, etc. I don’t have data. But in considering this,  I wonder about our assumptions about

  1. the use of these toolkits in general, and
  2. the importance of the points you make toward use (and improvements going forward).

Or are we just masking or missing the deeper, underlying issues? I really don’t know and I’d really LIKE to know.

I confess, I get totally frustrated when my own clients hire me to do things that are already done. The KS Toolkit came out of that frustration after three separate clients asked for the SAME thing and the differentiating factor was not whether the tool was on a private intranet or public, but branding. Yes, branding. Does that change the value of the toolkit? Should it?  Now, that said, over time the existing Toolkit product needs improvement. And your focus on adaptation is to me SUPER IMPORTANT. The issue of how to create and improve cooperatively sourced products alone deserves another blog post. (Note to self). But lets go back to rationale for internal vs. cooperative, shared resources.

I think a lot of the points you make are right on, but I also worry about some of the underlying causes that make these ideas of “needing internal validation,” “our language” and stuff so important in a field like international development and cooperation. From where I sit, I thought our field has shared goals.   So why do we have these counterproductive insider, invented here, not invented here, we are different from everyone else, etc attitudes? What do they represent? Control? Power? Fear? Territoriality? Reliance on the status quo?

Do we really understand if and why we need our unique products? Or is our vision too limited to see both the value and possibility for, and the mechanisms to cooperatively create, use, and improve resources?

Let me get more specific and look at each of Ian’s reasons for a customized product.

  • It can be written in the kind of language (and jargon and buzzwords) people in the organization understand. Having a sense of identity and ownership is important. But reinforcing organizational buzzwords and jargon does not help wider cooperation in the development field, no? Why might we want to reinforce this behavior? Think of the “beneficiaries” as well. Doesn’t our insider language and jargon distance us from them? 
  • It can include tools selected to meet the specific needs of the organization, and the tools selected (even when sourced from elsewhere) can be adapted and tailored to the organizational context. This is a compelling argument for internal platforms. Curation, adaptation and tailoring are really useful “value added” to a toolkit. But why not do that adaptation in a public, cooperative platform where others can learn from what you do, particularly those closest to your organizational domains. Why not do it WITH those others? Hm, as I write this, I wonder about shifting from “organizational” context to “practice” or “domain” context. So if tool X is more useful in working with Y population, lets make sure all of us working with Y population have access to that tool adaptation and can contribute towards its ongoing improvement?
  • The tools can be tested on real organizational problems and the feedback obtained can be used to improve them and help communicate them better. I can’t figure out the value of this being internal to an organization. Again, it relates to the practice, no? The global public good here is pretty darn high…
  • The tools can go through a quality review and sign off process that the organization understands and respects. Why can’t this happen in a cooperative platform? Heck, it might even contribute to better interorganization practices as a whole? And who is the arbiter of quality at the tool level when we rarely seem to care or pay attention at the application level where the IMPACT happens, right?
  • The fact that the toolbox is developed together with internal as well as external expertise means that staff know who they can follow-up with for advice and support on when and how to use them.  Again, I can imagine this same value on a public/cooperative platform.

Adaptation is an important thing we ignore very often in KM. There is too much sense that replication and scaling are the solution. So I deeply respect this aspect of adaptation that I sense in Ian’s response.

My “yes, and” perspective  is that what you learn/do through adaptation is of value beyond your org. And insights come from beyond your org. And your org exists for public good, right? Why not build more nuanced structures that facilitate open, public, crowdsourced resources, ones that add that layers of adaptation – for example there are other orgs sharing UNICEF’s targets and goals who might also benefit from this need to improve tools.

I fully know that what I’m suggesting is not easy. We have learned through the KSToolkit.org that people DO have different needs, need the material organized or expressed differently. But those reasons don’t appear to be organizational. They appear to be driven by the users context and practice. And that these contexts and practices vary WITHIN organizations, and are often shared ACROSS organizations. And cooperatively creating and supporting a shared resource doesn’t fit into most organizational process or budgeting parameters, so when we see things like the KSToolkit.org we are seeing the work of committed individuals who make things happen, often in spite of their organizations. (And deep bow to all of you, including Ian who has been a toolkit supporter.)

I think there is a much larger, more valuable proposition of opening up some of this work across organizations and getting off the  focus on our organizations. Lets focus on our goals and the ultimate reason we are doing this. So every human being has the right to and access to food, clean water, housing, education and human dignity.

So what are the barriers? What is it we are really avoiding by sharing this “knowledge infrastructure?” Is it convenience? When we work for global public good, what is the cost of this “convenience?” What is keeping us from shifting towards more cooperative and networked structures which can tap a potentially broader and more diverse set of expertise, share the burden of refinement, adaptation, improvement and just simply reduce this recreation? We all need and benefit from the process of adapting and improving tools.  Many of the tools in a Knowledge Exchange toolkit will have relevance to wider audiences. At the same time, so much of what is in these toolkits is not rocket science. What IS rocket sciences is the organizational shifts and changes that actually enable people to USE this stuff. Toolkits are just a resource. And this opens another Pandora’s box for another blog post!

I’ll say it. Lets start breaking down more walls instead of using what is convenient and conventional to maintain the status quo. And a little starting point like KM and KS toolkits seems like an ideal laboratory to find new, cooperative, networked ways to maximize value and minimize waste. Let’s recreate and improve together. Otherwise we are supporting wheel reinvention.

And Ian, thanks for lighting me up to write about this today. You have helped me clarify my thinking. The next two things we need to consider is what it takes to cooperatively create global public goods (and a lot of good people have been doing some great work in other domains from which we can learn), and how to move the tools from toolboxes into practice!

via Why we sometimes need to reinvent the wheel | KM on a dollar a day.

Ponderings on Network & Community Governance Part 1

Warning: LONG thinking-out-loud post! And note, the best stuff is in the comments!

For the last month or so there have been some very interesting conversations on the KM4Dev email discussion. One of them has been a reflection on the governance of KM4Dev, particularly the role of the current Core Group and the overall business model. KM4Dev has been around for over 10 years and grown to be a vibrant and respected community. It certainly is one of my very central communities of practice and I love and fret over it a lot. I was on the Core group from its inception until about 18 months ago when I stepped out, partly from burnout, partly from frustration, but keenly aware that my “just do it” attitude had longer term ramifications of people expecting me and the other “do-ers” to, well, just get it done. That is dis-empowering. (And I can be, um, a little dominating? 🙂 ) Now, back to the question of governance.

This begs the question, what kind of animal IS KM4Dev? A community of practice (CoP)? A loose, affiliated network of people interested in KM in development? A service? How should this inform our choices? Are there sufficient distinctions in the governance and supporting infrastructure of a larger network, versus a more bounded community? Or is it more dependent on the nature of that community or network?

As I read the messages, there were those who advocated a strong group for governance, for a paid secretariat staff. For formality. Others suggested developing multiple local offshoots and centralize the support functions in those volunteer hubs. From ideas for spin offs that embrace diverse business models, pleas for funding, to a very open, “let it be” model, all struck me as models that reflected each person’s world view.  Some  fundamentally urged the group to become more of an advocate for KM in development as a community, while others kept a more CoP-traditional perspective of the group as a place for its own learning. Do academics prefer more formality? What causes people to think paid positions are more generative for the community than volunteering? Are there ramifications beyond reliability? SOOOO many things to consider.

I then sent the following message to the group (this is just part of the message. It was a rambly, early morning thing!):

Here is my perception (NOT FACT) Those of us who prefer structure and some degree of formality discussed more about governance and secretariat (and I suppose, have a clearer idea about that differentiation. It is not a language used outside of development much here in the US!) Those of us who prefer informality (or perhaps, just fleeing too much structure!) emphasize the more emergent and adhoc options. Those who are taking a strong community lens focus on the community aspects of volunteerism and self organization. Those with a KM lens, (which in fact, have not stood out in my memory of reading these threads — INTERESTING) advocate for structures which focus on KM and finally, some have advocated structure that in fact advocates for international development.

How do we find your way forward with all these options? Furthermore, how do you discern options where people will “walk their talk” and pick up leadership. It is all nice and good to say “YOU should do this or that.” But in the end, if no one in the community is willing to step up to the tasks, all is probably lost. If no one cares enough to value and use what is provided – paid or not, what is it worth?

Consider this:  if you look at the number of people posting in the thread (less than 20?) compared to the list of members on the email list and/or our NING site (2500+), how do you reconcile the individual advocacy for a particular path forward with the huge, silent, larger whole? To whom does this “governance” thing matter? Is it important to those who simply see KM4Dev as an email list they can dip into when they need it – a sort of service? To those who avidly read, but rarely or never post for a host of reasons? To those of us who perhaps love KM4dev too much? 🙂

So I started doodling.  Is it useful to examine our governance and structure questions from a variety of lenses, and then find out if there is a sweet spot between them? From the conversation I discerned three possible lenses or perspectives including:  Community, KM (in development) and Advocacy for KM in Development. Here is what I sketched on my notebook.

governancescribbles

For example, philosophically I absolute love the idea that KM4Dev should be more altruistic and more actively serve development. The realist in me says this is a structural mismatch, that indeed, by focusing on community and KM, we become stronger agents of that wider change through other, more formalized structures (of our orgs, etc) and we become INFLUENCERS as a network.  But that does not exclude forays into advocacy. The lenses do not imply “either/or” but simply help us explore from a variety of perspectives. Here is a very imperfect first try and looking across the three example lenses :  

ThreeKM4DevLenses

If I look across the three, there is less difference between the community lens and the domain lens, while the advocacy lens presents unique benefits and needs. As noted above, it looks to be a far stretch for KM4Dev to pull that off. That said, KM4Dev might be an amazing incubator for a more focused group working on the advocacy.

So the next level of resource implications are about the degree of importance KM4Dev activities and artifacts have to be polished to the level of acceptance by development organizations and practitioners outside of the community. In other words, legitimacy beyond the community. This seems to require more infrastructure and thus more refined business models (funding) and processes.

So the question is, what does the community want and what can it pull off. And I’d personally add, how does it differentiate itself from yet another organization?

Help me improve my thinking.

P.S. If you look back up to the first image, you will see some scribbling on the lower right of the notebook sketch. I’ll post about that in the next blog post.  Stay tuned for Part 2 of Nancy’s Ramblings….