Zoom Logo

Decolonizing Evaluation & Research Series: A Conversation with Funders - Shared screen with speaker view
umbawuike
22:41
Audio for panelists are great
Lauren VanEnk
31:27
Colleen, are you able to share in the chat that definition of localization that USAID is using?
Colleen Brady, USAID (she/her)
31:55
Hi Lauren! Sure thing: At USAID, we understand localization as the set of internal reforms, actions, and behavior changes USAID is undertaking to ensure our work puts local actors in the lead, strengthens local systems, and is responsive to local communities.
Lauren VanEnk
32:10
thanks!
Rituu B Nanda (Global Fund for Children)
35:23
Thanks Colleen
Rituu B Nanda (Global Fund for Children)
35:37
Encouraging example David!
David Burt, Start Funds
36:24
https://startnetwork.org/resource/anti-racist-and-decolonial-framework
Colleen Brady, USAID (she/her)
37:32
https://usaidlearninglab.org/resources/participatory-evaluation-guidance-note
Charles Guedenet (He/His)
39:40
My experience is that participatory approaches that involve local stakeholders can inadvertently accentuate local power imbalances if it is not done intentionally with an inclusion lens that is grounded in an understanding of local power dynamics.
Rituu B Nanda (Global Fund for Children)
40:44
Yes Charles!
Marcel Janssen - Holt International (he/his)
40:44
Agreed, Charles
Colleen Brady, USAID (she/her)
42:19
Amazing point, Charles! I also think that evaluations being *led* by local evaluators is one way to build that deep understanding of local power dynamics into the process.
Rituu B Nanda (Global Fund for Children)
45:24
I coordinate Asia Pacific Evaluation Association's group on ‘Community ownership in Evaluation’. We would love to learn from different perspectives and viewpoints.
Ben Bestor, InterAction
48:17
To Rituu's comment, there was an APEA-associated webinar several weeks ago: "Shifting the power in MEL: NGOs and communities take ownership of MEL". I recommend others to check it out!
Ben Bestor, InterAction
49:12
https://app.mural.co/invitation/mural/aconversationwithfunders6492/1663787491395?sender=u0be4a082ea2e4430dadc4252&key=f69b9b22-cf5b-49aa-a321-97b5bfaba8a7
Tricia Ryan (she/her)
51:09
Anyone else being asked to create an account?
Rituu B Nanda (Global Fund for Children)
51:49
Yes Tricia, me too
Ben Bestor, InterAction
52:22
Sorry to hear that Tricia. As a backup, feel free to write your thoughts in the Zoom chat and I will transfer them onto a card in MURAL.
Rituu B Nanda (Global Fund for Children)
52:36
Ben, I will do that as well. Thank you
Mary Sue Smiaroski - OIS
53:17
yes, asking me to create an account
Mary Sue Smiaroski - OIS
54:06
Funding organizations have to be open to teams asking much more strategic questions (beyond the questions underlying the OECD criteria)
Ben Bestor, InterAction
55:18
Great, thanks, Mary Sue! Your thoughts now live in MURAL.
Rituu B Nanda (Global Fund for Children)
55:39
Communities collect data for their use, assess their own progress and take action on it. Our definition of communities- those most affected by the issue or with the lived experience particularly youth and children.
Andres
57:20
we expect a support that accepts that this is experimental by nature, so open to explore the unknown and learn and build from it.
Ryan Brenner
57:30
Funding organizations need to ensure their evaluation methods indicators, and learning questions are conflict-sensitive.
Zdena Middernacht- ODS
58:18
The participation of communities needs to start at the design stage of evaluations, not only the data collection and dissemination stages.
Rituu B Nanda (Global Fund for Children)
59:26
yes Zdena
Rituu B Nanda (Global Fund for Children)
59:42
Great point @Andres
Clara Hagens
59:43
How about developmental evaluation? Do folks have experience with that in including more stakeholders and responding to voice?
Rituu B Nanda (Global Fund for Children)
01:02:20
Clara, I have facilitated Systemic Participatory action research similar to developmental evaluation
Colleen Brady, USAID (she/her)
01:02:51
USAID has conducted a number of really interesting developmental evaluations. You can learn more about them here: https://www.usaid.gov/PPL/MERLIN/DEPA-MERL
Rituu B Nanda (Global Fund for Children)
01:03:23
Thanks Colleen.
Colleen Brady, USAID (she/her)
01:03:23
(I know I have several other colleagues on the line, and invite you to share any great examples you know of as well!)
Clara Hagens
01:04:26
Thank you
Rituu B Nanda (Global Fund for Children)
01:04:27
What wisdom in this group
Clara Hagens
01:06:19
Yes - auto translate is getting fantastic. I think we are there soon.
Eleanor Davey, Humanitarian Advisory Group
01:09:29
In your experience, are there areas that funders feel they can't evaluate or understand, but wish they could? Do you see these as being linked to the historical reliance on certain approaches?
Mary Sue Smiaroski - OIS
01:09:47
thanks for organizing this reflection, this was so interesting.
Marcel Janssen - Holt International (he/his)
01:10:01
In Guatemala we used to do bilingual subgrants for a USAID funded project. Worked well, but is only possible if local laws allow that.
Colleen Brady, USAID (she/her)
01:10:12
Also: Administrator Power mentioned in the panel at UNGA this week (where you were, I believe, Gunjan!), that some procurement processes and proposals can also be accepted in other languages.
Gunjan, Movement for Community-led Development Zoom
01:10:59
@colleen she did!
Ryan Brenner
01:14:39
USAID is asking for comments on beneficiary feedback mechanisms currently as well.
Colleen Brady, USAID (she/her)
01:16:59
Yes! to Ryan's point, we really are looking for feedback on this. You can view this here: https://www.workwithusaid.org/blog/request-for-public-external-comment-on-collecting-feedback-from-beneficiaries-of-development-programs-a-guide-for-usaid-implementing-partners?mode=preview
Gunjan, Movement for Community-led Development Zoom
01:19:40
https://mcld.org/research-tools/ This is the tool I mentioned that looks at how organizations can assess the quality of evaluations not just from the traditional lens of rigor but from the cld lens too
Rituu B Nanda (Global Fund for Children)
01:20:07
Great Colleen!
Colleen Brady, USAID (she/her)
01:21:52
+1 Subarna -- it's an ongoing work!
Charles Guedenet (He/His)
01:22:04
Really good point. To decolonize evaluation, you need to also have decolonization in organizations and programs.
Subarna Mathes
01:25:56
part of it is not to feel inertia b/c the challenge is so big. I have to believe the small steps get us to something.
Ben Bestor, InterAction
01:25:57
Interested in InterAction's Evaluation & Program Effectiveness Community of Practice? Do you have decolonization/localization examples to share? Reach out to Ben Bestor (bbestor@interaction.org).
Clara Hagens
01:26:00
Fantastic event and discussion - thank you
Rituu B Nanda (Global Fund for Children)
01:26:00
Thanks Ben and Gunjan for your excellent facilitation.
Subarna Mathes
01:26:23
thank you Gunjan. thank you Ben.
Elliot Signorelli (USAID)
01:26:24
Great panel discussion. Thanks everyone!
Annie Conaghan
01:26:51
And if you could save the chat thread! Great discussion there as well
Eskedar Dejene
01:26:53
Really great discussion. Thank you.