Audio for panelists are great

Colleen, are you able to share in the chat that definition of localization that USAID is using?

Hi Lauren! Sure thing: At USAID, we understand localization as the set of internal reforms, actions, and behavior changes USAID is undertaking to ensure our work puts local actors in the lead, strengthens local systems, and is responsive to local communities.

thanks!

Thanks Colleen

Encouraging example David!

https://startnetwork.org/resource/anti-racist-and-decolonial-framework

https://usaidlearninglab.org/resources/participatory-evaluation-guidance-note

My experience is that participatory approaches that involve local stakeholders can inadvertently accentuate local power imbalances if it is not done intentionally with an inclusion lens that is grounded in an understanding of local power dynamics.

Yes Charles!

Agreed, Charles

Amazing point, Charles! I also think that evaluations being *led* by local evaluators is one way to build that deep understanding of local power dynamics into the process.

I coordinate Asia Pacific Evaluation Association's group on ‘Community ownership in Evaluation’. We would love to learn from different perspectives and viewpoints.

To Rituu's comment, there was an APEA-associated webinar several weeks ago: "Shifting the power in MEL: NGOs and communities take ownership of MEL". I recommend others to check it out!

https://app.mural.co/invitation/mural/aconversationwithfunders6492/1663787491395?sender=u0be4a082ea2e4430dadc4252&key=f69b9b22-cf5b-49aa-a321-97b5bfaba8a7

Anyone else being asked to create an account?

Yes Tricia, me too

Sorry to hear that Tricia. As a backup, feel free to write your thoughts in the Zoom chat and I will transfer them onto a card in MURAL.

Ben, I will do that as well. Thank you

yes, asking me to create an account

Funding organizations have to be open to teams asking much more strategic questions (beyond the questions underlying the OECD criteria)

Great, thanks, Mary Sue! Your thoughts now live in MURAL.

Communities collect data for their use, assess their own progress and take action on it. Our definition of communities- those most affected by the issue or with the lived experience particularly youth and children.

we expect a support that accepts that this is experimental by nature, so open to explore the unknown and learn and build from it.

Funding organizations need to ensure their evaluation methods indicators, and learning questions are conflict-sensitive.

The participation of communities needs to start at the design stage of evaluations, not only the data collection and dissemination stages.

yes Zdena

Great point @Andres

How about developmental evaluation? Do folks have experience with that in including more stakeholders and responding to voice?

Clara, I have facilitated Systemic Participatory action research similar to developmental evaluation

USAID has conducted a number of really interesting developmental evaluations. You can learn more about them here: https://www.usaid.gov/PPL/MERLIN/DEPA-MERL

Thanks Colleen.

(I know I have several other colleagues on the line, and invite you to share any great examples you know of as well!)

Thank you

What wisdom in this group

Yes - auto translate is getting fantastic. I think we are there soon.

In your experience, are there areas that funders feel they can't evaluate or understand, but wish they could? Do you see these as being linked to the historical reliance on certain approaches?

thanks for organizing this reflection, this was so interesting.

In Guatemala we used to do bilingual subgrants for a USAID funded project. Worked well, but is only possible if local laws allow that.

Also: Administrator Power mentioned in the panel at UNGA this week (where you were, I believe, Gunjan!), that some procurement processes and proposals can also be accepted in other languages.

@colleen she did!

USAID is asking for comments on beneficiary feedback mechanisms currently as well.

Yes! to Ryan's point, we really are looking for feedback on this. You can view this here: https://www.workwithusaid.org/blog/request-for-public-external-comment-on-collecting-feedback-from-beneficiaries-of-development-programs-a-guide-for-usaid-implementing-partners?mode=preview

https://mcld.org/research-tools/ This is the tool I mentioned that looks at how organizations can assess the quality of evaluations not just from the traditional lens of rigor but from the cld lens too

Great Colleen!

+1 Subarna -- it's an ongoing work!

Really good point. To decolonize evaluation, you need to also have decolonization in organizations and programs.

part of it is not to feel inertia b/c the challenge is so big. I have to believe the small steps get us to something.

Interested in InterAction's Evaluation & Program Effectiveness Community of Practice? Do you have decolonization/localization examples to share? Reach out to Ben Bestor (bbestor@interaction.org).

Fantastic event and discussion - thank you

Thanks Ben and Gunjan for your excellent facilitation.

thank you Gunjan. thank you Ben.

Great panel discussion. Thanks everyone!

And if you could save the chat thread! Great discussion there as well

Really great discussion. Thank you.