alumni | TechChange | The Institute for Technology and Social Change

Several months following the completion of the program, we sat down with Royce Escolar, Monitoring & Evaluation and Communications Officer and M&E Diploma Track graduate, to hear about how the program affected his professional development, ambitions, and projects.

Q: How did you find out about TechChange, and how did you become interested in taking courses?

I found out about TechChange by googling courses on Monitoring and Evaluation (M&E). I knew that I had to constantly learn new tools and approaches to enhance my skills in M&E given the fast-paced changes in the sector. The use of technology to enhance M&E and how to best present and visualize M&E data were what attracted me most when I decided to take up TechChange’s diploma track.

I previously had a chance to coordinate work with USAID when I was with AusAID. It was good to know that USAID had and still continues to use TechChange to train their officers. It was an indicator for me that the courses offered by TechChange are of high quality and value to a key player in the international development sector.

Q: Have you taken online courses before?

I surely did. I took my Masters in Evaluation from University of Melbourne via distance learning from 2012 to 2013. This was a two-year part-time curriculum which allowed me to work full-time during the day and study after work hours.

Q: How would you compare the TechChange experience to other online course experiences?

TechChange provided a much more fun and practical learning experience by creatively incorporating multi-media in the courses. I really enjoyed how the topics and courses were presented using easy to understand language. TechChange also gave us lots of opportunities to practice and use the M&E tools and software, including insights on the context where the tools would be most relevant. I also valued the sharing of experiences from guest resource persons via video and the sharing from other course participants.

Q: How have you been able to use what you learned at TechChange in your work?

Yes, I have used Canva.com a couple of times in creating infographics to better present the outcomes from capacity development initiatives funded by our program. A copy of one infographic I made is available in our program website at: http://aanzfta.asean.org/program-highlights/

I have also used what I learned on data visualization in developing a communication package to be presented to Economic Ministers from 12 countries party to a regional free trade agreement. This package will be finalized and uploaded to the website (http://aanzfta.asean.org/) by end-September 2017.

By Dec 2017, I will revive my own blog on M&E (http://royceescolar.wixsite.com/evaluation) which has been inactive since early 2016 when I took a full-time job. I plan to post some of these data visualization products in my blog and write articles reflecting on my experiences and the process in developing these data visualization products.

Q: Would you recommend the Technology for Monitoring and Evaluation Diploma to a friend?

I would definitely recommend TechChange and the Diploma track on technology for M&E!!!

Above graphic by Royce for the AANZFTA-ASEAN program website
Featured image: ASEC – Community Relations Division

What stories would you tell with data from your daily life?

In September 2014, two award-winning information designers living on different sides of Atlantic, Giorgia Lupi and Stefanie Posavec, collaborated on a year-long project to collect, visualize, and share information about their daily lives. Each week they would hand-draw representations of their activities and thoughts as part of a process to use data to become more humane and connected on a deeper level. The end result is Dear Data: an award-winning project to make data artistic, personal, and open to everyone.

(Watch starting at 6:45)

In Spring 2016, we asked online students in our Tech for Monitoring and Evaluation Online Diploma Program to try their hand at a similar month-long project and send postcards to one another. As we have 110 students in 35 countries, many of whom had only just met in the preceding weeks, this provided an excellent opportunity to recreate some of what made Giorgia and Stefanie’s project so special. And it gives me great pleasure to share some examples of their work.

For one project, two of our students (Madison and Ann, who both work with Health Policy Plus), sent one another postcards every week on the following four topics:

Daily activities
Social media
Food
Emotions

These postcards are presented without commentary below, so that you can see the postcards as they did.

When asked for their reflections as part of the exercise, both Madison and Ann claimed that the process made them mindful of issues and habits that they had previously ignored, and that they were able to discern larger patterns when looking at their week as a whole. Though neither were professional information designers, their work improved over multiple iterations, as well as became a fun, inclusive process.

“Our different styles quickly became apparent and added to the reflective learning. Apparently Madison is calm and cool, and Ann is, well, a bit excitable,” said Madison.

“The involvement of friends and family was an unplanned bonus. Visualization and art attracts attention…they got drawn in (especially Ann’s 10 year-old son Harry) and got a kick out of seeing what arrived in the mail,” said Ann.

And both agreed: “Overall it was a fun challenge—we highly recommend it. Many thanks and acknowledgement to Giorgia Lupi and Stefanie Posavec, the Dear Data creators”

If you’re interested in learning more about how you can better collect, visualize, and make decisions based on data, check out our 16-week Tech for Monitoring and Evaluation Online Diploma Program and enroll today. First course in the track starts September 12th.

Week 1: Days in My Work Week

Week 2: Social Media

Week 3: Food

TechChange courses are designed for busy young professionals. Today we are very excited to chat with Grace Kim, the project manager for the Global Innovation Exchange, who participated in TC103: Technology for Disaster Response. She discusses her experience with the overall program, and how it has impacted her work.

Q: Why did you decide to enroll in the Tech for Disaster Response course?

I spent 8-years as a software sales executive at IBM and several startups, but I had always wanted to focus on T4D. My initial plan was to try T4D from the private sector side, but soon realized that most companies have not integrated products and services serving the development industry into their core business. This makes it difficult to find a full-time, dedicated role focusing on T4D in the private sector. In May 2015, I decided it’s time to change careers, but felt I needed to brush up on development technology. I have always been interested in disaster response and humanitarian aid, but never really figured out how to break into that sector. So I searched online for courses, TC103 came up…and the rest is history!

Q: How did the Technology for Disaster Response course impact your professional life and/or professional development?

While I was taking TC103 in June 2015, I was spending more time and effort (by choice!) on the course than on my day job. It made me realize that life is too short to spend my life doing something that I was not passionate about so I LEFT MY JOB! During my “funempoyment”, I did 60 informational interviews in DC between August and November (Chris Neu, COO of TechChange, was #38 and Nick Martin, CEO of TechChange, was #51) and landed my job at USAID by the end of December. TC103 helped me to learn very quickly about the technologies available in disaster response and develop a network of practitioners in this space. Being able to name drop relevant organizations and people during my informational interviews and job interviews allowed me to demonstrate that I wasn’t a complete foreigner coming from the private sector.

Q: What caught your attention about TechChange courses, or got you interested in taking them?

First, TechChange offered a course that was of personal interest to me – technology for disaster response. Second, it was affordable for me to pay out of pocket. Third, the platform was really easy to use, and encouraged participation and collaboration between students so I truly felt that I got to develop some good relationships with other classmates. Fourth, the instructor, Timo Leuge, was very knowledgeable and brought experts in the field as guest lecturers, which I thought, were really great.

Q: What would be an advice to other participants taking a TechChange course? How can they get the most out of it?

1. Do all the reading because you will learn a lot from them. 2. Participate in the course and earn points (for your certificate) by commenting and jumping in on various discussion strings. You will feel more connected to your classmates. 3. Visit the TechChange office in DC…they are super friendly!

Q: How have you been able to use what you learned in the courses in your work, and how has the program overall been helpful to you?

The Global Innovation Exchange covers all sectors in development so I’m using the learnings from TC103 to make sure that we have the disaster response/humanitarian aid sector content developed in terms of innovations, funding opportunities, resources and events relevant to this sector.

Q: What is the Global Innovation Exchange?

The Global Innovation Exchange is an online platform that is a “one stop shop” for development innovations, funding opportunities, resources and events. It is free to create an account to connect with like-minded individuals and experts, browse content by sector/topic/region, and share your expertise for the benefit of the global development community. The goal is to democratize and provide equitable access to information, reduce duplication, and allow us all to make informed business decisions across the development industry. It’s a great tool to see what people are working on and where, and search for funding opportunities, resources and events that is relevant to you.

Q: Are you new to the ICT4D sector?

Yes, although I’ve kept a pulse on T4D even when I was in the private sector, joining the Global Development Lab is my first job in the T4D sector.

Q: Would you recommend TechChange courses to a friend?

100%!!! It is great to see TechChange evolving to offer new courses like the diploma course in M&E and white labeling courses for organizations. What’s truly beneficial is that the instructors are practitioners who bring real-life experience to the course along with their network of experts who guest lecture.

About Grace:

Grace Kim is a Korean-American returned Peace Corps Volunteer from Los Angeles. She spent over 15 years in the private sector in environmental consulting, digital development and enterprise software. And recently, she joined USAID | Global Development Lab as the project manager for the Global Innovation Exchange.

In 2015, TechChange launched the Technology for Monitoring & Evaluation Diploma Program, which combined three TechChange courses (Tech for M&E, Tech for Data Collection and Survey Design, Tech for Data Visualization) into one comprehensive program. The program was meant to give busy working professionals a robust foundation in technology for M&E through the three core courses as well as workshops and office hours with course facilitators. Our first cohort is finishing up the program as we begin 2016, and a new session will launch on January 25.

Today we are very excited to chat with Sonja Schmidt, the Senior M&E Advisor to JSI’s AIDSFree project, who is one of the first participants to complete the Technology for Monitoring & Evaluation Diploma Program: Working Professionals Experience. She discusses her experience with the overall program, how each course influenced her work, as well as how she was able to better understand the use of ICTs in M&E.

How did you come across the Tech for M&E Diploma Program?

A colleague of mine from JSI had sent around some links for TechChange courses. When I clicked the links I noticed the Diploma Program, and thought that this would be a good option to take advantage of the three courses in order to get a wider foundation on the topic.

Have you taken online courses before? Did the program meet your expectations?

I had never taken an online course before, so this was a very new experience for me. I found it challenging in the beginning, particularly with the first course that I took, because I initially felt overwhelmed and struggled a bit with learning how to move around the platform and managing the material.

That being said, the program far exceeded my expectations. I have to compliment TechChange because, being an M&E expert, I look at most material with a critical eye, but I found that the material that was put together and all of the speakers/guest experts were stellar. I was also quite pleasantly surprised by the group dynamics present on the platform. I did not expect this from a virtual group, but in the end there were names that kept popping up, and I actually had the chance to meet someone from the course in person – I am almost said that it has ended.

Are you new to the field of M&E? If not, why did you think this would be valuable to your career?

I have many years of experience in the M&E field. Despite this fact, I realized that the concept of ICT and M&E emerged on the scene pretty suddenly – it did not really exist as an articulated concept even as recently as 3 years ago. I remember meeting someone a few years back who had created his own company around an app meant to improve data collection for surveys, and was surprised because I never thought that that would take off. Now, several years later I find it fascinating how this has become mainstream.

So, my main reason for taking the program was to learn more about this new and rapidly changing field, the intersection of technology and monitoring & evaluation, and get a better grasp of it.

How have you been able to use what you learned in the courses in your work, and how has the program overall been helpful to you?

I have definitely been able to use what I learned in the courses, and the Diploma Program, as foundations for my work. The Technology for M&E course, while a bit repetitive for me sometimes, as I’m an experienced M&E professional, still provided me with exposure to new materials as well as to other people’s perspectives and approaches. The Technology for Data Collection & Survey Design course was not as applicable to my personal work, however it did improve my capacities as an M&E advisor in terms of being able to recommend methods or software, or considerations to take into account, to in-country M&E folks who might be the ones actually designing M&E programs themselves. The Technology for Data Visualization course is the one that had the most impact on my work directly, because a big part of my work is reporting to stakeholders and presenting data. The Introduction to Excel for Data Visualization course was also extremely helpful because it is a familiar software, and Excel is something that I will always use; especially for organizations that do not have much funding, Excel is a very powerful and useful tool.

In general, I think the courses were useful in my work in that when I come across a particular issue, I can now think in a way where I ask myself how I can improve or do something better. I can then go back to the material and target specific areas and continue to use the program material as a tool for learning in my work. I am also currently working on developing a training in Tanzania on data quality, and I plan to discuss with my colleagues ways to use, for example, phones to more quickly submit data from site facilities to our central office.

Interested in the TechChange Technology for Monitoring & Evaluation Diploma Program? Get more information and apply here. Enrollment is open and on-going, but our next batch of courses begins January 25, 2016. It is still not too late to sign up and join this amazing program with participants from all corners of the globe!

About Sonja
Sonja has over 15 years of experience in international public health, with a focus on infectious diseases, including TB, HIV/AIDS and immunization programs. She has long-term country experience in Bangladesh, India, Nepal and Ethiopia and has worked for several UN organizations (UNIFEM, UNICEF, WHO) and numerous USAID-funded projects. Currently as the Senior M&E Advisor to JSI’s AIDSFree project, she oversees and coordinates the monitoring and evaluation of the project and guides country projects in M&E planning, data quality assessment, data analysis and use. Sonja has an MA in medical anthropology and an MPH with a focus on policy and management.

TechChange courses are designed for busy young professionals. In any of our courses, you will find yourself taking the course alongside international development field and headquarter staff, university professors and students, freelancers, and so many other kinds of eager learners. Today, we are excited to chat with Amira Elibiary, who is an M&E specialist and works for Tshikululu Social Investments in South Africa. After she submitted an insight piece she wrote about M&E as a result of her participation in our Technology for Monitoring & Evaluation course, we caught up with Amira to talk about her overall experience with the course and how it has impacted her work.

Q: How did you find out about TechChange, and what made you interested in taking a course?
I am a member of the MandE News Yahoo Group, which is a practitioner group for M&E professionals. Someone posted information about TechChange and the course in the group, so that is how I initially found out about it. At my organization, Tshikululu Social Investments, which is a fund manager for corporate social investment, I’ve been grappling with conducting data collection in an efficient manner and the M&E process in general. I decided to take the course to see what tools are out there because I felt that I was getting stuck in terms of thinking of new ideas.

Q: Have you taken online courses before? What did you think of the TechChange course and the style?
I had taken several online courses with other organizations before I took this Technology for M&E course with TechChange. I found it a bit hard at first to get accustomed to and navigate the platform, but once I got used to it I really enjoyed the course and the setup. I liked the TechPoints system, which did not exist in other courses I had taken. The TechChange course was also definitely more interactive than the other courses I had taken. I was able to have discussions with other participants in the course, and most of my problem solving and ideas came from this sort of engagement with other students and from hearing their experiences. The content of the course was also great, especially the guest speakers.

Q: What level of experience did you have with tech for M&E going into the course?
I work a lot in the M&E field but going into this course I knew about some tech for M&E tools, but I didn’t have a lot of exposure to and experience with them. This did not pose a problem for me, however – the material was not hard to understand or to follow, and has definitely increased my knowledge of the M&E field as well as the various tools out there.

Q: How did you use what you learned in the course at your job and in your work?
I would say that the main way that what I learned in the course has been applicable to my work is in terms of bringing in more ideas. At work we get a lot of different service providers that come to us offering us their tools, and I feel that now I am more knowledgeable and better equipped to decide between these tools.

More specifically, the guest expert that spoke about the issue of privacy has impacted my work as well. The insight piece that I wrote for my company’s blog about the issue of privacy and M&E was in part a result of my participation in this course. This presentation made me stress the issue of privacy more with my colleagues. As M&E practitioners, we are aware of this issue but maybe don’t think about it as actively as we should. This aspect of the course brought more attention to the fact that it is people that we are collecting data from, not just numbers.

I also have begun to think more about local contexts. For example, in the course we talked about how most people in the developing world are connecting to the online world via mobile phones rather than desktop or laptop computers, which many still do not have. This has caused me to consider that perhaps we should begin to use some mobile tools for M&E, or at least be choosing tools that are also mobile compatible.

Q: What advice would you give to other participants in order to for them to succeed in the course and gain the most from this experience?
When I was taking the course I didn’t always have time to attend all the guest expert sessions live because I was busy with work; I went back and watched most of them later in the months following the end of the course. I do regret not attending more of the events live because it would have been a much better tool for learning and I would have had the opportunity to ask more questions directly. So, I would probably tell students that they should browse through the course calendar at the beginning of the course and pick a few live events during the four-week period that they are most interested in and plan into their schedules to attend those.

The second piece of advice I would give to students is to actually use and take advantage of the knowledge within each course participant. There are a huge range of participants that all have different backgrounds and areas of expertise and, as I mentioned earlier, most of my problem solving was a result of discussions that I had with other participants.

Interested in taking this course? New session begins January 25, 2016. Apply and sign-up for our Technology for Monitoring & Evaluation course here in order to gain new skills and join an incredible network of professionals from all over the world! For a full list of the courses we offer, feel free to visit our online course catalogue.

About Amira

Amira Elibiary is a Monitoring and Evaluation (M&E) specialist with 10 years of experience in research, grant-making and program management; over two years of experience in the corporate social investment sector for education, health and social development projects. With a keen interest and extensive experience in democracy, governance, advocacy and rule of law work. Amira holds a Master’s degree in International Affairs from American University and a BA degree in Economics.

TechChange courses are designed with busy working professionals in mind. In any of our courses you will find yourself engaging with a vast network of participants from all corners of the globe who bring with them unique experiences and perspectives.

Today, we are excited to chat with Amy Noreuil, a Technology Advisor working at USAID’s Office of Transition Initiatives. Amy has taken seven TechChange courses to date, both on-demand and facilitated. We caught-up with her to chat about her overall experience with TechChange as well as how our courses have impacted her professional life.

How did you find out about TechChange, and what caught your attention about TechChange courses, or got you interested in taking them?

I’ve been following TechChange for a number of years, but I think the first time I ever heard about it was through a TechChange-hosted happy hour where I ran into Chris Neu, Chief Operating Officer of TechChange. My curiosity was piqued because I always want to know about other initiatives going on when it comes to the use of technology for social good. I love going out and hearing about new projects that are under way to figure out how they could support our work or how we could support them. I’m a contextualist at heart – I believe the impact of technology can vary widely depending on the context – so I’m always interested in learning from the experience of others. I found the sense of community and diversity of students participating in TechChange courses to be one of the biggest assets. Everyone brings a unique perspective to the ‘classroom.’

After completing your first course with TechChange, what made you decide to enroll in more?

The first course I took with TechChange was Mapping for Social Good. After that first class, what drew me in – and what has kept me coming back to TechChange – is the people. To me, virtual learning experiences are inherently more individual experiences, but TechChange courses provide the opportunity to connect with other students and take what started as a quick chat to a more nuanced conversation. The interaction can be customized to what you want and need – a quick exchange of resources (e.g. reports, toolkits, etc.) or a deeper discussion about intended and unintended impact. The user interface is easy to navigate and caters to different learning preferences, including visual learners like me. It provides a high-level survey of topics or applications, while also giving the user the option to dig into the technical details of specific tools.

You’ve now taken seven TechChange courses – how have they impacted your career as a technology advisor for USAID’s Office of Transition Initiatives?

TechChange courses allow me to discover new tools as well as share experiences and insights with a wide range of people. I’m always looking for ways to break out of traditional silos.

The three major ways in which TechChange courses have impacted my work are:

Meeting people who are passionate about the intersection of technology, media & data
Finding tools and workshopping how they could support our partners and programs
Connecting with people who bring different perspectives, ideas and approaches

What is your advice for other students participating in TechChange courses? How can they get the most out of the experience?

Come into the course with an idea of what you want to learn. Set your intention early and be open to change. This learning objective will help you navigate course content and connect with students. The facilitators are very approachable and accessible. I also really encourage participants to meet up in-person and offline with students who live in the same geographic area. There’s no replacing that face-to-face connection. Developing a community of practice and creating an environment that facilitates learning takes time and commitment. I’m excited to see the TechChange community continue to grow and change.

Interested in learning more about TechChange courses? Check out our online course catalog here! We will be launching new sessions of several of our most popular courses in the New Year!

About Amy

Amy is the Technology Advisor at USAID Office of Transition Initiatives (OTI) where she supports staff as they decide how to integrate the use of information and communication technologies into their programs. She loves supporting co-creation spaces, leading digital literacy efforts and working closely with local staff to provide an outside perspective on the design of small grants. OTI supports U.S. foreign policy objectives by helping local partners advance peace and democracy.

TechChange courses are designed for busy young professionals. In any of our courses, you will find yourself taking the course alongside international development field and headquarter staff, university professors and students, freelancers, and so many other kinds of eager learners. Today, we are excited to chat with Eva Erlach, who is a full-time law student in Vienna, Austria and also works part-time for Ground Truth Solutions. Eva recently took our Technology for Data Visualization course. We caught up with her to see how she was able to apply what she learned in the course.

How did you come across the TechChange course?
At Ground Truth Solutions, I am regularly tasked with producing reports on the perceptions of crisis-affected people during humanitarian actions. In order to visualize the data, I was looking around for the best resources to learn more about data visualization. I came across TechChange’s Tech for Data Visualization course on Twitter and my employer helped me pay for the course.

Have you taken online courses before? What did you think of the TechChange course?
This was actually my first online course and I was very impressed. The ability to interact with other participants in the course was great! Also, since the live events with guest experts were always recorded, and I could revisit the course materials for four more months, it really gave me flexibility to manage my time to make the most out of the course. There were a lot of resources — which is always better than having less — and that gave me freedom to either just get an overview of the topic or dig deeper on the topics most useful to me.

Are you new to data visualization?
I have actually been doing data visualization for a while, and mainly on Excel. I also knew of the other data visualization tools but wasn’t sure which ones were good ones and how to really work with them. This course gave me the insights I needed on different data visualization tools. It also helped me see that you can do much more data visualization just with Excel. Most of the other data visualization software tend to be expensive, so learning more about data visualization on Excel was great.

How did you use what you learned in the course at Ground Truth Solutions?
I worked on Ground Truth Solutions’ three reports on community perceptions in the Nepal crisis. As part of the Inter-Agency Community Feedback Project, Ground Truth’s role is to provide the government of Nepal and aid agencies with real-time feedback from affected people and recommendations based on that feedback.

Our audience for this report were agencies involved in the humanitarian response in Nepal. Since the agencies wanted to be able to print and disseminate the reports to field staff as well as email to their branch offices, we decided to do a pdf report instead of an interactive dashboard. I used R for the analysis and created the graphs on Excel. I then created the maps on Inkscape, and used a python script for the labels and colors.

A snapshot of Ground Truth Solutions’ Community Survey Report 3

I was able to visualize the data in a better way because of the course. The reports are available on our website to download and we have been promoting it all over social media.

How has the course been useful to you?
The course really allowed me to understand data visualization on a deeper level, and to realize that we really need to think about the audience for any visualizations you work on and the kind of message you are trying to communicate through the visualization.

Would you recommend this course to a friend or colleague?
Absolutely!

Interested in learning more about how to use technology for your organization’s data visualization needs? We start our next Technology for Data Visualization online course on Monday, November 23! Join participants like Eva in this four-week online course!

About Eva

Eva Erlach is a program analyst at Ground Truth Solutions. The aim of Ground Truth is to support humanitarian actors to systematically listen and respond to the voices of affected people. Eva holds an undergraduate degree in Development Studies and is currently finishing her law degree at University of Vienna, specializing in human rights. She has volunteered on social projects in India and Uganda and has experience in the field of asylum law and domestic violence.

By Kevin Flanagan and Yuting Liao

A few weeks ago, my colleague Yuting Liao and I had the opportunity to attend MERL Tech—an industry conference of sorts designed to bring together M&E practitioners, researchers, technologists, and development professionals—on behalf of the Monitoring, Evaluation, and Learning (MEL) team at the National Democratic Institute (NDI).

At NDI, the MEL team is always on the lookout for innovative M&E practice that can be effectively applied to the democracy and governance sector and this event seemed like an excellent opportunity to explore the “big ideas” and partake in a larger discussion: what can information and communication technologies (ICT) offer to monitoring, evaluation, and learning work as the pressure to integrate ICTs into many aspects of development programming continues to rise.

Offering nearly thirty presentations, the event provided us ample opportunity to sit back and revel in the opinions of the experts, as well as contribute meaningfully to roundtable discussions and collaborative brainstorming activities. As such, these are the five takeaways:

1. More data does not necessarily mean more learning

ICT can make data collection easier, however, it’s crucial to ask the question: is this the data we need? “Big data” is enticing and a common mistake of the novice researcher is: let’s collect as much data as we can. But will that data answer your evaluation questions or will it simply be distracting? While collecting larger volumes of data could certainly result in unexpected observations, if data collection is not strategically tied to your evaluation questions, it does not necessarily lead to better learning. Quality is more important than quantity.

2. ICT can increase the level of risk for the subjects of the evaluation

Data hacks happen, so start by being scared. Whether we want to admit it or not, ICT implementations introduce additional risks to M&E work, particularly when it comes to privacy and data security. And yet, too often M&E practitioners don’t address the risks until after a breach happens. Worry about this in advance and create a threat model to assess assets, risks, and vulnerabilities.

3. Be a data-led organization, not just data-driven

While ICT does help improve data accuracy, organizations that embrace a “data-led” mentality will empower their users to strive to better understand data and incorporate it into their decisionmaking processes. Successful learning initiatives rely on better interpretation and analysis of data, and ICT for evaluation is useless without capable analytical and sector experts.

4. ICT can expand your sample size, but be mindful of the unexpected challenges in sample bias

When collecting data, ICTs can expand the reach of your evaluation efforts, creating opportunities to capture data beyond the traditional “beneficiaries” of a program. However, the “digital divide” may perpetuate the issue of sample bias, and your results may be valid only for those segments of the population with digital access.

5. There’s no ICT “quick-fix” to improve monitoring & evaluation

While it’s possible to achieve a high level of methodological rigor through carefully designed ICT studies, it’s not always easy to do so—often being technically complex, expensive, and time-consuming. Most importantly, effective ICT is built on sound monitoring & evaluation strategies, and incorporating ICTs into M&E requires long-term institutional commitment and evaluation capacity development.

Despite the wide breadth of content, there was a common theme: “It’s ok to reinvent the wheel, not the flat tire.” These words spoken by Susan Davis during a five-minute “lightning” presentation, struck an unexpected chord with the audience, attendees and presenters alike. Whether these are words of comfort for the tech-timid or caution for the tech-tenacious, Davis pointed us all to the indisputable fact that it’s okay to look to new technologies to address old problems in development as long as we are all aware that any new process, tool, or approach has just as much potential to fall flat as did their predecessors. The successful integration of M&E and ICT is fully reliant on sound monitoring and evaluation strategies and realistic expectations.

Kevin Flanagan is a TechChange alum from Technology for Monitoring and Evaluation course. He is a learning technologist on the Monitoring, Evaluation and Learning team at the National Democratic Institute.

Yuting Liao is senior assistant for data analysis and visualization on the Monitoring, Evaluation and Learning team at the National Democratic Institute.

The National Democratic Institute is a nonprofit, nonpartisan organization working to support and strengthen democratic institutions worldwide through citizen participation, openness and accountability in government.

Featured image: Wayan Vota Flickr

One of the things that sets the TechChange platform apart from other online courses is the network you are immersed in. Today, we are excited to highlight one of our alumna who took the network she built within one of our courses, into the incredible work she’s doing. Devjani joined us in our Technology for Monitoring and Evaluation course a few months ago, and her curiosity for the role of technology in M&E led her to take a deep dive in one of the tools she was introduced to in the course. We got to catch up with her on how the course has influenced her work.

How did you come across our Tech for M&E course?

I was on a year-long sabbatical in London from the National Hydroelectric Power Corporation (NHPC) in India. During my sabbatical, I wanted to learn more about the role of technology in monitoring and evaluation. I was looking for a course that would not only provide me a sound knowledge of the system but would also be cost-effective for me. So, after a few google searches, I came across TechChange’s course on Technology for Monitoring and Evaluation and immediately signed up!

Why were you curious about the role of tech in M&E?

NHPC’s power projects are located in far-flung villages, from Jammu and Kashmir in the North to Arunachal Pradesh and Manipur in the North-East. The project locations are very remote without any infrastructure, roads, or communication, making survey, investigation and project completion very challenging. Due to the remoteness of these projects, we have often noticed that the socio-economic surveys were not being conducted very diligently. We have often found that there are lot of discrepancies and inaccurate data collected on project-affected families during Social Impact Assessment Studies. Manual data collection in these remote villages has been cumbersome, and the staff have to carry GPS, cameras and papers into the field. Sometimes, the affected villages are so far out that it takes more than a day to reach it by foot, and in that case, the data collected in paper surveys are re-entered manually into Excel sheets, leading to a high margin of error.

After the manual collection of data, the monitoring is done through site visits (once or twice a year) and the data collected by external consultants doesn’t always reach the NHPC, making it difficult to have baseline information on the families affected by the project.

I knew there had to be a better way to collect data and do M&E!

How did TechChange provide you with the information you needed to make an impact?

In the TechChange course, I was introduced to so many possibilities of ICT in M&E, but I was hungry for more and wanted to take an even deeper dive. From the various M&E tools I got to know through the TechChange course, I was interested in learning more about a data collection tool, Akvo FLOW. I had attended a guest expert session with Marten Schoonman of Akvo, so I reached out to the course facilitator to help me get in touch with him. Marten put me in touch with the Akvo India group and I was able to attend a five-day training session in India with the Akvo team to learn all about the tool and how well I can use it in my organization.

Picture from the Akvo FLOW training in India

I attended a 5-day training, organised by the India chapter of the Akvo group with 40 other attendees. Everyone came from diverse backgrounds; some were tech savvy and highly educated while others were handling smartphones for the first time. It was a great opportunity for me to really dive into one specific tool that I was curious about.

Tell us more about Akvo FLOW

Akvo FLOW is a data collection platform that is used on inexpensive mobile phones with an Android platform. It has helped me with all of the following:

Getting the GPS coordinates
Obtaining authentic data from inaccessible respondents
Surveying a greater geographical area at lower costs
Ease of obtaining data on the dashboard
Using it in areas where there is no mobile network
Managing a database of respondents who can provide loads of data that can be used for baseline studies and longitudinal impact assessments
Geo-mapping of sampled areas and use of media such as pictures, audio and video,
Creation of identity cards
Data analysis and evaluation

Since NHPC’s projects are located in remote areas all over India, we can use Akvo FLOW to collect data from all projects in a standardised format and have it all in the same platform.

Any advice for someone considering a TechChange course to break into the ICT4D field?

Today, ICT has become an indispensable tool to bridge distances and spread the seeds of development in the remotest corners of this world. For funders and development workers, monitoring in remote areas is a daunting task, but the expansion of ICT has now paved the path towards limitless possibilities, providing easy access to information to make informed decisions. ICT4D is not just about computers, mobile phones and the internet, but it is also about help, support and capacity building of people who are using them and linking them with the right communities.

Here are five reasons I would always recommend TechChange courses:

Extremely helpful and cooperative course coordinators. I was totally new to ICT when I enrolled for this programme, so I was prepared to feel lost. But with the help of facilitators and guest experts, I could get hands-on experience with the Akvo FLOW tool. This has opened a new door of opportunity for me and I am excited to implement what I learned to my work.
Course material is beyond just PowerPoints. It’s very interactive with plenty of networking opportunities, group discussions and presentations, live question and answer sessions, feedback from other participants, video chats, etc. making the whole learning process very engaging and enjoyable. There is plenty of learning opportunities from course participants as well, who are very experienced and coming from different parts of the world with different sets of skills and approaches.
Courses are very well crafted and exhaustive yet comprehensive. Excellent study materials that are up to date.
Connecting with guest experts who are leaders in the ICT4D industry. It’s very difficult to get access to such a range of good study materials and get to hear from the experts themselves.
Courses are easily accessible. All the course material, even live events are recorded and archived for those who could not attend the live sessions. Then, the course materials are available even 4 months after a course ends, which gave me ample time to catch up and get a grasp of the whole syllabus.

What’s next?

It is going to be a daunting task to introduce ICTs in our public sector, but I am going to take up brainstorming sessions with senior officers from various organisations and try to understand how to effectively use these tools in our crucial surveys and monitoring of community development and CSR programmes and also use the same for conducting Social Impact Assessment studies.

“Nothing stops an organization faster than people who believe that the way they worked yesterday is the best way to work tomorrow. To succeed, not only do your people have to change the way they act, they have got to change the way they think about the past.” – Former Chairman of KPMG International, Jon Madonna.

So my journey begins here. I know it’s an uphill task to convince the system to accept this Akvo FLOW tool, which opens a whole new world of data transparency and authenticity, and successfully integrating the tool in our various development programmes.

I would really like to thank the whole TechChange Team for giving me this opportunity to share my views and experience with you all. I am going to come back to them over and over for many more courses that would not only ensure progress in my professional development but also give me inspiration and satisfaction to work successfully in the field of social development.

***
Interested in learning more about data collection, you can still join our Tech for Data Collection and Survey Design course that started on Monday! Want a more immersive experience? Check out our Tech for M&E Diploma program!

About Devjani

Devjani has been working for over 18 years in India with a successful track record in the area of Environment, Social Development, CSR and Sustainability. Her experience extends across large hydro and mining projects within the government & NGO sectors and international funding agencies. She has travelled extensively in India to conduct a range of investigative studies. Devjani is a Registered PRINCE2 Practitioner and has a postgraduate degree in Public Systems Management with specialisation in Environment. She has also done a Post Graduate Certificate course in Environmental Impact & Assessment with specialisation in Strategic Environment Assessment.

Featured image: Isha Parihar from Akvo India trying to calibrate the GPS in the field

We are excited to start our fourth iteration of our most popular online course, Technology for Monitoring and Evaluation! We wanted to ask some of our alumni who have taken the course with us what they got from the course. Here is what they had to say:

Ladislas Hibusu
Consultant at Zhpiego (Zambia)

This is the course that landed me a Monitoring and Evaluation consultancy job with Jhpiego as I approached the interview room with much tech knowledge and courage beyond my previous experiences.

Sahibzada Arshadullah
Senior Manager M&E at Cowater International Inc (Pakistan)

This is a must course for the M&E practitioners, where they can get hand on experience using various latest tools and softwares necessary for data management, real time monitoring, and evaluation. Due to the ever increasing role of information technology in the development sector as well the beginning of the big data era, it has become important for M&E related professionals to exploit the latest technological advancement and equip themselves with the right tools and software to compete in the global market.

Abigail Rumsey
Content Developer (Technical Solutions) at Plantwise Knowledge Bank (UK)

The community created around this course is the most valuable aspect. There are people from all around the world sharing their experiences and knowledge, and learning together.

Niamh Barry
Global Lead on Monitoring and Evaluation at Grameen Foundation (Uganda)

This course was fantastic. The platform of engagement was the best i have experienced, you feel part of a community and it is so engaging (this is coming from someone who has lost interest in a few online courses before!). The facilitators, demos and guest speakers were well chosen. Do this course if you are just starting in Tech and M&E and if you have already started it, it will show you how much more there is to learn and inspire you to try new innovations in your work.

Robert Kolbila
M&E Manager, Mennonite Economic Development Associates (Ghana)

Enrolling in this course has just opened a new career path for me as development practitioner. I have been exposed to modern tools and techniques that is fast changing the face of M&E in development practice globally. I was a Nutrition Coordinator at my organization when I joined the course, and now have transitioned to M&E Manger of a $20 million project. This course has been life changing for me.

Want to be our next success story? Our next Tech for M&E online course begins next week! Save your spot now!

We have equipped around 6000 alumni with similar skills around the world in many of our other courses. To help our community grow even further, we are taking a step beyond a 4-week online course, and offering a brand new diploma program in Tech for M&E. Check it out here!