Address
Description
Do you want to build a career that is truly worthwhile? The World Bank Group is one of the largest sources of funding and knowledge for developing countries; a unique global partnership of five institutions dedicated to ending extreme poverty and promoting shared prosperity. With 189 member countries and more than 120 offices worldwide, we work with public and private sector partners, investing in groundbreaking projects and using data, research, and technology to develop solutions to the most urgent global challenges. For more information, visit www.worldbank.org.
Background and Context:
The Independent Evaluation Group (IEG)'s mission is to improve World Bank Group (WBG) development results through excellence in evaluation. IEG is responsible for the assessment of the relevance, efficacy, and efficiency of WBG operational policies, programs and activities, and their contribution to development effectiveness. IEG's evaluations aim to enhance accountability and learning to inform the formulation of new (and course corrections of ongoing) core work of the WBG.
IEG is directly responsible for:
Proposing strategic choices about the IEG work program after consultations with external stakeholders, the Boards, and WBG management, ensuring it is relevant and aligned with the Institutions' key strategic priorities, overall resources, and with the main development challenges affecting its member countries.Evaluating whether the WBG Institutions' core work is producing the expected results, including global, regional, and other programs in which the institution(s) is a participant.Incorporating evaluation assessments and findings into recommendations designed to help improve the development effectiveness of the WBG's core work, and their responsiveness to member countries' needs and concerns.Reviewing the Institutions' operational self-evaluations.Reporting regularly to the Boards on actions taken by the institution(s) in response to evaluation findings, and on the measures, being taken to improve the overall operations evaluation system and enhance learning, including dissemination and outreach activities.Identifying, disseminating, and promoting the uptake of evaluation findings and lessons to maximize contributions to the WBG's learning and knowledge framework and reinforce learning and accountability within the WBG in reference to achieving the corporate goals.Contributing to the international evaluation community, including knowledge-sharing with other multilateral and bilateral institutionEncouraging and assisting member countries to build effective monitoring and evaluation partnerships, capacities, and systems.IEG's organizational structure comprises: The Office of the Director General, Evaluation (IEGDG) which includes the Methods Advisory Function (IEGMA); the Human Development and Economic Management Department (IEGHE); the Finance, Private Sector and Sustainable Development Department (IEGSP); and the Knowledge and Communications Department (IEGKC). Through the VP and Director General of Evaluation (DGE), IEG reports directly to the Board of Executive Directors.
Methods Advisory Function
IEG’s objective is to help the WBG meet its goals and enhance its development effectiveness through timely, robust evaluation. In 2016, as part of its organizational renewal, IEG’s Methods Advisory Function (IEGMA) was established to help deepen the quality and credibility of IEG evaluation work. The Methods Advisory Function consists of a small centrally located team of Data Scientists and methodologists managed by the Head of methods.
• Advising IEG staff on the best available evaluation methods to address specific evaluation questions and supporting teams in the implementation of those methods.
• Quality assuring IEG’s evaluation products and advising the IEG’s leadership on the credibility and rigor of evaluation plans and reports.
• Ensuring consistent and efficient use of data in evaluations through support to IEG’s data arrangements, systems, and staffing of analysts.
• Researching, generating, piloting and promoting innovative evaluation methodologies including the application of data science and artificial intelligence in the practice of evaluation.
• Through a learning program, supporting the development of evaluation skills among IEG staff and ensuring that internal and external audiences understand and appreciate the rationale for IEG’s evaluation methodologies and approaches.
• Sharing IEG’s methodological knowledge and know-how with the broader international evaluation community, including but not limited to other members of the Evaluation Cooperation Group
Duties and responsibilities:
Embedded in the IEGMA and under the guidance of the Head of Methods, the successful candidate will:
• Provide advisory support to evaluation teams. The Data Scientist will provide specialized methodological and data support to evaluation teams, including:
o Helping evaluation teams develop their sampling/selection approaches, plan for econometric analysis, develop qualitative data collection and analysis plans (e.g., interview or case-based design), or any other mixed-methods approach
o Advising evaluation teams on their data management, processing and analysis practices
o Coaching evaluation teams on the use of specialized software or tools (e.g, content analysis software, statistical packages)
o Developing Job Aids, Checklists, Guidance, Written examples of applications to further assist evaluation teams in implementing the evaluation design.
• Foster the use of innovative evaluation methods. The Data Scientist will help test and validate the use of innovative methods in the context of IEG evaluations (e.g., application of advanced analytics on administrative, survey or media data, Machine Learning or AI-enabled approaches)
• Contribute to evaluation staff capacity development. The Data Scientist will support the delivery of trainings, clinics, and other learning events aimed at enhancing IEG’s staff evaluation skills. In particular, the Data Scientist will support the design and rollout of the Foundations of Evaluation Design curriculum related to the use of specialized methods and evaluation design principles (e.g., sampling, reproducibility, data processing and analysis, counterfactual and configurational causal approaches, etc.)
• Contribute to the review of evaluation approach papers and reports. The Data Scientist will review specialized methodological appendices and other parts of evaluation reports and approach papers (as needed) as part of IEG’s overall quality assurance process.
• Contribute to the publication of methods papers. The Data Scientist will contribute to writing, curating, reviewing and publishing methods papers that discuss the application of specific (innovative) methods in IEG evaluations.
• Contribute to the data collection and analysis activities of some evaluations. The Data Scientist will also take part in specific thematic, corporate or country program evaluation. As a team member, the Data Scientist will conduct data collection and analysis activities under the guidance of the evaluation Task Team Leader.
Selection Criteria
Outstanding analytical skills. The ability to grasp and unpack complex issues. The ability to translate complex conceptual and methodological challenges into clear and actionable language. Advanced knowledge of quantitative evaluation research methods such as multivariate statistical analysis (e.g. quasi-experimental modelling) and some knowledge of data science applications (e.g. text analytics).Knowledge of qualitative evaluation research methods such as case-based methods (e.g. process tracing).Experience in the use of data science software packages and statistical programming language, such as R, Python, STATA as well as computer-assisted qualitative data analysis software such as NVivo. Excellent writing skills in English.Strong interpersonal and communication skills, including a sense of diplomacy and ability to work with teams in a professional and respectful manner.Understanding of the general literature, current issues, main concepts and terminology in development evaluation and social science research. Understanding of the stages of designing and planning an evaluation.High degree of motivation, initiative, flexibility, reliability and responsiveness to changing demands; capacity to multitask with demonstrated ability of being an independent starter with minimal supervision, and a high capacity to persevere for results.
Educational Requirements and experience:
A master’s degree in the social sciences (e.g., program evaluation, political science, public policy, sociology, economics) and five years of relevant experience. Given the fact that the function involves the provision of specialized methodological and data science support to evaluation teams, a PhD would be preferred for this position with equivalent combination of education and experience. Demonstrated experience of conducting program or policy evaluation or applied social/political science research. Teaching or training experience (at the graduate, post-graduate level or of professionals) is highly desired.Knowledge of WBG interventions, systems and processes is a plus.WBG Core Competencies:
Deliver Results for Clients: Achieves results and identifies mission-driven solutions for the client.
Collaborate Within Teams and Across Boundaries: Initiates collaboration across boundaries and broadly across WBG and brings differing ideas into the forefront.
Collaborates across organizational boundaries, internally and externally with a sense of mutuality and respect.Consistently engages others in open dialogue, brings out any conflicting viewpoints and incorporates viewpoints into solutions, giving credit where credit is due. Leverages expertise of all team members to ensure successful outcomes.Makes choices and sets priorities with a WBG corporate perspective in mind.Create, Apply and Share Knowledge: Creates, applies and shares knowledge from across and outside WBG to strengthen internal and/or external client solutions.
Ensures systematic sharing of good practice and learning from lessons from across WBG, clients, and partners.Is known across WBG in their subject area and is sought out by WBG colleagues to advise, peer review, or contribute to knowledge products of others.Seeks mentoring opportunities with more experienced staff to deepen or strengthen their professional knowledge and mentors junior staff.Builds networks across the WBG and as part of external professional groups/networks.Make Smart Decisions: Recommends and takes decisive action.
Applies critical thinking and seeks inputs and experience from others to recommend a course of action consistent with the WBG’s strategy.Evaluates risk and anticipates the short- and long-term implications of decisions.Commits to a decision and takes action once a decision has been reached.World Bank Group Core Competencies
The World Bank Group offers comprehensive benefits, including a retirement plan; medical, life and disability insurance; and paid leave, including parental leave, as well as reasonable accommodations for individuals with disabilities.
We are proud to be an equal opportunity and inclusive employer with a dedicated and committed workforce, and do not discriminate based on gender, gender identity, religion, race, ethnicity, sexual orientation, or disability.
Learn more about working at the World Bank and IFC, including our values and inspiring stories.
