Page 1
MONITORING
AND
EVALUATION
SECTION-III
Page 2
MONITORING
AND
EVALUATION
SECTION-III
INTRODUCTION
Evidence-based policymaking is integral to
the overall governance structure of New
India. To achieve this, it is important to
be able to track performance, determine
outcomes to understand how well a
scheme is performing, help diagnose
reasons for poor performance, and generate
recommendations for course corrections.
This requires not only the collection of
data but also putting in place proper
frameworks with measurable parameters
to strengthen the effective management
of limited public resources and achieve a
deeper and broader impact of schemes.
The Development Monitoring and Evaluation
Office (DMEO), an attached unit of NITI,
is driving accountability in governance
through proper monitoring and evaluation,
along with the other Verticals.
Apart from this, NITI Aayog has also
developed several indices and dashboards
by focusing on effective management and
better outcomes backed by data analysis.
MONITORING AND
EVALUATION
29
Annual Report 2021–22
Page 3
MONITORING
AND
EVALUATION
SECTION-III
INTRODUCTION
Evidence-based policymaking is integral to
the overall governance structure of New
India. To achieve this, it is important to
be able to track performance, determine
outcomes to understand how well a
scheme is performing, help diagnose
reasons for poor performance, and generate
recommendations for course corrections.
This requires not only the collection of
data but also putting in place proper
frameworks with measurable parameters
to strengthen the effective management
of limited public resources and achieve a
deeper and broader impact of schemes.
The Development Monitoring and Evaluation
Office (DMEO), an attached unit of NITI,
is driving accountability in governance
through proper monitoring and evaluation,
along with the other Verticals.
Apart from this, NITI Aayog has also
developed several indices and dashboards
by focusing on effective management and
better outcomes backed by data analysis.
MONITORING AND
EVALUATION
29
Annual Report 2021–22
DEVELOPMENT MONITORING AND EVALUATION OFFICE
DMEO is the apex monitoring and evaluation (M&E) office of the Government of India. Its ambit of
work also includes technical advice to the States, under NITI Aayog’s mandate of cooperative and
competitive federalism.
DMEO’s role is to: (i) monitor the progress and efficacy of strategic and long-term policy and programme
frameworks as well as initiatives to facilitate their improvements, including necessary mid-course
corrections; and (ii) actively monitor and evaluate the implementation of programmes and initiatives to
strengthen the probability of success and scope of delivery.
DMEO’s major projects in 2021–22 included:
1. Output-Outcome Monitoring Framework
2. Data Governance Quality Index
3. Global Indices for Reforms and Growth
4. Infrastructure Sector Review
5. Institutionalizing and Promoting Evaluations
6. Engagement with States (Section IV: Cooperative Federalism)
7. Partnerships with Academic Institutions
8. Capacity-Building
9. Other Activities for Institutional Strengthening
Output-Outcome Monitoring Framework
Since 2018, DMEO has been undertaking a rigorous process to compile the Output-Outcome
Monitoring Framework (OOMF). The framework has nearly 5,000 output and outcome indicators for
around 500 Central Sector (CS) and Centrally Sponsored Schemes (CSSs), which form the primary
mode of Government service delivery to beneficiaries.
The CS and CSSs in the OOMF exercise together cover Rs 12 lakh crore of the total Union Budget of
over Rs 34 lakh crore in 2021–22. By juxtaposing this financial outlay with quantitative measurements
of scheme performance, more judicious use of and greater accountability to public expenditure are
intended.
DMEO has worked closely with 67 Ministries and Departments in setting quantitative targets for
measurable output and outcome indicators, tracked quarterly progress with the help of dashboards,
collected scheme performance data for FY20, FY21 and FY22, and facilitated review meetings.
Outcome-Based Reviews of Schemes
In 2020–21, thirty-eight review meetings with Ministries/Departments were completed. To review the
progress on OOMF for 2021–22, 54 meetings were proposed, of which 43 have been completed (as
of 20 January, 2022).
30
Annual Report 2021–22
MONITORING AND EVALUATION
Page 4
MONITORING
AND
EVALUATION
SECTION-III
INTRODUCTION
Evidence-based policymaking is integral to
the overall governance structure of New
India. To achieve this, it is important to
be able to track performance, determine
outcomes to understand how well a
scheme is performing, help diagnose
reasons for poor performance, and generate
recommendations for course corrections.
This requires not only the collection of
data but also putting in place proper
frameworks with measurable parameters
to strengthen the effective management
of limited public resources and achieve a
deeper and broader impact of schemes.
The Development Monitoring and Evaluation
Office (DMEO), an attached unit of NITI,
is driving accountability in governance
through proper monitoring and evaluation,
along with the other Verticals.
Apart from this, NITI Aayog has also
developed several indices and dashboards
by focusing on effective management and
better outcomes backed by data analysis.
MONITORING AND
EVALUATION
29
Annual Report 2021–22
DEVELOPMENT MONITORING AND EVALUATION OFFICE
DMEO is the apex monitoring and evaluation (M&E) office of the Government of India. Its ambit of
work also includes technical advice to the States, under NITI Aayog’s mandate of cooperative and
competitive federalism.
DMEO’s role is to: (i) monitor the progress and efficacy of strategic and long-term policy and programme
frameworks as well as initiatives to facilitate their improvements, including necessary mid-course
corrections; and (ii) actively monitor and evaluate the implementation of programmes and initiatives to
strengthen the probability of success and scope of delivery.
DMEO’s major projects in 2021–22 included:
1. Output-Outcome Monitoring Framework
2. Data Governance Quality Index
3. Global Indices for Reforms and Growth
4. Infrastructure Sector Review
5. Institutionalizing and Promoting Evaluations
6. Engagement with States (Section IV: Cooperative Federalism)
7. Partnerships with Academic Institutions
8. Capacity-Building
9. Other Activities for Institutional Strengthening
Output-Outcome Monitoring Framework
Since 2018, DMEO has been undertaking a rigorous process to compile the Output-Outcome
Monitoring Framework (OOMF). The framework has nearly 5,000 output and outcome indicators for
around 500 Central Sector (CS) and Centrally Sponsored Schemes (CSSs), which form the primary
mode of Government service delivery to beneficiaries.
The CS and CSSs in the OOMF exercise together cover Rs 12 lakh crore of the total Union Budget of
over Rs 34 lakh crore in 2021–22. By juxtaposing this financial outlay with quantitative measurements
of scheme performance, more judicious use of and greater accountability to public expenditure are
intended.
DMEO has worked closely with 67 Ministries and Departments in setting quantitative targets for
measurable output and outcome indicators, tracked quarterly progress with the help of dashboards,
collected scheme performance data for FY20, FY21 and FY22, and facilitated review meetings.
Outcome-Based Reviews of Schemes
In 2020–21, thirty-eight review meetings with Ministries/Departments were completed. To review the
progress on OOMF for 2021–22, 54 meetings were proposed, of which 43 have been completed (as
of 20 January, 2022).
30
Annual Report 2021–22
MONITORING AND EVALUATION
31%
69%
Central Sector Schemes/Projects
67
~
500
~
5000
Ministries/Departments
Central Sector/Centrally
Sponsored Schemes
Output and Outcome
Indicators Tracked
Centrally Sponsored Schemes
Coverage under OOMF 2021-22
Revised Template for Expenditure Finance Committee (EFC)/Standing
Finance Committee (SFC)
A committee was constituted by the Secretary, Department of Expenditure (DoE), to undertake a
detailed review of various sections of the EFC/SFC template to improve its accuracy and relevance
and enhance the coherence of information.
The committee was chaired by Deputy Director-General, DMEO, and included members from DMEO,
DoE and the Project Appraisal and Management Division of NITI Aayog. Several recommendations
were made by the committee, most notably, the inclusion of the logical framework approach, which
is a globally accepted best practice for outlining elements about a scheme’s design as well as its
monitoring and evaluation. The recommendations of the committee were accepted by Secretary, DoE,
and the revised EFC/SFC template came into effect on 1 September 2021.
Data Governance Quality Index
The Data Governance Quality Index (DGQI) exercise was initiated in May 2020 to assess the data
preparedness of Ministries and Departments using a standardized framework. DGQI 1.0—undertaken
between May 2020 and February 2021—focused on assessing the data systems for nearly 250
CS/CSSs across sixty-five Ministries and Departments. On the basis of this assessment, areas for
improvement were highlighted. Ministries and Departments were advised to prepare an action plan
for attaining the frontier DGQI score, along with establishing a data and strategy unit (DSU) to steer
the formulation and implementation of this plan.
Subsequently, DGQI became a regular exercise for measuring data preparedness levels as well as
identifying and implementing the necessary reform actions to improve performance across Ministries
and Departments by December 2022. The DGQI 2.0 exercise includes most CS/CSSs as well as the
non-schematic interventions of Ministries/Departments.
Through webinars, one-on-one meetings and training of resources, DMEO has provided regular hand-
holding to Ministries and Departments to help them achieve the frontier DGQI scores. A detailed Terms
of Reference (ToR) for setting up the DSU, along with an indicative outline of the Ministry/Department
level action plan, have also been shared.
31
MONITORING AND EVALUATION
Annual Report 2021–22
Page 5
MONITORING
AND
EVALUATION
SECTION-III
INTRODUCTION
Evidence-based policymaking is integral to
the overall governance structure of New
India. To achieve this, it is important to
be able to track performance, determine
outcomes to understand how well a
scheme is performing, help diagnose
reasons for poor performance, and generate
recommendations for course corrections.
This requires not only the collection of
data but also putting in place proper
frameworks with measurable parameters
to strengthen the effective management
of limited public resources and achieve a
deeper and broader impact of schemes.
The Development Monitoring and Evaluation
Office (DMEO), an attached unit of NITI,
is driving accountability in governance
through proper monitoring and evaluation,
along with the other Verticals.
Apart from this, NITI Aayog has also
developed several indices and dashboards
by focusing on effective management and
better outcomes backed by data analysis.
MONITORING AND
EVALUATION
29
Annual Report 2021–22
DEVELOPMENT MONITORING AND EVALUATION OFFICE
DMEO is the apex monitoring and evaluation (M&E) office of the Government of India. Its ambit of
work also includes technical advice to the States, under NITI Aayog’s mandate of cooperative and
competitive federalism.
DMEO’s role is to: (i) monitor the progress and efficacy of strategic and long-term policy and programme
frameworks as well as initiatives to facilitate their improvements, including necessary mid-course
corrections; and (ii) actively monitor and evaluate the implementation of programmes and initiatives to
strengthen the probability of success and scope of delivery.
DMEO’s major projects in 2021–22 included:
1. Output-Outcome Monitoring Framework
2. Data Governance Quality Index
3. Global Indices for Reforms and Growth
4. Infrastructure Sector Review
5. Institutionalizing and Promoting Evaluations
6. Engagement with States (Section IV: Cooperative Federalism)
7. Partnerships with Academic Institutions
8. Capacity-Building
9. Other Activities for Institutional Strengthening
Output-Outcome Monitoring Framework
Since 2018, DMEO has been undertaking a rigorous process to compile the Output-Outcome
Monitoring Framework (OOMF). The framework has nearly 5,000 output and outcome indicators for
around 500 Central Sector (CS) and Centrally Sponsored Schemes (CSSs), which form the primary
mode of Government service delivery to beneficiaries.
The CS and CSSs in the OOMF exercise together cover Rs 12 lakh crore of the total Union Budget of
over Rs 34 lakh crore in 2021–22. By juxtaposing this financial outlay with quantitative measurements
of scheme performance, more judicious use of and greater accountability to public expenditure are
intended.
DMEO has worked closely with 67 Ministries and Departments in setting quantitative targets for
measurable output and outcome indicators, tracked quarterly progress with the help of dashboards,
collected scheme performance data for FY20, FY21 and FY22, and facilitated review meetings.
Outcome-Based Reviews of Schemes
In 2020–21, thirty-eight review meetings with Ministries/Departments were completed. To review the
progress on OOMF for 2021–22, 54 meetings were proposed, of which 43 have been completed (as
of 20 January, 2022).
30
Annual Report 2021–22
MONITORING AND EVALUATION
31%
69%
Central Sector Schemes/Projects
67
~
500
~
5000
Ministries/Departments
Central Sector/Centrally
Sponsored Schemes
Output and Outcome
Indicators Tracked
Centrally Sponsored Schemes
Coverage under OOMF 2021-22
Revised Template for Expenditure Finance Committee (EFC)/Standing
Finance Committee (SFC)
A committee was constituted by the Secretary, Department of Expenditure (DoE), to undertake a
detailed review of various sections of the EFC/SFC template to improve its accuracy and relevance
and enhance the coherence of information.
The committee was chaired by Deputy Director-General, DMEO, and included members from DMEO,
DoE and the Project Appraisal and Management Division of NITI Aayog. Several recommendations
were made by the committee, most notably, the inclusion of the logical framework approach, which
is a globally accepted best practice for outlining elements about a scheme’s design as well as its
monitoring and evaluation. The recommendations of the committee were accepted by Secretary, DoE,
and the revised EFC/SFC template came into effect on 1 September 2021.
Data Governance Quality Index
The Data Governance Quality Index (DGQI) exercise was initiated in May 2020 to assess the data
preparedness of Ministries and Departments using a standardized framework. DGQI 1.0—undertaken
between May 2020 and February 2021—focused on assessing the data systems for nearly 250
CS/CSSs across sixty-five Ministries and Departments. On the basis of this assessment, areas for
improvement were highlighted. Ministries and Departments were advised to prepare an action plan
for attaining the frontier DGQI score, along with establishing a data and strategy unit (DSU) to steer
the formulation and implementation of this plan.
Subsequently, DGQI became a regular exercise for measuring data preparedness levels as well as
identifying and implementing the necessary reform actions to improve performance across Ministries
and Departments by December 2022. The DGQI 2.0 exercise includes most CS/CSSs as well as the
non-schematic interventions of Ministries/Departments.
Through webinars, one-on-one meetings and training of resources, DMEO has provided regular hand-
holding to Ministries and Departments to help them achieve the frontier DGQI scores. A detailed Terms
of Reference (ToR) for setting up the DSU, along with an indicative outline of the Ministry/Department
level action plan, have also been shared.
31
MONITORING AND EVALUATION
Annual Report 2021–22
65 Ministries/Departments
250 CS/CSSs
Self-assessment of data systems
6 themes - Data generation, data
quality, data analysis, data security &
HR capacity, use of technology,
case studies
No integration with PRAYAS
Dashboard
74 Ministries/Departments
650 CS/CSSs + non-schematic
interventions
Self-assessment of DSU and action
plan (data strategy), data systems
and data-driven outcomes
6 new themes added: DSU, action
plan, data management, synergistic
data use, inter-agency collaboration,
prescriptive analytics
DGQI scores integrated with PRAYAS
Dashboard & quarterly reviews
DGQI 1.0
Vertical
scope
expansion
Horizontal
scope
expansion
New
themes
Regular
review
mechanisms
DGQI 2.0
Enhanced scope of DGQI 2.0 exercise compared to DGQI 1.0
Sector Reviews
Since 2017, DMEO under its ‘sector reviews’ initiative has been facilitating regular monitoring and
review of key infrastructure and social sectors. These reviews, held in coordination with the concerned
Ministries/Departments, have played a crucial role in broadening the policy dialogue, developing tailored
policies, facilitating critical reforms, and resolving inter-ministerial issues.
As part of the reviews, key performance metrics have been defined for every sector, and annual
targets agreed upon in consultation with the respective Ministries/Departments. The progress on
these metrics is tracked through a web-based interactive sector review dashboard maintained by
DMEO. In June–July 2021, power and energy, transport and telecom sectors were reviewed by the
Hon’ble Prime Minister. Sector performance notes for 2021–22 have also been prepared and shared
with the PMO, Cabinet Secretariat, Department of Expenditure and Department of Economic Affairs.
Institutionalizing and Promoting Evaluations
Constitution of Development Evaluation Advisory Committee
The Development Evaluation Advisory Committee (DEAC) was reconstituted under the Chairmanship
of Vice Chairman, NITI Aayog, on 30 June 2021. The members of the committee include CEO, NITI
Aayog; Secretaries, Finance, Expenditure, and Rural Development; Director, National Institute of Public
Finance and Policy; DG, DMEO; and two experts.
The DEAC will provide leadership for institutionalizing the evaluation of Government schemes; promoting
the evaluation culture and ecosystem; steering evaluation studies for course corrections and scheme
rationalization; and guiding the creation of capacity in States for evaluation. In a meeting held on
28 July 2021, the DEAC approved a three-year evaluation plan covering all CS schemes between
2021–24 (Table 1), followed by the evaluation of all CSSs between 2024–26.
32
Annual Report 2021–22
MONITORING AND EVALUATION
Read More