What Standardised Testing Doesn’t Tell Us About Learning

Asia-Pacific, Civil Society, Education, Headlines

Opinion

When we say that children aren’t learning, what we mean is that they are not fitting into our assessment of their learning outcomes | Picture courtesy: Nilesh Nimkar

When we say that children aren’t learning, what we mean is that they are not fitting into our assessment of their learning outcomes | Picture courtesy: Nilesh Nimkar

THANE, MAHARASHTRA, India, Jun 6 2019 (IPS) – When we look at learning outcomes for children, we only look at standardised tests, ignoring any indigenous knowledge, language, or problem solving strategies they might have.


The brick kilns of Sonale were bustling with activity—children running around, indigenous technology being used, and lots of mathematics being done. I recently went there after a teacher from the nearby primary school approached our nonprofit, Quest, because the children living there were simply not learning. The concern was, if they didn’t even know their multiplication tables, how would they cope in classes V, VI, and VII?

So I went to see for myself. I asked these children, “To make the mortar for the bricks, how many pits have been dug?

“On one side 11; another side 12”

They also told me they would put three containers of raw material in each pit. So I asked them how many containers they would need in total, and after running off to count them, they came back with the right answers. They could also explain how they arrived at those numbers. What I found was that they were counting in threes. Not the way one recites the tables in the schools, but visualising it in their mind.

Clearly, these children knew how to multiply. That they failed to memorise their tables was beside the point. They had understood the concept and had demonstrated a strong meta-cognitive ability when they explained how they arrived at the answer

Clearly, these children knew how to multiply. That they failed to memorise their tables was beside the point. They had understood the concept and had demonstrated a strong meta-cognitive ability when they explained how they arrived at the answer. In my further conversations, I was amazed to see the kinds of calculations the children at the brick kilns did. For instance, 13 multiplied by 11 was done mentally because they were able to understand it within their own context (that of the brick kiln).

Standardised testing disadvantages marginalised children

This example illustrates one of the biggest challenges of our schools today—standardised assessment—which further disadvantages marginalised children. These children have a different type of cultural capital that schools and tests hardly recognise.

Western research in the field of math pedagogy points to the importance of children’s indigenous knowledge and strategies in solving problems and considers them to be the starting point for sound understanding of elementary mathematics. But what are those indigenous strategies in the Indian context? We still don’t know much about them. And our lack of knowledge results in us asking these children to run an unfair race.

Today, when we say that children from marginalised communities aren’t learning, what we mean is that they are not fitting into our assessment of their learning outcomes. By completely ignoring their indigenous knowledge, language, and problem-solving strategies, we have so far continued to focus on what they don’t know, and never paid attention to what they do know.

The process tells us more than just the outcomes

I do not deny the necessity of having some common indicators to understand the status of education in a given cluster, block, district, or state. But setting and chasing these indicators mindlessly could be dangerous.

Take for example, an encounter I had at an SSC exam centre in a rural school a few years ago. While I was visiting, I saw that the teachers were openly giving students answers to questions while they wrote their exams. When I asked why this was happening, a teacher said to me, “These children are weak from the beginning. It is almost impossible that they pass the exam on their own. If they fail, it will affect the result of our school and this would create a lot of trouble for us.”

This encounter is a classic example of what will happen if we neglect the process of learning and just focus on the numerical indicators of success. Our belief tends to be that if we can control learning outcomes, the quality of education will improve. But children can rote learn, or use unfair ways to pass their exams—we have no system that can check it at scale. What’s more, we are forgetting to track whether or not these children truly understand what they’ve been taught.

Ever since the ASER and other such reports have been published, we’ve been talking about how poor the learning outcomes are. But what have we really done to change things? We have been experimenting with examinations more than the actual process of learning, finding newer and newer ways to test the learning outcomes. But, if a pipe is choked, no matter what bowl you put under the opening, no water will drip into it. Similarly, no matter what exams, standard tests, and evaluation tool we use, only a little will change if we fail to address the core issues related to the process of learning.

When we say that children aren’t learning, what we mean is that they are not fitting into our assessment of their learning outcomes | Picture courtesy: Nilesh Nimkar

“What I found was that they were counting in threes. Not the way one recites the tables in the schools, but visualising it in their mind” | Picture courtesy: Nilesh Nimkar

What needs to be done

1. Strengthen the process, invest in teachers

One of the positive outcomes of the Right to Education (RTE) Act is that it improved enrolment rates. But we know that it’s not enough to get children into schools. We need to alter our schools to meet children’s needs. If we want to set the process of education right, we have to strengthen its most impacting factor, the teacher.

Teacher education and ongoing teacher professional development are areas where we haven’t paid much attention. Instead of offering our teachers quick fixes to the challenges they face, we need to begin working with, and for our teachers.

One example of how to do this could be through a technology based distant mentoring system for teachers working across geographies. Quest, the nonprofit I run, has a system like this on a much smaller scale—here, teachers send audio recordings of their classroom activity to mentors (experienced teachers, teacher-educators, or researchers in the field of pedagogy), who then provide them with ongoing feedback to help them fine-tune their skills. This type of support system needs to be created on a larger scale.

2. Change the way we test

We need to alter the tools and parameters we use to assess success. We had a chance to do this when the idea of continuous comprehensive evaluations was introduced. However, the teachers and education community at large could not free themselves from the idea of examinations, and we lost a golden opportunity to bring our focus on to the process.

In a country as diverse as India, the assessment framework could be common for all. But the actual tests should be local and culturally appropriate. For example, I have seen assessment tests that show a picture of a well-maintained French garden or a city park, expecting a rural child to talk about it. In this situation it is obvious that the child will show poor oral expression.

Or yet another example is that of asking children to write words only from the ‘standard’ language—when in reality, Marathi spoken in different parts of Maharashtra is not the same. But normally the assessments are not sensitive to this regional variation, which means that children with a home language that is different than the standard variant of Marathi will always perform poorly.

The question we must ask ourselves is, do we want to make the education system more inclusive, or do we want to use it as a sieve to weed out the ‘weaker’ children? We need to design an overarching framework and build a bank of regionally, culturally appropriate testing items. Unless we do this our focus will always remain on what children don’t know.

Nilesh Nimkar has over 20 years’ experience in the field of early childhood education, elementary education, teacher education and curriculum development. He has initiated several innovative programs for teachers and children, specially in the rural and tribal areas. He has received the Maharashtra Foundation Award for ‘Outstanding social work in the field of education’.

This story was originally published by India Development Review (IDR)

 

Rural Education: Moving Past “Poor Solutions for Poor People”

Asia-Pacific, Civil Society, Development & Aid, Education, Headlines, Poverty & SDGs, Regional Categories, TerraViva United Nations

Education

People often believe that the problems in the education space have more to do with curricula or pedagogy, or with the capacity of teachers. We disagree. The main issue is that today, communities are missing from the school ecosystem.

Photo Courtesy: Sachin Sachdeva

NEW DELHI, May 6 2019 (IPS) – Communities are treated as passive recipients, giving them no say in the functioning of their schools. Here’s why this needs to change.


During our work with people living around the Ranthambhor National Park on issues of conservation, livelihoods, and eco-development, a constant question we were asked was how long we thought we could continue helping them. And then, an accompanying question — would their children never be in a position to help themselves? To advocate for and implement the change they wanted to see?

People had been led to believe that sending children to school was a precondition for a better future. Despite this, what they kept seeing was that the education system accessible to them was not equipping their children with the skills and abilities that they required to negotiate better futures for themselves.

Poor solutions for poor people

Working in Sawai Madhopur made us painfully aware of the community’s past experiences with education. Over time they had experienced the Shiksha Karmi Programme (which trained daughters-in-law to run schools), and the Rajiv Gandhi Pathshalas (which trained a young person who had passed Class 10, to run schools), not counting their countless experiences with government schools in the larger villages, most of which were sub-optimal.

When we look at the pitfalls of the government schooling system — be it teacher absenteeism, quality of textbooks, a lack of adequate infrastructure, constrained budgets and human resources — and the plans or schemes that have been created to address them, we realise that most of them could be categorised as ‘poor solutions for poor people’.

People often believe that the problems in the education space have more to do with curricula or pedagogy, or with the capacity of teachers. We disagree. The main issue is that today, communities are missing from the school ecosystem.

The current school system has made communities passive recipients of whatever the government tosses at them, giving them no say in the functioning of the school. It does not work with the community to help them actively engage with the process.

People don’t understand the gap between their aspirations and reality

The idea that any kind of education should lead to a job (preferably a government one) is prevalent amongst the communities we work with. However, what is less clear is how exactly that will happen, and what the probability is of it happening at all.

People had begun to realise that their education system was leaving children under prepared – they may have completed class 10 or 12, but their capacities and skill sets were far lower than they should have been – making it impossible for them to find the job they dreamed of, or continue on an educational path that would get them there.

What’s worse, by dedicating most of their time and resources to school, these children were sometimes unable to take up their traditional occupations – be it in agriculture or livestock rearing – making them incapable of earning a substantial income.

In such a situation, with huge gaps between their reality and aspirations, young people often found themselves helpless. There was scarcely anyone in the village who could have told them what needed to be done to become a doctor, engineer, bureaucrat, lawyer, entrepreneur – or what it entailed.

Despite this, children would go through their schools and come to urban centres looking for opportunities – be it that elusive government job or being a professional. It was only upon reaching the cities that they would realise how under-prepared they were, and as a result end up taking whatever work they could get–as waiters, drivers, cleaners, helpers, construction workers and similar positions in the informal sector.

It is no surprise then, that when it came to education, people in the community were losing faith in government schools.

Communities are the main stakeholder in their education

People often believe that the problems in the education space have more to do with curricula or pedagogy, or with the capacity of teachers. We disagree. The main issue is that today, communities are missing from the school ecosystem.

The community is the biggest stakeholder in the education space, and they need to be treated as such. People need to have a real idea of what they can expect from the system, and they need the system to be accountable to them. This has never happened.

So while there is plenty of work being done to train teachers, help principals, build the skills of School Management Committees (SMCs), design curriculum and change pedagogy, there is not enough being done with parents and community members. Even though parents make up the bulk of the SMC, they tend to be involved only in issues related to infrastructure or for instance, looking at teacher attendance or organising events – essentially any activity that is easy to monitor and does not demand engagement in processes.

It is time that we understood that education is about creating the right ecosystem for learning to happen, and that a village and its community are part of that process. When families have a better understanding of learning processes, they will also ensure that the home environment provides the right encouragement. When community members are able to offer their knowledge—as farmers, mechanics or officers in government—to students, they are teaching children about different possibilities in their future. It is only through involvement of the community that people will learn to ask the right questions, to seek accountability from the system. SMCs, being a subset of the community, offer a channel to do this. And if the community is aware, the SMCs will also function well.

For change to occur, communities must be more aware, and in charge of their education.

People often believe that the problems in the education space have more to do with curricula or pedagogy, or with the capacity of teachers. We disagree. The main issue is that today, communities are missing from the school ecosystem.

Photo Courtesy: Sachin Sachdeva

Working with communities to improve the education system

Having said that, we have to keep in mind that today, most communities, having been passive recipients of education thus far, are unprepared to challenge the system. It is therefore essential that we work to change this.

Based on our work at Gramin Shiksha Kendra (GSK) – an organisation which works with communities to enhance the quality of education in government schools – over the last 14 years, here are some suggestions on how this can be done:

1. Give them positions of seniority/power

Include members of the local community in your organisation board and involve them in the decision making. For example, at GSK we have people from the community on our board – some of them are parents who missed the opportunities of a quality education for their children, and two of them have never been to school but bring in their insights, wisdom and understanding of the local context.

These community members have guided and helped the organisation evolve its strategies, brought concerns and aspirations of the people to the board, and cautioned us against taking decisions that might not have the right impact.

2. Change your metrics of success

For example, we have kept the strength and management capacities of the school management committees as our apex indicator of success/failure, rather than only focussing on learning outcomes. We believe that when the schools and government-appointed school teachers become accountable to the SMC, and the SMC is in a position to guide and manage, the initiative will have succeeded.

3. Involve them in the work being done

Members from the community are invited to teach in the schools as guest teachers. Their experiences add to the curriculum of the school and are adapted for the schools. To be a teacher is still a valued profession, which gives parents a sense of importance and respect in the area.

Additionally, in an attempt to create a community-led ecosystem for education, we have an annual education festival called Kilol in our villages. The village community takes responsibility to organise Kilol’s and GSK shares, through exhibits and processes, our ways of teaching science, language, math, as well as the importance of components like pottery, sport and carpentry. The festival gives everyone in the community an opportunity to celebrate learning and understand what happens in school.

4. Give the initiative that is for them, to them

Our latest attempt is in handing over one of the schools that GSK set up back to the community to manage. That is when the school will become truly community-owned and community-managed.

We made this possible by, over the last 14 years, giving different members from the community a chance to be a part of the SMC. This has resulted in over 35 members in the community who have at one point or another been members of the SMC.

Because of their experience, the SMCs will soon be able to take over the management of the school and run it. GSK plans to facilitate this process and will help the SMC and the community evolve a future course of action – whether that leads to a science education initiative in the area, a comprehensive school, or an outreach programme.

This is important, as it defines our education initiative in the area. We don’t intend running the schools for ever, we want the community to take over. This will be our biggest success and we will continue providing them the technical support – or any other support that they may require. Most importantly, by giving the school back to the community, we are giving power back to the people – which is where it should be.

Sachin Sachdeva is a Co-Founder of Gramin Shiksha Kendra, www.graminshiksha.org.in , an organisation which works with communities to enhance the quality of education in government schools. Sachin has worked with development initiatives over the past 25 years and has been working with communities to help them look at their futures from a position of strength. GSK works with over 70 schools around the Ranthambhor National Park and along with the community runs three schools, one of which has been set up in a rehabilitated village. He is currently Director of the Paul Hamlyn Foundation’s India programme.

This story was originally published by India Development Review (IDR)

 

Global Governance and Information

Civil Society, Civilisations Find Alliances, Climate Change, Development & Aid, Education, Environment, Featured, Global, Global Governance, Headlines, Human Rights, Natural Resources, Peace, Poverty & SDGs, TerraViva United Nations

Opinion

Ambassador Walther Lichem* of Austria is President Inter Press Service (IPS).

VIENNA, Apr 16 2019 (IPS) – The past seventy years since the end of the second world war have been marked by profound changes in our international system. Relations between states have become more horizontally structured interactions with a rising significance of the common good articulated and pursued by newly-created international programmes and organisations.


Ambassador Walther Lichem

The international agenda increasingly consists of items addressing internationally and globally-shared challenges of dependencies and interdependencies.

The traditional security and peace focus has been broadened into areas of concern which require contributions and activities not only by states but by international organisations and programmes who jointly with non-state actors such as academic institutions and associations, civil society organisations, the private sector including those who joined the Global Compact, have contributed to a new pattern of leadership in the processes of defining our global goals and in the implementation of the related programmes of action.

Another characterizing element in our Global Agenda related-approach is the inter-sectoral interdependence reflected in the international community’s agenda marked by “AND” – “climate change and international security”, “human rights and societal cohesion” etc.

These agenda—and interrelated-ness—require, however, also institutional integration cutting across the institutional development marked by sectoral segregation. There is a rising need for each agenda sector to be fully up-to-date regarding the entire pattern of global challenges and the related plans of action, using this level of information for the development of institutional integration.

There is also a rising need for information flows between governmental/ intergovernmental and non-governmental organizations (NGOs).

The new global agenda benefits from the work and conclusions of academic institutions and programmes, a relationship which regrettably has not yet been fully recognized by the international system.

Many of our important global agenda items based their policy approach on research and academic discourse – e.g. the issue of environmental protection, the concept of sustainability, the process of climate change, the societal development needs and human rights etc.

Another dimension of the pluralisation of global governance affectedness and responsibility is the role of each and every citizen on the globe to know and understand these challenges and assume a rising responsibility in addressing them.

Certain agenda areas, such as environmental protection, the sustainable development and use of our natural resource systems, human rights and human security have given the citizen an almost central role in the achievement of the declared objectives.

Today, every citizen can contribute to the recognition of the dignity of the other and the related human rights. The impact of citizen-focused human rights programmes is visible in human rights cities in all regions of the world. The citizen creating conditions of societal cohesion also essentially contributes to peace and security.

Private sector decisions can make important contributions to both the natural resources related and societal cohesion-related challenges. Academic institutions must adjust their programmes of research and of university education to the global agenda-related challenges.

The cultural sector provides important inputs into the development of values and related behavioural patterns related to the challenges of pluri-identity societies and the integration of otherness.

All these new patterns of responsibility and contributions to achievements for our Global Agenda, however, do require qualified information. It must be recognized that complex academic or policy-process related studies and reports are not accessible to the general citizenship including those in positions of responsibility at local and national levels.

Even governmental institutions and the international diplomatic community cannot internalize all the documents which are to serve as a basis for multilateral negotiations.

The development of this new participatory system of global governance with intergovernmental institutions and processes, national governments and local authorities has led to the recognition of an urgent need for qualified patterns of information which translate challenges, achievements and failures to the political responsibilities at local, national and also international levels, to governmental, inter-governmental and non-governmental institutions who have increasingly shaped our Global Agenda and articulated the rising need for societal understanding and information.

Media are the classical providers of such information combining data with assessments and the vision of our common future. Yet, as analysis of the current situation underlines, there is an urgent need to strengthen qualified information systems which would provide not only governmental, intergovernmental and non-governmental institutions and the citizens but also the media with pertinent and needed information.

There is no way into a future of shared global responsibility without a qualified and also ethically committed system of information related to our processes of global change.

There is a need to recognize that such highly pertinent information related to our common future requires recognition and support from the global society as a contribution to our shared global public space.

This implies that support is to be provided from governmental, intergovernmental and non-governmental institutions. A respective policy discourse with participation from these institutions is to be envisaged in order to prevent the decay or elimination of qualified programmes like Inter Press Service.

*Walther Lichem, retired Austrian Ambassador with studies in law and oriental archaeology (Univ. of Graz, Austria) and political science (Univ. of North Carolina, Chapel Hill; Institute for Advanced Studies, Vienna) started his professional career in 1966 at the United Nations Secretariat in New York in the field of international water resources with development cooperation missions to Ethiopia (1971), Argentina (1971-74) and to the Senegal River Development Organisation (1980). He was also Rapporteur on international river basins at the International Conference on Water Law (Caracas, 1976) and at the IVth World Water Conference (Buenos Aires, 1982).
Ambassador Lichem undertook major assignments in the UN system at the Human Rights Summit in Vienna in 1992 and as Ambassador to Chile and to Canada, as a member of the UN Committee on the Peaceful Uses of Outer Space and as an adviser to the 16 countries sharing the Guinea Current in West and Central Africa on the creation of a regional organisation.