Wednesday, 26 February 2020 14:06

Major concerns with Overseer

Written by  Basil Chamberlain, chief executive of the Taranaki Regional Council
Taranaki Regional Council chief executive Basil Chamberlain. Taranaki Regional Council chief executive Basil Chamberlain.

Taranaki Regional Council chief executive, Basil Chamberlain responds to Overseer chief executive, Dr Caroline Read's claim that the council made misleading statements about OverseerFM.

We take issue with the Overseer chief executive Dr Caroline Read, who accuses us of misleading statements (read her piece here). 

More compulsory and widespread use of OverseerFM as a regulatory tool is among sweeping changes to freshwater management proposed by the Government.  We believe New Zealanders must understand clearly the risks involved with this.

It’s difficult to believe Dr Read has fully read and appreciated the council’s position. Because after accusing us of being misleading, she confirms our core criticism: that OverseerFM is a nutrient budgeting model and not a real-time nitrogen loss calculator and is not designed to deliver “an absolute pass/fail against an absolute value”. But that’s exactly what’s happening now in some places, with more widespread misuse proposed.

We agree that when used properly, OverseerFM can give a farmer insight into improving farm practices aimed at reducing losses. But even then, its limitations and uncertainty should be clearly identified and widely understood. This is especially so in Taranaki, with its relatively high rainfalls and rainfall variability.

We are far from alone in our concerns:

The Parliamentary Commissioner for the Environment called for an urgent and fully independent review of OverseerFM before any widespread adoption as a regulatory tool. 

The PCE says:

Measuring the scale and environmental effects of nutrient loss from an individual property, as distinct from those of the wider catchment, is ‘problematic in the extreme’. It cannot be done.

OverseerFM is a model that uses algorithms to simplify and summarise highly complex natural processes and standardise complex local variability. All models operate with a level of uncertainty. The PCE says its uncertainty and level of transparency is not acceptable in a regulatory setting. Those being regulated need to feel confident they’re getting fair treatment.

OverseerFM can’t measure actual nutrient levels or losses, nor what happens to the nutrients after that, nor what happens in the surrounding and receiving environments.

Even for farming systems for which it has been calibrated, Overseer-calculated results for losses of nitrogen can be 25% to 30% inaccurate – but even this does not take into account any errors with measurements or uncertainty from data inputs, providing only part of the picture of quantifying uncertainty. Outside of calibrated areas (including Taranaki), the ‘uncertainty is likely to exceed 50%, but could be much higher still’. 

Dr Julie Everett-Hincks, legal and scientific researcher at the University of Otago, says that ‘Overseer would not likely withstand legal challenge, but more importantly, is it right to burden farmers with regulatory compliance when the tool used cannot reasonably measure nutrient losses? In its current form and governance structure, Overseer is not fit to be a regulatory tool’. 

Professor Troy Baisden, BOPRC chair in Lake and Freshwater Science at the University of Waikato: “When used to enforce regulation, Overseer lacks the openness and transparency needed for scientists to review model results or develop improvements.” 

Former IPCC working group director Martin Manning, Massey University Professor Emeritus of Industrial Mathematics, Graeme Wake, Massey agricultural senior scientist Tony Pleasants, and a retired associate professor of mathematics, John Gamlen:  Spending millions fixing Overseer’s problems will not be enough unless the underlying mathematical model is ditched and replaced by more sophisticated modelling that can reflect interactions between different biological processes. “New Zealand is at serious risk of losing its credibility in agricultural and environmental management with the public and from our international colleagues … the science does not stand up to peer scrutiny.”

TRC has a long-standing policy of supporting the use of OverseerFM as a benchmarking tool for the individual farm, as an assistant in reviewing and informing farm management practices, and as a means of education. 

We’re a successful and experienced water management regulator. When making rules, we seek to ensure they’re soundly based, fit for the purpose of solving real problems, and able to be monitored and enforced. We want to avoid unjust and perverse outcomes – behaving professionally demands nothing less.

So, we share the view of many experts and authorities that OverseerFM is unfit for use as a regulatory tool. 

• Basil Chamberlain is chief executive of the Taranaki Regional Council



More like this

Will review fix Overseer?

Overseer Ltd says it welcomes the recent launch of an independent review of its environmental modelling software and is looking forward to working with the review panel.

Overseer review overdue

Federated Farmers remains sceptical that Overseer can become a valid regulatory tool, despite the announcement last week of a high-powered panel appointed to review the software.


ANZCO makes a $30m profit

Meat company ANZCO Foods recorded its best-ever revenue of $1.7b and a net profit before tax of $30.6m for the year ended 31 December 2019.


M. bovis – we’re making headway

Ministry for Primary Industries chief science adviser, Dr John Roche on the indications New Zealand is winning the fight against Mycoplasma bovis.

Delays ruled out on water reforms

Delaying the introduction of new water reforms was not an option according to the two cabinet Ministers directly involved – Environment Minister David Parker and Agriculture Minister Damien O’Connor.

$700m for freshwater clean up

The Government has announced a $700 million fund to support the primary sector and other groups in meeting new clean water standards.

» The RNG Weather Report

» Latest Print Issues Online

The Hound

Dirty water

The Hound understands that Federated Farmers has been cut out of the information loop, for the past year, on the…

Who’s paying?

Your canine crusader noticed a full-page ad recently run in a farming paper calling on meat companies SFF and Alliance…

» Connect with Rural News

» eNewsletter

Subscribe to our weekly newsletter

Popular Reads

Drop in payout looms

Dairy farmers are being told to brace for a big drop in milk payout next season.