On the data science competition website Kaggle, a number of competitors in the “The Nature Conservancy Fisheries Monitoring” competition overfit their image classifier models to a poorly representative validation data set. This resulted in intermediate competition rankings that were misleading and discouraged other data scientists from competing. Outside of the competition environment it would not have been clear that this error had taken place.

In the “The Nature Conservancy Fisheries Monitoring” competition on the data science competition website Kaggle, a number of competitors overfit their image classifier models to a poorly representative validation data set.

Negligible

Religion

Image classifer models designed by individual competitors on Kaggle.

Individual Kaggle Competitors

Public administration and defence

Perception

supervised learning, machine learning, DNN, VGG, open-source

Feature detection, Image classification, Decision support

Global

Kaggle, The Nature Conservancy

Kaggle Competitors

2016-11-14T08:00:00.000Z

2017-04-12T07:00:00.000Z

Near miss

Accident

No

Images captured on fishing boats