It is a Quality Measure used in Image Segmentation.

Visually, it can be represented as follows.

center

Using the Pixels that fall in the intersection between FP, TP and FN pixel classifications, an accurate Image Segmentation can be obtained.

Mathematically

  • Intersection over union ():

Here the Binary classification is directly used for calculation of IoU. Hence it is biased towards classifications of with large and counts.

  • Instance-level intersection over union ():
Here the $\text{TP}$ and $\text{FN}$ are weighted by the ratio of the average class instance size by the current ground truth size instance.