Method Details


Details for method 'Scale invariant CNN + CRF'

 

Method overview

name Scale invariant CNN + CRF
challenge pixel-level semantic labeling
details We propose an effective technique to address large scale variation in images taken from a moving car by cross-breeding deep learning with stereo reconstruction. Our main contribution is a novel scale selection layer which extracts convolutional features at the scale which matches the corresponding reconstructed depth. The recovered scaleinvariant representation disentangles appearance from scale and frees the pixel-level classifier from the need to learn the laws of the perspective. This results in improved segmentation results due to more effi- cient exploitation of representation capacity and training data. We perform experiments on two challenging stereoscopic datasets (KITTI and Cityscapes) and report competitive class-level IoU performance.
publication Convolutional Scale Invariance for Semantic Segmentation
I. Kreso, D. Causevic, J. Krapac, and S. Segvic
GCPR 2016
https://ivankreso.github.io/papers/kreso16gcpr.pdf
project page / code https://github.com/ivankreso/scale-invariant-cnn
used Cityscapes data fine annotations, stereo
used external data ImageNet
runtime n/a
subsampling no
submission date April, 2016
previous submissions

 

Average results

Metric Value
IoU Classes 66.281
iIoU Classes 44.8593
IoU Categories 85.0125
iIoU Categories 71.1596

 

Class results

Class IoU iIoU
road 96.2716 -
sidewalk 76.792 -
building 88.8319 -
wall 40.0224 -
fence 45.4312 -
pole 50.1187 -
traffic light 63.3179 -
traffic sign 69.6063 -
vegetation 90.6168 -
terrain 67.1449 -
sky 92.197 -
person 77.6231 58.9594
rider 55.8633 40.0069
car 90.0512 84.011
truck 39.2087 19.7231
bus 51.3082 35.7663
train 44.4082 32.971
motorcycle 54.3873 35.9963
bicycle 66.1389 51.4409

 

Category results

Category IoU iIoU
flat 97.1543 -
nature 90.2285 -
object 59.931 -
sky 92.197 -
construction 89.0092 -
human 78.2105 60.5889
vehicle 88.3571 81.7302

 

Links

Download results as .csv file

Benchmark page