Method Details
Details for method 'Scale invariant CNN + CRF'
Method overview
name | Scale invariant CNN + CRF |
challenge | pixel-level semantic labeling |
details | We propose an effective technique to address large scale variation in images taken from a moving car by cross-breeding deep learning with stereo reconstruction. Our main contribution is a novel scale selection layer which extracts convolutional features at the scale which matches the corresponding reconstructed depth. The recovered scaleinvariant representation disentangles appearance from scale and frees the pixel-level classifier from the need to learn the laws of the perspective. This results in improved segmentation results due to more effi- cient exploitation of representation capacity and training data. We perform experiments on two challenging stereoscopic datasets (KITTI and Cityscapes) and report competitive class-level IoU performance. |
publication | Convolutional Scale Invariance for Semantic Segmentation I. Kreso, D. Causevic, J. Krapac, and S. Segvic GCPR 2016 https://ivankreso.github.io/papers/kreso16gcpr.pdf |
project page / code | https://github.com/ivankreso/scale-invariant-cnn |
used Cityscapes data | fine annotations, stereo |
used external data | ImageNet |
runtime | n/a |
subsampling | no |
submission date | April, 2016 |
previous submissions |
Average results
Metric | Value |
---|---|
IoU Classes | 66.281 |
iIoU Classes | 44.8593 |
IoU Categories | 85.0125 |
iIoU Categories | 71.1596 |
Class results
Class | IoU | iIoU |
---|---|---|
road | 96.2716 | - |
sidewalk | 76.792 | - |
building | 88.8319 | - |
wall | 40.0224 | - |
fence | 45.4312 | - |
pole | 50.1187 | - |
traffic light | 63.3179 | - |
traffic sign | 69.6063 | - |
vegetation | 90.6168 | - |
terrain | 67.1449 | - |
sky | 92.197 | - |
person | 77.6231 | 58.9594 |
rider | 55.8633 | 40.0069 |
car | 90.0512 | 84.011 |
truck | 39.2087 | 19.7231 |
bus | 51.3082 | 35.7663 |
train | 44.4082 | 32.971 |
motorcycle | 54.3873 | 35.9963 |
bicycle | 66.1389 | 51.4409 |
Category results
Category | IoU | iIoU |
---|---|---|
flat | 97.1543 | - |
nature | 90.2285 | - |
object | 59.931 | - |
sky | 92.197 | - |
construction | 89.0092 | - |
human | 78.2105 | 60.5889 |
vehicle | 88.3571 | 81.7302 |