Method Details


Details for method 'ContextNet'

 

Method overview

name ContextNet
challenge pixel-level semantic labeling
details Modern deep learning architectures produce highly accurate results on many challenging semantic segmentation datasets. State-of-the-art methods are, however, not directly transferable to real-time applications or embedded devices, since naive adaptation of such systems to reduce computational cost (speed, memory and energy) causes a significant drop in accuracy. We propose ContextNet, a new deep neural network architecture which builds on factorized convolution, network compression and pyramid representations to produce competitive semantic segmentation in real-time with low memory requirements. ContextNet combines a deep branch at low resolution that captures global context information efficiently with a shallow branch that focuses on high-resolution segmentation details. We analyze our network in a thorough ablation study and present results on the Cityscapes dataset, achieving 66.1% accuracy at 18.3 frames per second at full (1024x2048) resolution.
publication ContextNet: Exploring Context and Detail for Semantic Segmentation in Real-time
Rudra PK Poudel, Ujwal Bonde, Stephan Liwicki, Christopher Zach
arXiv
https://arxiv.org/abs/1805.04554
project page / code
used Cityscapes data fine annotations
used external data
runtime 0.0238 s
Nvidia Titan X (Maxwell, 3,072 CUDA cores)
subsampling no
submission date May, 2018
previous submissions

 

Average results

Metric Value
IoU Classes 66.1354
iIoU Classes 36.8025
IoU Categories 82.7734
iIoU Categories 64.2744

 

Class results

Class IoU iIoU
road 97.6061 -
sidewalk 79.2413 -
building 88.7849 -
wall 43.8331 -
fence 42.857 -
pole 37.9459 -
traffic light 52.0247 -
traffic sign 58.8521 -
vegetation 90.0181 -
terrain 66.854 -
sky 91.9594 -
person 72.1678 47.1301
rider 53.9426 24.6504
car 91.6679 82.9059
truck 54.011 19.347
bus 66.4552 30.5792
train 58.3754 28.3276
motorcycle 48.9028 21.5497
bicycle 61.0729 39.9303

 

Category results

Category IoU iIoU
flat 97.8015 -
nature 89.6254 -
object 47.741 -
sky 91.9594 -
construction 88.8979 -
human 72.6078 48.0915
vehicle 90.7808 80.4574

 

Links

Download results as .csv file

Benchmark page