Method Details
Details for method 'ContextNet'
Method overview
name | ContextNet |
challenge | pixel-level semantic labeling |
details | Modern deep learning architectures produce highly accurate results on many challenging semantic segmentation datasets. State-of-the-art methods are, however, not directly transferable to real-time applications or embedded devices, since naive adaptation of such systems to reduce computational cost (speed, memory and energy) causes a significant drop in accuracy. We propose ContextNet, a new deep neural network architecture which builds on factorized convolution, network compression and pyramid representations to produce competitive semantic segmentation in real-time with low memory requirements. ContextNet combines a deep branch at low resolution that captures global context information efficiently with a shallow branch that focuses on high-resolution segmentation details. We analyze our network in a thorough ablation study and present results on the Cityscapes dataset, achieving 66.1% accuracy at 18.3 frames per second at full (1024x2048) resolution. |
publication | ContextNet: Exploring Context and Detail for Semantic Segmentation in Real-time Rudra PK Poudel, Ujwal Bonde, Stephan Liwicki, Christopher Zach arXiv https://arxiv.org/abs/1805.04554 |
project page / code | |
used Cityscapes data | fine annotations |
used external data | |
runtime | 0.0238 s Nvidia Titan X (Maxwell, 3,072 CUDA cores) |
subsampling | no |
submission date | May, 2018 |
previous submissions |
Average results
Metric | Value |
---|---|
IoU Classes | 66.1354 |
iIoU Classes | 36.8025 |
IoU Categories | 82.7734 |
iIoU Categories | 64.2744 |
Class results
Class | IoU | iIoU |
---|---|---|
road | 97.6061 | - |
sidewalk | 79.2413 | - |
building | 88.7849 | - |
wall | 43.8331 | - |
fence | 42.857 | - |
pole | 37.9459 | - |
traffic light | 52.0247 | - |
traffic sign | 58.8521 | - |
vegetation | 90.0181 | - |
terrain | 66.854 | - |
sky | 91.9594 | - |
person | 72.1678 | 47.1301 |
rider | 53.9426 | 24.6504 |
car | 91.6679 | 82.9059 |
truck | 54.011 | 19.347 |
bus | 66.4552 | 30.5792 |
train | 58.3754 | 28.3276 |
motorcycle | 48.9028 | 21.5497 |
bicycle | 61.0729 | 39.9303 |
Category results
Category | IoU | iIoU |
---|---|---|
flat | 97.8015 | - |
nature | 89.6254 | - |
object | 47.741 | - |
sky | 91.9594 | - |
construction | 88.8979 | - |
human | 72.6078 | 48.0915 |
vehicle | 90.7808 | 80.4574 |