Method Details
Details for method 'TuSimple_Coarse'
Method overview
name | TuSimple_Coarse |
challenge | pixel-level semantic labeling |
details | Here we show how to improve pixel-wise semantic segmentation by manipulating convolution-related operations that are better for practical use. First, we implement dense upsampling convolution (DUC) to generate pixel-level prediction, which is able to capture and decode more detailed information that is generally missing in bilinear upsampling. Second, we propose a hybrid dilated convolution (HDC) framework in the encoding phase. This framework 1) effectively enlarges the receptive fields of the network to aggregate global information; 2) alleviates what we call the "gridding issue" caused by the standard dilated convolution operation. We evaluate our approaches thoroughly on the Cityscapes dataset, and achieve a new state-of-art result of 80.1% mIOU in the test set. We also are state-of-the-art overall on the KITTI road estimation benchmark and the PASCAL VOC2012 segmentation task. Pretrained models are available at https://goo.gl/DQMeun. |
publication | Understanding Convolution for Semantic Segmentation Panqu Wang, Pengfei Chen, Ye Yuan, Ding Liu, Zehua Huang, Xiaodi Hou, Garrison Cottrell https://arxiv.org/abs/1702.08502 |
project page / code | https://github.com/TuSimple/TuSimple-DUC |
used Cityscapes data | fine annotations, coarse annotations |
used external data | ImageNet |
runtime | n/a |
subsampling | no |
submission date | February, 2017 |
previous submissions | 1, 2, 3, 4 |
Average results
Metric | Value |
---|---|
IoU Classes | 80.1316 |
iIoU Classes | 56.9287 |
IoU Categories | 90.7234 |
iIoU Categories | 77.8373 |
Class results
Class | IoU | iIoU |
---|---|---|
road | 98.5498 | - |
sidewalk | 85.9381 | - |
building | 93.17 | - |
wall | 57.7328 | - |
fence | 61.1498 | - |
pole | 67.2266 | - |
traffic light | 73.7003 | - |
traffic sign | 77.9701 | - |
vegetation | 93.4245 | - |
terrain | 72.3348 | - |
sky | 95.3779 | - |
person | 85.9083 | 67.6445 |
rider | 70.5223 | 47.315 |
car | 95.869 | 89.1883 |
truck | 76.1068 | 38.2876 |
bus | 90.6076 | 52.5284 |
train | 83.7292 | 54.8 |
motorcycle | 67.4445 | 44.777 |
bicycle | 75.7378 | 60.8887 |
Category results
Category | IoU | iIoU |
---|---|---|
flat | 98.6616 | - |
nature | 93.1372 | - |
object | 73.0897 | - |
sky | 95.3779 | - |
construction | 93.4496 | - |
human | 85.9905 | 68.5614 |
vehicle | 95.3568 | 87.1131 |