Method Details
Details for method 'TuSimple_Coarse'
Method overview
| name | TuSimple_Coarse |
| challenge | pixel-level semantic labeling |
| details | Here we show how to improve pixel-wise semantic segmentation by manipulating convolution-related operations that are better for practical use. First, we implement dense upsampling convolution (DUC) to generate pixel-level prediction, which is able to capture and decode more detailed information that is generally missing in bilinear upsampling. Second, we propose a hybrid dilated convolution (HDC) framework in the encoding phase. This framework 1) effectively enlarges the receptive fields of the network to aggregate global information; 2) alleviates what we call the "gridding issue" caused by the standard dilated convolution operation. We evaluate our approaches thoroughly on the Cityscapes dataset, and achieve a new state-of-art result of 80.1% mIOU in the test set. We also are state-of-the-art overall on the KITTI road estimation benchmark and the PASCAL VOC2012 segmentation task. Pretrained models are available at https://goo.gl/DQMeun. |
| publication | Understanding Convolution for Semantic Segmentation Panqu Wang, Pengfei Chen, Ye Yuan, Ding Liu, Zehua Huang, Xiaodi Hou, Garrison Cottrell https://arxiv.org/abs/1702.08502 |
| project page / code | https://github.com/TuSimple/TuSimple-DUC |
| used Cityscapes data | fine annotations, coarse annotations |
| used external data | ImageNet |
| runtime | n/a |
| subsampling | no |
| submission date | February, 2017 |
| previous submissions | 1, 2, 3, 4 |
Average results
| Metric | Value |
|---|---|
| IoU Classes | 80.1316 |
| iIoU Classes | 56.9287 |
| IoU Categories | 90.7234 |
| iIoU Categories | 77.8373 |
Class results
| Class | IoU | iIoU |
|---|---|---|
| road | 98.5498 | - |
| sidewalk | 85.9381 | - |
| building | 93.17 | - |
| wall | 57.7328 | - |
| fence | 61.1498 | - |
| pole | 67.2266 | - |
| traffic light | 73.7003 | - |
| traffic sign | 77.9701 | - |
| vegetation | 93.4245 | - |
| terrain | 72.3348 | - |
| sky | 95.3779 | - |
| person | 85.9083 | 67.6445 |
| rider | 70.5223 | 47.315 |
| car | 95.869 | 89.1883 |
| truck | 76.1068 | 38.2876 |
| bus | 90.6076 | 52.5284 |
| train | 83.7292 | 54.8 |
| motorcycle | 67.4445 | 44.777 |
| bicycle | 75.7378 | 60.8887 |
Category results
| Category | IoU | iIoU |
|---|---|---|
| flat | 98.6616 | - |
| nature | 93.1372 | - |
| object | 73.0897 | - |
| sky | 95.3779 | - |
| construction | 93.4496 | - |
| human | 85.9905 | 68.5614 |
| vehicle | 95.3568 | 87.1131 |
