Method Details


Details for method 'LDFNet'

 

Method overview

name LDFNet
challenge pixel-level semantic labeling
details We propose a preferred solution, which incorporates Luminance, Depth and color information by a Fusion-based network named LDFNet. It includes a distinctive encoder sub-network to process the depth maps and further employs the luminance images to assist the depth information in a process. LDFNet achieves very competitive results compared to the other state-of-art systems on the challenging Cityscapes dataset, while it maintains an inference speed faster than most of the existing top-performing networks. The experimental results show the effectiveness of the proposed information-fused approach and the potential of LDFNet for road scene understanding tasks.
publication Incorporating Luminance, Depth and Color Information by Fusion-based Networks for Semantic Segmentation
Shang-Wei Hung, Shao-Yuan Lo
https://arxiv.org/abs/1809.09077
project page / code https://github.com/shangweihung/LDFNet
used Cityscapes data fine annotations, stereo
used external data
runtime n/a
subsampling 2
submission date September, 2018
previous submissions

 

Average results

Metric Value
IoU Classes 71.3095
iIoU Classes 46.3312
IoU Categories 88.509
iIoU Categories 74.2323

 

Class results

Class IoU iIoU
road 98.1172 -
sidewalk 83.4747 -
building 91.0841 -
wall 45.9437 -
fence 49.4788 -
pole 62.0208 -
traffic light 67.0745 -
traffic sign 70.665 -
vegetation 92.5054 -
terrain 70.704 -
sky 94.8484 -
person 81.035 61.3789
rider 62.8911 38.4455
car 93.8577 87.6736
truck 52.6447 27.8712
bus 60.9671 39.0677
train 55.0563 31.4029
motorcycle 54.5332 33.0228
bicycle 67.9781 51.7872

 

Category results

Category IoU iIoU
flat 98.4199 -
nature 92.1765 -
object 68.0405 -
sky 94.8484 -
construction 91.683 -
human 81.2993 62.621
vehicle 93.0956 85.8436

 

Links

Download results as .csv file

Benchmark page