Allen Institute for AI

Surface Normals

Estimating the normal vectors to all the surfaces in the image. Note that this is highly linked to depth estimation as the normal of a surface is orthogonal to its change in depth.

Try it for yourself
1. Upload an Image (or choose one from the examples)
Examples...
Image:
Click to upload your own image
2. Run a model

Multi Task Refinenet

Real-Time Joint Semantic Segmentation and Depth Estimation Using Asymmetric AnnotationsVladimir NekrasovThanuja DharmasiriAndrew SpekTom DrummondChunhua ShenIan D. ReidICRA2019

This model used an encoder decoder structure, but the output of this is used to predict 3 very related aspects of the scene: segmentation, depth and surface normals. For images which only have annotations for a subset of these, they use an expert model to provide preliminary annotations in order to avoid having a biased gradient.