Object labels

Mapillary’s computer vision technology automatically detects objects depicted in images, such as buildings, cars, pedestrians, bicycle racks, and much more. This is based on a method called semantic segmentation—an algorithm is trained to detect and assign a category label to every pixel in the image. Since each image has geocoordinates, it is possible to also visualize those object labels on the map. This will let you get a visual reference to different kinds of objects.

The visualizations at this stage reflect positions of the images where certain objects are visible. This is not the same as map features, which is one step further—triangulating the location of an object that has been detected in several images, so we can determine the location of that object in the real world and place it on the map as a map feature.

You can visualize object labels on the Mapillary web app. (See the article about exploring object labels.)

To retrieve and use automatically extracted object labels, you need a subscription through Mapillary for Organizations. Create a Mapillary account and set up an organization to get started.

Below is the list of the 65 classes of objects that are provided in the data licence.