Object detections

Mapillary’s computer vision technology automatically detects objects depicted in images, such as buildings, cars, pedestrians, bicycle racks, and much more. This is based on a method called semantic segmentation—an algorithm is trained to detect and assign a category label to every pixel in the image.

Since each image has geocoordinates, it is possible to also visualize the object detections on the map. This will let you filter for images that contain specific kinds of objects. The map visualizations at this stage reflect positions of the images where certain objects are visible. This is not the same as map features, which is one step further—triangulating the location of an object that has been detected in several images, so we can determine the location of that object in the real world and place it on the map as a map feature.

You can visualize object detections on the Mapillary web app. (See the article about exploring object detections.)

To retrieve and use automatically extracted object detections, you need a subscription through Mapillary for Organizations. Create a Mapillary account and set up an organization to get started.

Below is the list of the 65 classes of objects that are provided in the data license.