Using AprilTags for Loop Closure in Dot3D

Using AprilTags for Loop Closure in Dot3D

Overview:
AprilTags for Loop Closure provide a way for Dot3D to identify 3D points in the scene across different points in time.
They do not require any additional measurement or manual input and will never decrease your optimized data quality, so they are very safe to use in a scan (as long as you avoid duplicate tags in the scene!) and are therefore a recommended good practice.

Let's say you start your scan in one part of the scene, then continue to scan many other parts of the scene and then scan back to your starting point. In this case an AprilTag placed at the start/end point will help Dot3D "close the loop" in the scan by establishing identity of the start/end point.

When to use AprilTags for Loop Closure:
The Dot3D loop closure and registration engine is already quite robust even without the help of AprilTags.
There are three situations however in which using AprilTags can make a big difference:

a) When scanning stretches with a lack of geometric structure: Large walls, floors, asphalt, parking lots, anything that's flat and doesn't fit in the camera's field-of-view. In these cases we recommend putting one or more AprilTags on the flat structure in areas that are subject to loop closure (i.e. you start at a flat area, then scan other things then come back to it).

b) When scanning stretches with a lack of visual texture: Any element that is a single color, or a blend of colors changing slowly over the surface, and doesn't fit in the camera's field-of-view. White walls in a room would be a good example here. In these cases we recommend putting several AprilTags in the untextured area to provide the Dot3D algorithms with some added visual texture.

c) When scanning large scenes (entire apartments, residences, parking lots, large outdoor scenery). In those cases it is again recommended to use AprilTags, especially in the loop closure areas.

Basics of AprilTag Targeting for Loop Closure:
  1. Automatically improved accuracy within single scans
    1. Improved frame-to-frame registration via accurate loop closure
  2. Available for download at www.dotproduct3d.com/targets
  3. Can be printed to different sizes, but larger tags will be recognized more readily by the software
  4. Preparation:
    1. Place 1-3 AprilTags at the starting point of your scan
      1. If using more than one tag, place them at least 1.5 meters (5 ft) apart from each other.
      2. Plan to return back to the same area at the end of your scan
    2. Scatter additional AprilTags throughout the scan
      1. Quantity is up to you (typically 5-20 total depending on scene size)
      2. Should be evenly placed throughout scene at varying elevations
      3. Also can be placed in difficult areas (i.e. empty white walls) to assist with tracking
      4. Initial 1-3 are most crucial
AprilTag Targeting for Loop Closure Procedure:
  1. Begin your scan in the area of your first 1-3 tags
  2. Turn the AprilTags highlighted orange while scanning (detected)
    1. If not detected easily, move slowly around the tag while keeping in in the center of view. Moving closer can also help but try to avoid very close distances below 60 cm (2 ft).
    2. Turn all tags orange before moving on
  3. Pan through the scene in standard fashion
    1. Move about the scene in a loop to return back to the start tags
  4. Upon return to the start, turn tags orange again before finishing
AprilTags can also be utilized for scale bar and survey targeting, which do require additional input of known measurements/coordinates to add even higher accuracy/confidence to the data. Please click here for a video tutorial on these more advanced workflows.


    • Related Articles

    • Pros / Cons and scanning Best Practices for Intel RealSense D415 and D435

      The Intel RealSense D455, D415, and D435 (as well as D435i) sensors are a great choice for scanning outdoors and/or in sunlight. However, as with all sensors, they have both advantages and limitations. Following best practices is highly recommended ...
    • Targeting: How to Reference Survey Control Coordinates in Dot3D 5.0 & Up

      1. Obtain a minimum of 3 AprilTag target coordinates (i.e. from survey instrument, measurement, reference model, another point cloud, etc.) 2. Set up a .txt target control file in the following format: AprilTag #, x, y, z AprilTag #, x, y, z AprilTag ...
    • Dot3D Tutorial: Registering Multiple DP Scans with AprilTags in Dot3D Pro

      Please click below for a full video tutorial on this procedure: Dot3D Tutorial: Registering Multiple DP Scans with AprilTags in Dot3D Pro This DotProduct video tutorial walks us through the full procedure to register 2 DP scans to each other using ...
    • Using Survey Control Targets In Dot3D

      (For a video tutorial, click the link here) When creating a scan with Dot3D, you may want to use known Survey Control points, to increase the accuracy of the scan, or to fit it into a coordinate system To begin, when creating your scan, you will want ...
    • Which versions of Dot3D allow for use of AprilTag targets?

      AprilTags can be used for loop closure (automatic single scene accuracy improvement by looping over unique tags multiple times) in any version of Dot3D with scanning capabilities enabled (Dot3D Scan, Dot3D X, and Dot3D Pro). However, to use AprilTags ...