PERFORMANCE CHARACTERIZATION OF COOPERATIVE LOCALIZATION AND SLAM

UMN Researchers: Anastasios Mourikis , Prof. Stergios Roumeliotis

Motivation:

 

The goal of this project is to provide theoretical tools for characterizing the accuracy of robot localization. In particular, our work focuses on three classes of localization problems:

 

1. Cooperative Localization (CL)

2. Simultaneous Localization and Mapping (SLAM)

3. Cooperative SLAM (C-SLAM)

Mobile robot teams have attracted the interest of the robotics community, because of the increased efficiency and reliability resulting when multiple robots cooperate for performing a task. In particular, localization (CL, SLAM, and C-SLAM) has been the most active research area of mobile robotics for the past two decades. This is due to the fact that it permits accurate pose estimation in unknown environments necessary for autonomy.

 

However, most of the research work on CL, SLAM, and C-SLAM has focused on implementation techniques and on addressing the problem of computational complexity. The issue of analytical evaluation of performance has been largely ignored in the literature, with only few exceptions of limited scope. As a result, questions such as "How much more accurate will the position estimates become if the odometry noise variance is reduced by 50%?", or "Will a particular set of sensors allow a robot to achieve localization errors smaller than 1m after 1h of operation?" can only be answered after extensive simulations and/or time-consuming experimentation. Clearly, this is a significant obstacle for efficient robot design. Our work aims at providing analytical means for answering such questions.

Contribution:

The primary contribution of this work is the derivation of theoretical tools for evaluating the performance, in terms of positioning accuracy, of CL, SLAM, and C-SLAM. In particular, we present analytical expressions that determine the guaranteed accuracy of localization, as a function of the following system-design parameters:

  • the accuracy of the robots' sensors

  • the number of robots and features

  • the structure of Relative Position Measurement Graph (RPMG) that describes the measurement topology between the robots and/or landmarks

  • the statistical properties of the robots' trajectories

  • the spatial distribution of features, in SLAM and C-SLAM

These expressions predict the localization accuracy a given robot design and facilitate the process of selecting the appropriate sensors for meeting the accuracy requirements of a given task. Moreover, the availability of analytical results enable one to study the properties of positioning errors during CL, SLAM, and C-SLAM and develop an intuitive understanding of the interaction between the system parameters. This knowledge will lead to design rules, which will reduce the time and effort required for new robot designs. Prior to this work, experimentation and numerical simulations were the only tools available for studying the trade-offs between selections of such parameters. These time-consuming methods become necessary only after a design has been finalized merely for validation purposes.

 

Approach:

Our specific goal is to study the properties of the state covariance matrix during pose estimation, since this matrix is a concrete measure of the uncertainty. The main challenge with this problem is that the models describing both the motion and the measurements of robots moving in 2D and 3D are generally nonlinear. As a result, the Extended Kalman Filter (EKF), rather than the linear Kalman filter, is applied for state estimation, and the Riccati recursion, which describes the time evolution of the covariance, is time-varying. For this Riccati no closed-form solution exists in the general case.

Therefore, in order to analytically study the properties of CL for robots moving in 2D, we resort to the derivation of upper bounds for the covariance of the position estimates. In particular, in our work we derive upper bounds on

  • the worst-case uncertainty of the position estimates, and

  • the expected uncertainty of the position estimates

In the latter case, prior information about the statistical properties of the robot's trajectories (and of the features' distribution, in the case of SLAM), is utilized.

In order to compute the upper bounds on the worst-case uncertainty, our approach is based on deriving a "bounding" LTI system, whose covariance at every time step is provably an upper bound of the covariance in the original, nonlinear system. This is achieved by determining upper bounds on the system noise covariance matrix and the relative position measurement covariance matrix.  By obtaining the steady-state solution of the Riccati corresponding to this LTI system, we are able to predict the guaranteed asymptotic accuracy of localization.

A similar approach, based on defining a different "bounding" LTI system, whose covariance is provably an upper bound to the expected uncertainty of the original nonlinear system, is followed for characterizing the expected performance of the system.

Results:

We have carried out extensive simulation tests and real-world experiments to validate the theoretical analysis, and to demonstrate its usefulness in predicting the performance of localization systems. In what follows, some representative results are described:

 

A. Cooperative Localization

 

We here present simulation results showing the effects of RPMG reconfigurations. The behavior of the covariance that is observed in the plots is predicted by, and corroborates, the theoretical analysis. The following figure shows the four different RPMG topologies that are used for this simulation test:

Figure 1

 

For this simulation, a homogeneous robot team comprising 9 robots is considered. The time evolution of the covariance is shown in Fig. 2:

Figure 2

 

In this plot, the covariance along the x axis for all robots is plotted. During the first 200sec of their mission, the robots localize independently (Dead Reckoning, DR). At t = 200sec, the robots start recording relative position measurements, which are described by a complete RPMG topology (cf. Fig. 1-I). The sharp improvement in localization accuracy, as well as the decrease in the rate of covariance increase, becomes evident. At t = 400sec, the RPMG topology changes to a sparser, ring graph (cf. Fig. 1-II). Clearly, after an initial transient response, the rate at which the covariance increases with the new RPMG topology remains unchanged, and a small constant penalty in performance is incurred. This result, which has very important practical implications, is predicted by our theoretical analysis.

 

At t = 600sec, a simulated communication failure occurs, and only two of the robots are able to record and communicate relative position measurements (cf. Fig. 1-III). Careful examination of the plot reveals that the rate of uncertainty increase for these two robots is precisely half that of the rest of the robots, which localize independently. This result verifies an important prediction of our analysis, which stipulates that the rate of uncertainty increase, for homogeneous robot teams, is inversely proportional to the number of robots.

 

At t = 800sec, the initial complete graph topology is restored (cf. Fig. 1-I). We observe that, as expected by the theoretical analysis, the covariance for all robots is identical to the one that would arise if no RPMG reconfigurations had occurred. Finally, at t = 1000sec, the RPMG assumes a random (i.e., non-canonical) topology (cf. Fig. 1-IV). Clearly, for this topology the asymptotic rate of uncertainty increase for all robots is identical, even though the constant term of the covariance varies among robots. 

 

B. Cooperative Simultaneous Localization and Mapping

 

We here present simulation results that demonstrate the application of the derived upper bound, and show the effects of RPMG reconfigurations in C-SLAM. The RPMG used in this simulation is shown in Fig. 3:

Figure 3

 

In particular, a team comprised of 4 robots, performing C-SLAM with 3 features, is considered.  For the first 1000sec, the RPMG has the structure shown in Fig. 3, while for the remaining 1000sec, the RPMG is a denser one, where each robot records measurements to all other robots and landmarks. The time evolution of the covariance of the position estimates for this case is shown in Fig. 4, along with the theoretically computed bounds:

Figure 4

 

From this plot we observe that the covariance of the landmarks' position estimates does not change after the RPMG changes. This is an important result, which is predicted by the closed-form expressions for the covariance. On the other hand, the robots' position estimates become more accurate, as a result of the increased positioning information that is available to each robot, in the new dense RPMG. Note also that, since in the new RPMG all robots perform the same number of measurements, the covariance bound is identical for all of them, in contrast to the situation occurring with the initial RPMG topology.

 

 

C. Simultaneous Localization and Mapping

 

For the case of SLAM, we present experimental results that demonstrate the usefulness of the analytical covariance bounds for predicting the accuracy of the robot's and landmarks' localization. In this experiment, a Pioneer 3 robot equipped with two opposite-facing SICK LMS200 laser scanners, which provide a 360o field of view, was employed. The robot is shown in Fig. 5:

 

Figure 5


During the experiment, the robot moves randomly while performing SLAM in an area of approximate dimensions 10m×4m. The laser scans are processed for detecting four prominent corners in the area, which are used as landmarks. For detecting each corner, line-fitting is employed to compute the equations of adjacent wall lines, and the intersection of these lines is determined. The robot also receives translational and rotational velocity measurements from its wheel encoders. The estimated robot trajectory, as well as the landmark positions, are shown in Fig. 6. In the same figure, a sample laser scan is superimposed (after being transformed to the global frame), to illustrate the geometry of the area where the robot operates.

Figure 6

 


In Fig. 7, the standard deviation of the estimation errors (solid lines), as this is computed by the filter, is compared to the standard deviation computed with the theoretically derived bounds (dashed lines).

(a)

 

  (b)                                                                     (c)

Figure 7: (a) the landmarks’ position standard deviation and corresponding upper bound (b) The robot’s position standard deviation and corresponding upper bound (c) The robot’s orientation standard deviation and corresponding upper bound.

 

 

From the above plots we conclude that the analytical bounds that we have derived can be employed in order to predict the localization accuracy of SLAM, without having to resort to extensive simulations or experimentation. We should point out that in this particular case, where the robot moves randomly in space, the actual standard deviations are approximately 2-3 times smaller than the corresponding upper bounds. If the robot’s trajectory was such that the robot-to-landmark distances were always close to their maximum allowable values (which are used in the bound computation), the bounds would have been significantly tighter. This fact has been verified in numerous simulation studies of “adverse” SLAM setups. Finally, it is worth mentioning that due to occlusions and data association failures, the landmarks were not detected in every laser scan. On the average, the landmarks were successfully detected 94% of the time. Despite these fluctuations in the number of observed landmarks, the theoretical bounds still provide a quite accurate characterization of the uncertainty in SLAM.

Related Publications:

1.  A.I. Mourikis, S.I. Roumeliotis: "Predicting the Performance of Cooperative Simultaneous Localization and Mapping (C-SLAM),''  International Journal of Robotics Research 25(12), pp. 1273-1286, Dec 2006.

[pdf bibtex]


2.  A.I. Mourikis, S.I. Roumeliotis: "Performance Analysis of Multirobot Cooperative Localization,'' IEEE Transactions on Robotics 22(4), pp. 666-681, Aug. 2006.

[pdf, bibtex]

 

3. S.I. Roumeliotis, I.M. Rekleitis, "Propagation of Uncertainty in  Cooperative Multirobot Localization: Analysis and Experimental Results", Autonomous Robots, 17(1), pp. 41-54, July 2004.

[pdf]

 

4. A.I. Mourikis, S.I. Roumeliotis: "Analytical Characterization of the Accuracy of SLAM without Absolute Orientation Measurements," Proceedings of Robotics: Science and Systems, Philadelphia, PA, Aug. 16-19, 2006.

[pdf bibtex]

 

5. A.I. Mourikis, S.I. Roumeliotis: "Performance Bounds for Cooperative Simultaneous Localization and Mapping (C-SLAM)," Proceedings of Robotics: Science and Systems, June 8-11, 2005, Boston, MA, pp. 73-80.

[pdf bibtex]

 

6.  A.I. Mourikis, S.I. Roumeliotis: "Analysis of Positioning Uncertainty in Simultaneous Localization and Mapping (SLAM)," in Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, September 28 - October 2, 2004, Sendai, Japan, pp. 13-20.

[pdf bibtex]

 

7.  A.I. Mourikis, S.I. Roumeliotis: "Analysis of Positioning Uncertainty in Reconfigurable Networks of Heterogeneous Mobile Robots,'' in Proceedings of the IEEE International Conference on Robotics and Automation, April 26-May 1, 2004, New Orleans, LA, pp. 572-579.

[pdf bibtex]

 

8. S.I. Roumeliotis, I.M. Rekleitis, "Analysis of Multirobot Localization Uncertainty Propagation" , In Proceedings of the 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems, Las Vegas, NV, Oct. 27-31, pp. 1763-1770.

[pdf]

 

9. I.M. Rekleitis, S.I. Roumeliotis , "Analytical Expressions for Positioning Uncertainty Propagation in Networks of Robots" . In Proceedings of the 11th IEEE Mediterranean Conference on Control and Automation, Rhodes, Greece, June 17-20, 2003, pp. 131-136.

[pdf]

Acknowledgements:

This work was supported by the University of Minnesota (GiA Award, DTC), the Jet Propulsion Laboratory (Grant No. 1248696, 1251073), the NASA Mars Technology Program (MTP-1263201), and the National Science Foundation (EIA-0324864, IIS-0643680).

 

 
 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 
Computer Science and EngineeringUniversity of MinnesotaInstitute of Technology