
   
PERFORMANCE
CHARACTERIZATION OF COOPERATIVE LOCALIZATION AND SLAM
UMN Researchers:
Anastasios
Mourikis ,
Prof. Stergios Roumeliotis
Motivation:
The goal of this project
is to provide theoretical tools for characterizing the accuracy of robot
localization. In particular, our work focuses on three classes of localization
problems:
1.
Cooperative Localization (CL)
2.
Simultaneous Localization and Mapping (SLAM)
3.
Cooperative SLAM (C-SLAM)
Mobile
robot teams have attracted the interest of the robotics
community, because of the increased efficiency and reliability
resulting when multiple robots cooperate for performing a task.
In particular, localization (CL, SLAM, and C-SLAM) has been
the most active research area of mobile robotics for the past
two decades. This is due to the fact that it permits accurate
pose estimation in unknown environments necessary for autonomy.
However, most of the
research work on CL, SLAM, and C-SLAM has focused on
implementation techniques and on addressing the problem of
computational complexity. The issue of analytical evaluation of
performance has been largely ignored in the literature, with
only few exceptions of limited scope. As a result, questions
such as "How much more accurate will the position estimates
become if the odometry noise variance is reduced by 50%?", or
"Will a particular set of sensors allow a robot to achieve localization
errors smaller than 1m after 1h of operation?" can only be
answered after extensive simulations and/or time-consuming
experimentation. Clearly, this is a significant obstacle for
efficient robot design. Our work aims at providing analytical means for
answering such questions.
Contribution:
The
primary contribution of this work is the derivation of
theoretical tools for evaluating the performance, in terms of
positioning accuracy, of CL, SLAM, and C-SLAM. In particular, we
present analytical expressions that determine the guaranteed
accuracy of localization, as a function of the
following system-design parameters:
-
the accuracy of the robots' sensors
-
the number of robots and features
-
the structure of Relative Position
Measurement Graph (RPMG) that describes the measurement
topology between the robots and/or landmarks
-
the statistical properties of the robots'
trajectories
-
the spatial distribution of features, in
SLAM and C-SLAM
These expressions predict the localization accuracy a given robot
design and facilitate the
process of selecting the appropriate sensors for
meeting the accuracy requirements of a given task. Moreover,
the availability of analytical results enable one to study the
properties of positioning errors during CL, SLAM, and C-SLAM and develop an intuitive understanding of the
interaction between the system parameters. This knowledge will lead to design
rules, which will reduce the time and effort required for new robot
designs. Prior to this work, experimentation and numerical
simulations were the only tools available for studying the
trade-offs between selections of such parameters. These time-consuming methods become necessary only after a design has been finalized merely for validation purposes.
Approach:
Our specific goal is to study the properties
of the state covariance matrix during pose estimation, since
this matrix is a concrete measure of the uncertainty. The main challenge with this problem is that the models describing both the
motion and the measurements of robots moving in 2D and 3D are
generally nonlinear. As a result, the Extended Kalman Filter (EKF),
rather than the linear Kalman filter, is applied for state
estimation, and the Riccati recursion, which describes the time
evolution of the covariance, is time-varying. For this Riccati
no closed-form solution exists in the general case.
Therefore, in order to analytically study the
properties of CL for robots moving in 2D, we resort to the
derivation of upper bounds for the covariance of the position
estimates. In particular, in our work we derive upper bounds on
In
the latter case, prior information about the statistical
properties of the robot's trajectories (and of the features'
distribution, in the case of SLAM), is utilized.
In order to compute the upper bounds on the
worst-case uncertainty, our approach is based on deriving a
"bounding" LTI system, whose covariance at every time step is
provably an upper bound of the covariance in the original,
nonlinear system. This is achieved by determining upper bounds
on the system noise covariance matrix and the relative position
measurement covariance matrix. By obtaining the
steady-state solution of the Riccati corresponding to this LTI
system, we are able to predict the guaranteed asymptotic
accuracy of localization.
A similar approach, based on defining a
different "bounding" LTI system, whose covariance is provably an
upper bound to the expected uncertainty of the original
nonlinear system, is followed for characterizing the expected performance of the system.
Results:
We
have carried out extensive simulation tests and real-world
experiments to validate the theoretical analysis, and to
demonstrate its usefulness in predicting the performance of
localization systems. In what follows, some representative
results are described:
A.
Cooperative Localization
We
here present simulation results showing the effects of RPMG
reconfigurations. The behavior of the covariance that is
observed in the plots is predicted by, and corroborates, the
theoretical analysis. The following figure shows the four
different RPMG topologies that are used for this simulation
test:

Figure 1
For
this simulation, a homogeneous robot team comprising 9 robots is
considered. The time evolution of the covariance is shown in
Fig. 2:

Figure 2
In
this plot, the covariance along the x axis for all robots is
plotted. During the first 200sec of their mission, the robots
localize independently (Dead Reckoning, DR). At t = 200sec, the
robots start recording relative position measurements, which are
described by a complete RPMG topology (cf. Fig. 1-I). The sharp
improvement in localization accuracy, as well as the decrease in
the rate of covariance increase, becomes evident. At t = 400sec,
the RPMG topology changes to a sparser, ring graph (cf. Fig.
1-II). Clearly, after an initial transient response, the rate at
which the covariance increases with the new RPMG topology
remains unchanged, and a small constant penalty in performance
is incurred. This result, which has very important practical
implications, is predicted by our theoretical analysis.
At t
= 600sec, a simulated communication failure occurs, and only two
of the robots are able to record and communicate relative
position measurements (cf. Fig. 1-III). Careful examination of
the plot reveals that the rate of uncertainty increase for these
two robots is precisely half that of the rest of the robots,
which localize independently. This result verifies an important
prediction of our analysis, which stipulates that the rate of
uncertainty increase, for homogeneous robot teams, is inversely
proportional to the number of robots.
At t
= 800sec, the initial complete graph topology is restored (cf.
Fig. 1-I). We observe that, as expected by the theoretical
analysis, the covariance for all robots is identical to the one
that would arise if no RPMG reconfigurations had occurred.
Finally, at t = 1000sec, the RPMG assumes a random (i.e.,
non-canonical) topology (cf. Fig. 1-IV). Clearly, for this
topology the asymptotic rate of uncertainty increase for all
robots is identical, even though the constant term of the
covariance varies among robots.
B.
Cooperative Simultaneous Localization and Mapping
We
here present simulation results that demonstrate the application
of the derived upper bound, and show the effects of RPMG
reconfigurations in C-SLAM. The RPMG used in this simulation is
shown in Fig. 3:

Figure 3
In
particular, a team comprised of 4 robots, performing C-SLAM with
3 features, is considered. For the first 1000sec, the RPMG
has the structure shown in Fig. 3, while for the remaining
1000sec, the RPMG is a denser one, where each robot records
measurements to all other robots and landmarks. The time
evolution of the covariance of the position estimates for this
case is shown in Fig. 4, along with the theoretically computed
bounds:

Figure 4
From
this plot we observe that the covariance of the landmarks'
position estimates does not change after the RPMG changes. This
is an important result, which is predicted by the closed-form
expressions for the covariance. On the other hand, the robots'
position estimates become more accurate, as a result of the
increased positioning information that is available to each
robot, in the new dense RPMG. Note also that, since in the new
RPMG all robots perform the same number of measurements, the
covariance bound is identical for all of them, in contrast to
the situation occurring with the initial RPMG topology.
C.
Simultaneous Localization and Mapping
For
the case of SLAM, we present experimental results that
demonstrate the usefulness of the analytical covariance bounds
for predicting the accuracy of the robot's and landmarks'
localization. In this experiment, a Pioneer 3 robot equipped
with two opposite-facing SICK LMS200 laser scanners, which
provide a 360o field of view, was employed. The robot
is shown in Fig. 5:

Figure 5
During the experiment, the robot moves randomly while performing
SLAM in an area of approximate dimensions 10m×4m. The laser
scans are processed for detecting four prominent corners in the
area, which are used as landmarks. For detecting each corner,
line-fitting is employed to compute the equations of adjacent
wall lines, and the intersection of these lines is determined.
The robot also receives translational and rotational velocity
measurements from its wheel encoders. The estimated robot
trajectory, as well as the landmark positions, are shown in Fig.
6. In the same figure, a sample laser scan is superimposed
(after being transformed to the global frame), to illustrate the
geometry of the area where the robot operates.

Figure 6
In Fig. 7, the standard deviation of the estimation errors
(solid lines), as this is computed by the filter, is compared to
the standard deviation computed with the theoretically derived
bounds (dashed lines).

(a)

(b)
(c)
|
Figure 7: (a)
the landmarks’ position standard deviation and
corresponding upper bound (b) The robot’s position
standard deviation and corresponding upper bound (c)
The robot’s orientation standard deviation and
corresponding upper bound. |
From
the above plots we conclude that the analytical bounds that we
have derived can be employed in order to predict the
localization accuracy of SLAM, without having to resort to
extensive simulations or experimentation. We should point out
that in this particular case, where the robot moves randomly in
space, the actual standard deviations are approximately 2-3
times smaller than the corresponding upper bounds. If the
robot’s trajectory was such that the robot-to-landmark distances
were always close to their maximum allowable values (which are
used in the bound computation), the bounds would have been
significantly tighter. This fact has been verified in numerous
simulation studies of “adverse” SLAM setups. Finally, it is
worth mentioning that due to occlusions and data association
failures, the landmarks were not detected in every laser scan.
On the average, the landmarks were successfully detected 94% of
the time. Despite these fluctuations in the number of observed
landmarks, the theoretical bounds still provide a quite accurate
characterization of the uncertainty in SLAM.
Related Publications:
1.
A.I. Mourikis, S.I.
Roumeliotis: "Predicting the Performance of Cooperative
Simultaneous Localization and Mapping (C-SLAM),''
International Journal of Robotics Research 25(12), pp.
1273-1286, Dec 2006.
[pdf,
bibtex]
2. A.I. Mourikis, S.I. Roumeliotis: "Performance
Analysis of Multirobot Cooperative Localization,'' IEEE
Transactions on Robotics 22(4), pp. 666-681, Aug. 2006.
[pdf,
bibtex]
3. S.I. Roumeliotis, I.M. Rekleitis,
"Propagation of Uncertainty in Cooperative Multirobot
Localization: Analysis and Experimental Results",
Autonomous Robots, 17(1), pp. 41-54, July 2004.
[pdf]
4. A.I. Mourikis, S.I.
Roumeliotis: "Analytical Characterization of the Accuracy of
SLAM without Absolute Orientation Measurements,"
Proceedings of Robotics: Science and Systems, Philadelphia,
PA, Aug. 16-19, 2006.
[pdf,
bibtex]
5.
A.I. Mourikis, S.I.
Roumeliotis: "Performance Bounds for Cooperative Simultaneous
Localization and Mapping (C-SLAM)," Proceedings of
Robotics: Science and Systems, June 8-11, 2005, Boston, MA,
pp. 73-80.
[pdf,
bibtex]
6. A.I.
Mourikis, S.I. Roumeliotis: "Analysis of Positioning
Uncertainty in Simultaneous Localization and Mapping (SLAM),"
in Proceedings of the IEEE/RSJ International Conference on
Intelligent Robots and Systems, September 28 - October 2,
2004, Sendai, Japan, pp. 13-20.
[pdf,
bibtex]
7. A.I.
Mourikis, S.I. Roumeliotis: "Analysis of Positioning
Uncertainty in Reconfigurable Networks of Heterogeneous Mobile
Robots,'' in Proceedings of the IEEE International
Conference on Robotics and Automation, April 26-May 1, 2004,
New Orleans, LA, pp. 572-579.
[pdf,
bibtex]
8. S.I. Roumeliotis, I.M. Rekleitis,
"Analysis of Multirobot Localization Uncertainty Propagation"
, In Proceedings of the 2003 IEEE/RSJ International
Conference on Intelligent Robots and Systems, Las Vegas, NV,
Oct. 27-31, pp. 1763-1770.
[pdf]
9. I.M. Rekleitis, S.I. Roumeliotis ,
"Analytical Expressions for Positioning Uncertainty Propagation
in Networks of Robots" . In Proceedings of the 11th
IEEE Mediterranean Conference on Control and Automation,
Rhodes, Greece, June 17-20, 2003, pp. 131-136.
[pdf]
Acknowledgements:
This work was supported by the
University of Minnesota (GiA Award, DTC), the Jet Propulsion Laboratory (Grant
No. 1248696, 1251073), the NASA Mars Technology Program (MTP-1263201),
and the National Science Foundation (EIA-0324864, IIS-0643680).
|