http://orcid.org/0000-0002-3136-5673
Figures
Abstract
Registration of laser scans, or point clouds in general, is a crucial step of localization and mapping with mobile robots or in object modeling pipelines. A coarse alignment of the point clouds is generally needed before applying local methods such as the Iterative Closest Point (ICP) algorithm. We propose a feature-based approach to point cloud registration and evaluate the proposed method and its individual components on challenging real-world datasets. For a moderate overlap between the laser scans, the method provides a superior registration accuracy compared to state-of-the-art methods including Generalized ICP, 3D Normal-Distribution Transform, Fast Point-Feature Histograms, and 4-Points Congruent Sets. Compared to the surface normals, the points as the underlying features yield higher performance in both keypoint detection and establishing local reference frames. Moreover, sign disambiguation of the basis vectors proves to be an important aspect in creating repeatable local reference frames. A novel method for sign disambiguation is proposed which yields highly repeatable reference frames.
Citation: Petricek T, Svoboda T (2017) Point cloud registration from local feature correspondences—Evaluation on challenging datasets. PLoS ONE 12(11): e0187943. https://doi.org/10.1371/journal.pone.0187943
Editor: Kim-Kwang Raymond Choo, University of Texas at San Antonio, UNITED STATES
Received: June 2, 2017; Accepted: October 28, 2017; Published: November 14, 2017
Copyright: © 2017 Petricek, Svoboda. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data sets and the evaluation protocol are publicly available under the section Laser Registration Datasets at: http://projects.asl.ethz.ch/datasets.
Funding: This work has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 692455 Enable-S3 (TP, http://ec.europa.eu/programmes/horizon2020/en/) and from the Grant Agency of the Czech Technical University in Prague under grant SGS16/161/OHK3/2T/13 (TS, https://sgs.cvut.cz). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Point cloud registration has many applications including mobile robotics, object modeling, and object recognition and pose estimation. It is a crucial step of the most commonly used methods for Simultaneous Localization and Mapping (SLAM), whether operating on the data from laser scanners or consumer-electronics RGB-D sensors, which have become widely available.
A variant of the Iterative Closest Points (ICP) algorithm is often employed to solve the task— see [1, 2] for the seminal papers on its point-to-point and point-to-plane formulations, respectively, or [3] for a generalization of these two methods. Despite many advantages of the algorithm, including real-time operation in some settings, the ICP algorithm has several drawbacks. Being an iterative local minimization method, it is sensitive to the initial alignment of the point clouds to be registered and their mutual overlap. As shown by [4], an inaccurate initial alignment or a low overlap between laser scans may deteriorate the accuracy of registration severely.
In order to overcome the limitations of the ICP algorithm, methods to establish global correspondences based local feature descriptors were suggested, such as [5, 6]. Since ICP performs very well if started within the basin of convergence, the coarse alignment obtained from these global methods often serves as an initial guess for ICP [6]. In modeling of objects from their partial views, ICP has been used to verify established correspondences and to refine registration provided from these [7].
Several alternative approaches have also been proposed. Instead of the special-purpose ICP formulation, Fitzgibbon [8] approached the registration problem as a general non-linear optimization which allowed to incorporate robust estimation via a Huber kernel. In 3D Normal-Distribution Transform (3D-NDT) [9], the surface is represented by a Gaussian Mixture Model and registration is also carried out by standard methods from numerical optimization. 4-points congruent sets (4PCS) are sought and matched in [10]. Despite the fast matching procedure proposed in the paper, for n input points the number of all possible coplanar 4-tuples is still , which presents a major issue, especially for scans with large planar regions. The computational efficiency of this method was later addressed in [11] by creating 4-tuples from sparse local features instead of points.
Even though many registration algorithms have been proposed, their fair comparison is still difficult due to a lack of datasets which would capture variety of scenes robots may encounter in the real world. A notable contribution to this area is due to [4, 12] which provide an experimental protocol using six medium-sized datasets with accurate ground-truth poses, capturing diverse environments, both indoor and outdoor, ranging from an apartment to a woodland area. This experimental protocol constitutes a basis for our evaluation. An example pair of reading and reference point clouds are shown in Fig 1. The same protocol has previously been used in evaluating 3D-NDT in [13, 14].
Point clouds from two datasets—(top) Gazebo with overlap 0.9 and (bottom) ETH with overlap 0.59. Reading and reference point clouds (left) prior registration and (right) aligned according to ground truth. The reference is displayed in blue, the reading in orange tones.
The contribution of the paper is threefold.
- We extend the local features from [15] by introducing keypoint detection and modifying the underlying method for establishing local reference frames. The method is evaluated on challenging real-world datasets, showing that for a moderate overlap between the laser scans, it provides a superior registration accuracy compared to four local methods [1–3, 9] and another three global methods [5, 10, 11].
- Underlying components of the method, namely the keypoint detection and the local reference frames, are evaluated with respect to the task, along with the effects of their respective parameters, and general suggestions are given concerning specific design choices.
- For local reference frames, we compare three methods for sign disambiguation of the basis vectors. One of these methods is novel and achieves better repeatability than the general method of [16] used in the Signature of Histograms of Orientations (SHOT) [17]. The results also justifies using the sensor position for sign disambiguation in situations when it is known.
Methods
Feature-based registration
We formulate the registration task according to [4]. Given two point clouds, reading and reference
, the task is to find a rigid transformation T0←1 such that p0 = T0←1(p1) for corresponding points
,
. In homogeneous coordinates, this is a linear transformation
(1)
with R0←1 being a 3-by-3 rotation matrix, t0←1 a 3-by-1 translation vector, and 0⊤ a 1-by-3 zero vector. Points pi can be assigned additional properties, such as surface normal ni, saliency hi, or a descriptor di, where the subscript denotes the index of the corresponding point.
The task is directly related to finding correspondences from the reading to the reference. From a set of tentative correspondences, found by matching local descriptors of the data, the transformation can be estimated using a robust estimator, such as Random Sample Consensus (RANSAC) [18].
We first introduce a general framework for feature-based registration. Within such a framework, underlaying components of the method are then evaluated.
Keypoint detection
Keypoints are selected as extrema of a saliency measure, which determines the kind of structures being sought in the data and directly affects repeatability and robustness of the detection. Fixed-scale and adaptive-scale detectors can be distinguished [19]—the former are given scale as a parameter, the latter seek characteristic scales within a scale-space representation of the data, which need to be constructed for these purposes. We will not consider scale-adaptive detectors for the registration task since the scale is not ambiguous with the data from calibrated sensors, relevant scale changes are unlikely to occur in reality, and because seeking characteristic scale introduces an additional source of errors which affect all the following stages. We restrict feature matching to include only features of the same scale.
Local extrema are obtained via non-maxima suppression where only the keypoints with locally maximal saliency are retained. Specifically, a keypoint at point p with saliency h is kept only if h ≥ hi for all , where
is a set of point indices within the σ-neighborhood of p. Points p with
are excluded from keypoint detection.
We consider two types of keypoint detectors. The first uses the covariance matrix of points,
(2)
where
, the second type uses the covariance matrix of normals,
(3)
where wi are weights assigned to individual points,
is a set of neighboring points of p, {i ∣ ‖pi − p‖ ≤ s}.
The eigenvalues of these covariance matrices will be denoted by λ1, λ2, λ3 in their decreasing order, and their corresponding eigenvectors by q1, q2, q3. We consider the following saliency measures as functions of the eigenvalues: , λ1, λ2, λ3,
,
.
Despite an intuitive geometrical meaning of the saliency measures, this may not directly correspond to their quality in terms of repeatability of the corresponding keypoints. Therefore, we evaluate several such measures in order to select the most suitable for the task at hand.
Some of these saliency measures have previously been used. For example, [20] uses the smallest eigenvalue λ3 of Cp and several methods based on Cn have been implemented in the Point Cloud Library [21], including the one using λ3, which can be seen as a direct extension of [22] but replacing the image gradients with the surface normals. We provide an experimental evaluation which compares them with possible alternatives and justifies their usage with challenging real-world data.
For the keypoints found in this stage we establish local reference frames and compute the descriptors.
Local reference frames
Local reference frames are the key means to achieve the desired level of descriptor invariance. Although the Cartesian coordinate system is the most common today [15, 17, 20], there are methods using a single reference axis [23], or no local frames at all [5]. Using reference frames yields several advantages. First, the three-dimensional distribution of points can be captured by the descriptor to increase its discriminative power. Second, each feature correspondence can provide an estimate of the transformation between the laser scans.
As noted by [17], although many methods rely on repeatable local frames, the importance of its particular choice is underrated. A common approach followed by many methods is to establish the basis of the reference frame from the eigenvectors of the feature covariance matrices as defined above.
As discussed in [16], singular value decomposition (SVD) of a matrix is unique only up to a reflection of each pair of singular vectors ui,vi since for every pair of singular vectors. The same applies to eigenvalue decomposition of real symmetric matrices. Disambiguating the sign of the eigenvectors is thus needed to obtain a unique and unambiguous reference frame [17]. Right-handedness of the reference frame is then enforced by setting one of the basis vectors to the cross product of the remaining two.
Zhong [20] uses the eigenvectors of the point covariance matrix Cp but does not disambiguate their signs. Tombari et al. [17] use the eigenvectors of the point covariance matrix Cp, replacing μ by the feature position p and using wi = 1 − ‖pi − p‖/s for the weights, s being the scale, and follow the general procedure of [16] to disambiguate signs. The eigenvectors of Cn are used in [15], with weights wi assigned based on the surface area of the respective polygons.
Throughout this paper, Qi denotes the orthonormal basis of the local reference frame associated with point pi, and contains the eigenvectors q1, q2, q3 in its columns. We consider three different methods of sign disambiguation, applied individually to each eigenvector q.
- The first, used in [15, 17], changes the sign of q to make ∑i sign(pi − p)⊤ q positive—we refer to this method as support.
- The second, denoted mean, reverses the sign of q if (μ − p)⊤ q < 0, where p is the feature position and μ the centroid of the points within the local neighborhood defined above. This method has not been used, to our knowledge, to establish local reference frames.
- The third, denoted sensor, assumes the sensor origin s is known and reverses the sign if (s − p)⊤ q < 0. This is a commonly used method for ensuring consistent orientation of estimated surface normals when the sensor position is known, yet it is less common in disambiguating all axes of local reference frames.
Feature descriptor
We use the descriptor of [15] with 3 × 3 in-plane spatial bins and 8 polar bins. The descriptor is created by projecting the points within the neighborhood and their corresponding normals onto three planes spanned by pairs of the basis vectors, and accumulating the projections into histograms. Each oriented point casts weighted votes into the two nearest polar bins, given by the normal projection, and into the four nearest spatial bins, given by the point projection. The weights are proportional to relative proximity to each histogram bin and inversely proportional to the local surface sampling density (the area of the corresponding polygon was used in [15]). See Fig 2 for an illustration, and [15] for more details regarding the descriptor and its application to object recognition.
(a) spherical support with local reference frame, (b) 8 orientation bins, (c) 4 spatial bins.
Pose from correspondences
Invariant descriptors are used to establish tentative correspondences from reading to reference. Let p1, p0 be a pair of points from reading and reference, respectively, and d1, d0 their associated descriptors. Then a correspondence is established if d0 is the among three nearest neighbors of d1 from the set of the reference descriptors and d1 is among three nearest neighbors of d0 from the set of the reading descriptors.
The pose is estimated from the set of tentative correspondences via Locally Optimized RANSAC [24]—pairs of correspondences, drawn randomly from the set, generate model poses and the pose maximizing the number of consensual correspondences is sought. The maximum number of iterations is estimated online, by setting the probability of missing the inlier set to η = 1/100 (see [24] for details). To generate the model poses, and to refine the pose from consensual correspondences, we use the method of [25] to find
(4)
for matching point positions p0,i, p1,i and normal vectors n0,i, n1,i. Before creating the model pose, we check that feature distances are consistent among both the point clouds and ignore the inconsistent samples.
Correspondences of the surface normals were used to generate model poses (from a pair of correspondences) and to locally optimize the model when up to five consensual correspondences were available. With more correspondences, the benefit of these terms vanished and minimizing the criterion based solely on the corresponding positions yielded more accurate pose estimates. Inlier threshold for a correspondence to be considered consensual was twice the scale of non-maxima suppression.
Dataset and experimental protocol
The laser registration datasets of [12] are used for experimental evaluation of the method and its components. The datasets were recorded with a laser rangefinder mounted on a tilting platform. For each scan the ground-truth position and orientation was obtained using a theodolite. The datasets contain both indoor and outdoor scenes, structured (an apartment, buildings) and unstructured environment (woodland area, a mountain plain), and dynamic elements with varying time spans (intra-scan and inter-scan motions, seasonal changes).
An experimental protocol for evaluation of point cloud registration methods is introduced in [4] by selecting pairs of scans from the datasets. From each dataset, 35 pairs of laser scans were selected to ensure approximately uniform coverage of the scan overlap from 0.3 to 0.99. The overlap is defined as the ratio of points from for which a matching point exists in
.
For each pair of point clouds 3 × 64 perturbations from the ground-truth alignment were generated to serve as initial alignments, 64 from each of the three Gaussian distributions with increasing variance. This establishes three classes of registration tasks with increasing difficulty, called easy, medium, and hard poses and constitutes a common ground for assessing sensitivity to initial alignment. As the feature-based methods are mostly insensitive to initial alignment of the point clouds we only use the first hard pose for each pair for their evaluation.
After transforming the reading point cloud to the initial pose, both point clouds are preprocessed as follows. First, the points with distance to the sensor less than 1m or greater than 20m are removed. Then, the point clouds are subsampled to achieve a maximum sampling density about 100m−2 and surface normal is estimated at each point kept by fitting a plane to its 15 nearest neighbors before subsampling. The normals are reoriented to point towards the sensor.
The datasets are particularly challenging due to several reasons. Our results suggest that the main difficulty comes with a low overlap between some of the point cloud pairs and sometimes prevailing repetitive structures, especially in the ETH dataset. Variations due to viewpoint change, sampling and noise seem to be relatively high compared to those induced by the variability in the scene itself.
Another difficulties comes with the sensing device—large parts of the scene are occluded by the moving platform itself, namely the poles on which the prisms are mounted. Tilting the laser also causes a very nonuniform sampling density, which increases towards the axis of rotation. Nevertheless, these are all difficulties which might need to addressed in applications and therefore we consider this to be a good benchmark for evaluation of registration methods.
Results
Prior to evaluating the registration method as a whole following the protocol of [4], we evaluate keypoint detection and local reference frames using a small number of laser scans and fix their parameters. The following parameter choices are assessed:
- type of the features used (points, normals),
- scale of the keypoint detection and the local reference frames,
- weights assigned to the features (normalized distance from feature point [17], surface area [15]),
- method of sign disambiguation (support, mean, sensor),
- pairs of basis vectors to ensure right-handedness of the local reference frames (q1 × q2, q2 × q3, q3 × q1).
Repeatability of keypoint detection
For keypoint detection we measure relative keypoint repeatability similarly to [19], as the ratio of the repeatable keypoints to all keypoints extracted from the reading. A keypoint is said to be repeatable if, after being transformed into the reference by the ground-truth transformation T0←1, its nearest neighbor among the keypoints detected in the reference is closer than some threshold. We set this threshold to be the same as the scale of non-maxima suppression.
As discussed in [26], the density of the extracted keypoints may affect the repeatability score—trivially extracting all the points would yield high repeatability. Thus, we include an experiment similar to the “Quantity Bias” experiment from [19], where only a limited number of the most salient keypoints are extracted to evaluate the keypoint detector. The repeatability score is also computed for the same number of randomly extracted points to assess the ratio of keypoints being matched by accident.
Regarding the feature weights, we have not found any to be significantly better than the others across all scales, both in keypoint detection and local reference frames, and therefore only the unit weights are considered further. From scales ranging from 0.25m to 1.0m, 0.35m provides best performing parameter combinations and is therefore selected to report the quantitative results below. This scale is also used in the point cloud registration experiments.
For each feature type, we report the results for the saliency measures in Fig 3. The saliency measure λ3 provides the best results for both feature types, with a large margin for points. It selects the regions where the minimum variance of the features in any direction is locally maximum, informally speaking, where the features spread in all directions most evenly. Note that the relative order of the saliency measures tends to be stable with the increasing number of selected keypoints, with only a few exceptions.
Repeatability of keypoints from (top) points and (bottom) normals for each saliency measure.
Repeatability of local reference frames
To evaluate the repeatability of the local reference frames, several metrics have been proposed— [17] measures the mean cosine of the corresponding axes, [27] aligns the z axes before measuring the cosine of the x axes to decorrelate the two measurements. In our experiments, we apply the same metric we use to quantify the rotation error of the registration itself.
Specifically, if Q1 and Q0 are the bases of the corresponding local reference frames from the reading and the reference, respectively, and R0←1 is the ground-truth rotation, the displacement of the reference frames is computed as
(5)
This measures the minimum angle of rotation needed to align the two bases and provides an upper bound on displacements of individual axes.
For the selected pairs of laser scans, 250 points are randomly selected from their overlapping parts where the local reference frames are established. The displacement eq is then computed for such corresponding reference frames.
As mentioned above, we further consider only the unit weights as other alternatives do not provide significant advantage. From scales 0.5m to 2.0m, the larger ones were found to provide more repeatable local reference frames and were also most frequent among the best performing combinations. All the results below are given for the scale fixed to 2m.
The average displacements for the sign disambiguation methods and the pairs of disambiguated vectors are shown in Fig 4. Note that we show the results with the remaining parameters having their optimal values—for example, the result for points and sign disambiguation based on the sensor uses q2 × q3 to comply with the right-hand rule but the similar result for normals uses q1 × q2 as these eigenvectors are easier to disambiguate for this feature type.
Average displacement eq of the corresponding local reference frames for (top) sign disambiguation methods and (bottom) pairs of disambiguated vectors ensuring right-handedness of the basis.
Fig 4 (top) shows that the sensor origin provides the strongest hint for the sign for both feature types, for points with a large margin, and therefore should be preferred to the others. In situations where the sensor origin is not available, the mean method outperforms the general method of [16, 17], here denoted support, when using points as features. For normals, these two methods perform comparably.
Fig 4 (bottom) shows that the most repeatable direction, including the sign, corresponds to the surface normal or a related direction, i.e., the 3rd basis vector for points, and the 1st basis vector for normals. The sign of this direction should therefore always be disambiguated directly, using an appropriate method, and not be given by the cross product of the remaining vectors.
Registration
In this section, we evaluate our method using the experimental protocol described above and compare it to state-of-the-art methods [3, 5, 9–11].
Let be the estimate of the ground-truth transformation T0←1 which aligns the reading with the reference. To assess the quality of the registration, [4] defines the residual transformation
(6)
and computes registration errors er and et from its rotational and translational components, ΔR and Δt, such that
(7)
(8)
where tr(ΔR) denotes the trace of ΔR. The rotation error er corresponds to the angle of rotation in the axis-angle representation. To allow an interpretation in terms of accuracy and precision, [4] suggests to use robust error statistics, namely the 50th, 75th and 95th percentiles of empirical distributions of the errors, referred to as A50, A75, A95. We follow this convention in our evaluation.
From local methods, we include in comparison Generalized ICP (G-ICP) [3] and 3D Normal-Distribution Transform (3D-NDT) [9] which is applied in a coarse-to-fine fashion with voxel sizes 2m, 1m and 0.5m. For a complementary evaluation of 3D-NDT, please refer to [13, 14, 28, 29]. From global methods, we include another method based on matching local features, namely the Fast Point-Feature Histograms (FPFH) with Sample Consensus Initial Alignment (SAC-IA) [5], and two alternative approaches, namely 4-Points Congruent Sets (4PCS) [10] and its keypoint-based variant (K-4PCS) [11].
In general, same preprocessing steps were used as for the proposed method except for 4PCS and K-4PCS for which we had to limit the number of input points to reduce running time, by using maximum density of 4m−2 and limiting maximum number of points to 500. For computing FPFH we used the common feature scale 2m, SAC-IA used three tentative correspondences for each feature and minimum feature distance of 1m to generate model poses. All the state-of-the-art methods were implemented in the Point Cloud Library [21].
The rotation and translation errors, er and et, for the samples from the hard poses are summarized in Table 1 (the best result for given percentile is typeset in bold). We also include the baseline results from [4] for the point-to-point (Point) [1] and point-to-plane (Plane) [2] ICP variants to allow easy comparison. Moreover, Fig 5 shows the full distributions of the errors achieved by the proposed method.
Distribution of (left) rotation and (right) translation errors for (top) all reading-reference pairs from hard poses and for (bottom) the pairs with overlap at least 0.75. A50, A75, and A95 denote the 50th, 75th, and 95th percentiles.
All methods considered in this paper fail in many cases, sometimes producing pose estimates which are further from the ground truth than the initial poses. Such results would most likely be unsatisfactory for any SLAM application. We also list the results for the reading-reference pairs with the overlap ratio at least 0.75 as the insufficient overlap seems to be the main cause why the methods based on matching invariant features are failing—see the bottom half of Table 1. Across higher overlap ratios, these methods yield good results in majority of cases.
Interesting fail cases are obtained with the ETH dataset—despite all methods failing to provide a reasonable translation estimate in most cases (A50 ≥ 2.37m), the feature-based methods consistently provide very accurate estimates of rotation. Moreover, our method even achieves the highest rotation accuracy on this dataset, contrary to a rather low translation accuracy. This is due to the regular structure of the environment with many repetitive patterns with similar orientation—even if these features are mismatched with each other, the rotation can still be estimated correctly from their correspondences. See Fig 6 for a visualization of consensual feature correspondences.
The reading and reference point clouds are displayed in orange and blue tones, respectively, aligned with each other using the ground-truth pose. Black lines connect the corresponding features from the consensual set, i.e., the inliers, marked by red circles and blue squares. The markers would be concentric in case of a perfect match. (left) Accurate pose estimate from 19 inliers in Gazebo point clouds with overlap 0.5. (right) Inaccurate translation estimate from 99 inliers in ETH point clouds with overlap 0.67.
Average registration errors across all datasets are summarized in Table 2, together with running times. The proposed method provides the most accurate estimates of rotation for all reading-reference pairs with hard initial poses, while 3D-NDT provides the most accurate estimates of translation. For relative overlap at least 75 percent, nevertheless, the proposed method provides superior accuracy in both rotation and translation. Average running time of our method, 14s, is less than 6× higher than that of the fastest local method, which is the point-to-point ICP, and about 3× lower than that of the second fastest global method, which is K-4PCS. Having been implemented in Matlab, our method can still benefit from further optimizations achieved by using a compiled language. Other methods were implemented in C++ as a part of the Point Cloud Library [21].
Conclusion
In this paper, we extended the local features of [15] by introducing keypoint detection and using a more robust method of the underlying local reference frames. The method was evaluated on a set of challenging real-world datasets [12]. We compared the method to state of the art—two local-optimization-based methods (Generalized ICP [3] and 3D Normal-Distribution Transform [9]) and three global-search-based methods (Fast Point-Feature Histograms with SAC [5] and two variants of the 4-Points Congruent Set method [10, 11]). The experimental protocol from [4] provided a sufficient level of difficulty for both classes.
Failures of the feature-based methods, ours and [5], are mostly due to low overlap between the point clouds and repetitive structures which prevail in some of the scenes, especially in the ETH dataset. Nevertheless, for overlap ratios above 0.75 the proposed method achieves the highest accuracy and could also be used to initialize the local methods which achieves high accuracy when an initial estimate within a basin of convergence is provided.
The evaluation of its underlying components suggests that the points constitute a more solid base for both detecting keypoints and establishing local reference frames than the surface normals. Local maxima of the smallest eigenvalue of the feature covariance matrix provide most repeatable keypoints for both of the feature types. Note that this corresponds to the well-known method image-based keypoint detector of [22].
Sign disambiguation of the basis vectors proved to be a very important aspect in creating repeatable local reference frames. For situations in which the sensor position is not known, we proposed a novel method which achieves better repeatability than the general method of [16] used in the SHOT descriptor [17]. The results also confirmed that the sensor position, when it is known, provides a very informative clue for sign disambiguation and justified its usage therein. Another conclusion can be made regarding which vectors should ensure a right-handed coordinate system—vectors close to surface normal are the easiest to disambiguate and should thus be used preferably.
We see many possibilities for improving the overall accuracy of registration which can be addressed in future work, namely
- introducing a verification step to ensure that the geometric constraints are met and the open-space assumption is not violated,
- detecting repetitive structures to reduce mismatched features, or
- using higher-level knowledge to identify, recognize, and match distinguished objects in the scene.
Acknowledgments
This work has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 692455 Enable-S3 and from the Grant Agency of the Czech Technical University in Prague under grant SGS16/161/OHK3/2T/13.
References
- 1. Besl PJ, McKay ND. A method for registration of 3-D shapes. Pattern Analysis and Machine Intelligence, IEEE Transactions on. 1992;14(2):239–256.
- 2. Chen Y, Medioni G. Object modelling by registration of multiple range images. Image and Vision Computing. 1992;10(3):145–155.
- 3.
Segal AV, Haehnel D, Thrun S. Generalized-ICP. In: Robotics: Science and Systems V. Seattle, USA; 2009.
- 4. Pomerleau F, Colas F, Siegwart R, Magnenat S. Comparing ICP variants on real-world data sets. Autonomous Robots. 2013;34(3):133–148.
- 5.
Rusu RB, Blodow N, Beetz M. Fast Point Feature Histograms (FPFH) for 3D registration. In: 2009 IEEE International Conference on Robotics and Automation; 2009. p. 3212–3217.
- 6. Mian A, Bennamoun M, Owens R. On the Repeatability and Quality of Keypoints for Local Feature-based 3D Object Retrieval from Cluttered Scenes. International Journal of Computer Vision. 2010;89:348–361.
- 7. Mian AS, Bennamoun M, Owens RA. Automatic Correspondence for 3D Modeling: An Extensive Review. International Journal of Shape Modeling. 2005;11(02):253–291.
- 8. Fitzgibbon AW. Robust registration of 2D and 3D point sets. Image and Vision Computing. 2003;21(13–14):1145–1153.
- 9.
Magnusson M. The Three-Dimensional Normal-Distributions Transform—an Efficient Representation for Registration, Surface Analysis, and Loop Detection. Örebro University; 2009.
- 10. Aiger D, Mitra NJ, Cohen-Or D. 4-Points Congruent Sets for Robust Pairwise Surface Registration. ACM Trans Graph. 2008;27(3):85:1–85:10.
- 11. Theiler P, Wegner J, Schindler K. Markerless point cloud registration with keypoint-based 4-points congruent sets. ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences. 2013;1(2):283–288.
- 12. Pomerleau F, Liu M, Colas F, Siegwart R. Challenging data sets for point cloud registration algorithms. The International Journal of Robotics Research. 2012;31(14):1705–1711.
- 13.
Hrabalík A. 3D Point Cloud Registration, Experimental Comparison and Fusing Range and Visual Data. Czech Technical University in Prague; 2014.
- 14.
Magnusson M, Vaskevicius N, Stoyanov T, Pathak K, Birk A. Beyond points: Evaluating recent 3D scan-matching algorithms. In: 2015 IEEE International Conference on Robotics and Automation (ICRA); 2015. p. 3631–3637.
- 15.
Petricek T, Svoboda T. Area-weighted Surface Normals for 3D Object Recognition. In: Pattern Recognition (ICPR), 2012 21th International Conference on; 2012. p. 1492–1496.
- 16. Bro R, Acar E, Kolda TG. Resolving the sign ambiguity in the singular value decomposition. Journal of Chemometrics. 2008;22(2):135–140.
- 17.
Tombari F, Salti S, Di Stefano L. Unique Signatures of Histograms for Local Surface Description. In: Daniilidis K, Maragos P, Paragios N, editors. Computer Vision—ECCV 2010. vol. 6313 of Lecture Notes in Computer Science. Springer Berlin / Heidelberg; 2010. p. 356–369.
- 18. Fischler MA, Bolles RC. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM. 1981;24(6):381–395.
- 19. Tombari F, Salti S, Di Stefano L. Performance Evaluation of 3D Keypoint Detectors. International Journal of Computer Vision. 2013;102:198–220.
- 20.
Zhong Y. Intrinsic shape signatures: A shape descriptor for 3D object recognition. In: Computer Vision Workshops (ICCV Workshops), 2009 IEEE 12th International Conference on; 2009. p. 689–696.
- 21.
Rusu RB, Cousins S. 3D is here: Point Cloud Library (PCL). In: 2011 IEEE International Conference on Robotics and Automation; 2011. p. 1–4.
- 22.
Shi J, Tomasi C. Good features to track. In: Computer Vision and Pattern Recognition, 1994. Proceedings CVPR’94., 1994 IEEE Computer Society Conference on; 1994. p. 593–600.
- 23. Johnson AE, Hebert M. Using spin images for efficient object recognition in cluttered 3D scenes. Pattern Analysis and Machine Intelligence, IEEE Transactions on. 1999;21(5):433–449.
- 24.
Chum O, Matas J, Kittler J. Locally Optimized RANSAC. In: Michaelis B, Krell G, editors. Pattern Recognition. vol. 2781 of Lecture Notes in Computer Science. Springer Berlin Heidelberg; 2003. p. 236–243.
- 25. Walker MW, Shao L, Volz RA. Estimating 3-D location parameters using dual number quaternions. CVGIP: Image Understanding. 1991;54(3):358–367.
- 26. Mikolajczyk K, Tuytelaars T, Schmid C, Zisserman A, Matas J, Schaffalitzky F, et al. A comparison of affine region detectors. International journal of computer vision. 2005;65(1):43–72.
- 27.
Petrelli A, Di Stefano L. On the repeatability of the local reference frame for partial shape matching. In: Computer Vision (ICCV), 2011 IEEE International Conference on; 2011. p. 2244–2251.
- 28.
Stoyanov T, Magnusson M, Lilienthal AJ. Point set registration through minimization of the L2 distance between 3D-NDT models. In: Robotics and Automation (ICRA), 2012 IEEE International Conference on; 2012. p. 5196–5201.
- 29.
Das A, Servos J, Waslander SL. 3D Scan Registration Using the Normal Distributions Transform with Ground Segmentation and Point Cloud Clustering. In: 2013 IEEE International Conference on Robotics and Automation; 2013.