Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The RMS measured by the rpg dataset is different from the result in the paper #28

Open
ZDJeffrey opened this issue Apr 26, 2023 · 1 comment

Comments

@ZDJeffrey
Copy link

Hello Dr. Zhou. I used 538b576 to test the RMS of the Relative Pose Error of the rpg data set, but the results are very different from the results in the paper, and the results of the upenn data set are similar to the results in the paper.
I use rostopic to record pose_pub and groundtruth, then use evo_traj to convert rosbag to tum format, and finally use evaluate_rpe.py to calculate the error.
I would like to ask if additional processing is required for the rpg dataset, or is it a problem with the testing method I am using. At the same time, I would like to ask how you measure Relative Pose Error and Absolute Trajectory Error.

dataset R in the paper(deg/s) R(deg/s) t in the paper(cm/s) t(cm/s)
rpg_bin 1.2 10.1 3.1 19.3
rpg_box 3.4 22.2 7.2 27.5
rpg_desk 3.1 12.7 4.5 20.6
rpg_monitor 1.7 14.0 3.2 15.8
upenn_flying1 1.0 1.1 6.5 6.8
upenn_flying3 1.2 1.1 7.1 6.5
@ZDJeffrey
Copy link
Author

I have found the T_maker_left to transform points and get the RMS of the Relative Pose Error of the rpg data set similar to the results in the paper. However, the RMS of the Absolute Trajectory Error tested after using T_maker_left is still different from the results in the paper , especially when using rpg monitor.

dataset Paper(cm) Test(cm)
rpg bin 2.8 3.7
rpg box 5.8 6.1
rpg desk 3.2 4.5
rpg monitor 3.3 8.0
upenn flying1 13.9 14.0
upenn flying3 11.1 9.5

@ZDJeffrey ZDJeffrey changed the title The RMS of rpe measured by the rpg dataset is too large The RMS of rpe measured by the rpg dataset is different from the result in the Jun 20, 2023
@ZDJeffrey ZDJeffrey changed the title The RMS of rpe measured by the rpg dataset is different from the result in the The RMS of rpe measured by the rpg dataset is different from the result in the paper Jun 20, 2023
@ZDJeffrey ZDJeffrey changed the title The RMS of rpe measured by the rpg dataset is different from the result in the paper The RMS measured by the rpg dataset is different from the result in the paper Jun 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant