Visual odometry step by step ( ZED stereo camera )

-
1. Initial setting:
  1.  Install OpenCV extra modules
  2.  Setting nsight environment (include and lib path)
  3.  Confirm ZED Serial number (/usr/local/zed/tools/ZED Explorer)
  4.  Key in ZED SN to get camera matrix and rectified images 後來改成用ZED SDK得到camera matrix (每次run程式時，回傳值都有一點誤差，可能是環境溫度等等造成)
  5.  Open ZED Camera and get real-time rectified images
Reference:
2. Feature matching / Stereo matching:
  1. Convert ZED source images to grayscale images
  2. Declare an OpenCV matcher (ex: BFMatcher) 
  3. Search match points between two images (left and right)
  4. Storing keypoints into vectors 
  5. Using RANSAC method to find good stereo matching points (findHomography OpenCV Fundamental matrix function)
  6. Draw and Display good stereo matching points according RANSAC_mask 
Reference:
  1. OpenCV function (triangulatePoints, convertPointsFromHomogeneous)
  2. Install VTK (Install VTK)
  3. Install PCL (Point Cloud Library)
  4. Install eigen (Install eigen)
Reference:
3.b Get object's 3D position by ZED SDK

Reference:

4. Estimate Camera pose using pnp algorithm
  1. Find initial object's 3D position
  2. Find matching point between lefe image (t-1) and left image (t)                                        Reference: Fundamental matrix RANSAC
  3. Calculate camera pose respect to the initial 3D position (Always use left image)
Reference: 

留言

張貼留言

這個網誌中的熱門文章

Useful PX4 Parameters

-
1. For setting companion link SYS_COMPANION (Before ver. 1.9.0) MAV_0_CONFIG, MAV_0_MODE (After ver. 1.9.0) 2. EKF2 configuration EKF2_AID_MASK EKF2_HGT_MODE EKF2_EV_DELAY (Reduce this parameter if high rate external vision is available) EKF2_EV_POS_X, EKF2_EV_POS_Y, EKF2_EV_POS_Z 3. Offboard mode parameters ( The vehicle will exit the mode if target setpoints are not received at a rate of > 2Hz ) COM_OBL_RC_ACT (Default: position mode, I set land mode) COM_OBL_ACT COM_OF_LOSS_T 4. Position loss failsafe COM_POSCTL_NAVL 5. Land mode MPC_LAND_SPEED COM_DISARM_LAND: Time-out for auto disarm after landing. (Default: 0, I set 3.) 6. TBD Reference: [1]  https://dev.px4.io/en/advanced/parameter_reference.html [2]  https://dev.px4.io/en/ros/external_position_estimation.html#tuning-EKF2_EV_DELAY [3]  https://docs.px4.io/en/config/safety.html#qgc_safety_setup
閱讀完整內容

Tuing PID parameters in QGroundcontrol (2)

-
圖片
Based on tips for tuning PX4 PID parameters written in my previous post [1] or even using the default values directly, you will be able to fly your vehicle freely in manual or stabilized flight mode.   However, if you are using an unique vehicle (usually assembly by yourself and only equipped with sensors you desire) and struggling for finding the best PID parameters for your applications. I think following 8 tips will help you to get ideal PID parameters.  This is the vehicle I made based on LHI QAV250 fiber frame, with TX2, high-speed camera, etc.[2]  Tip1:  Tuning order: Rate controller -> attitude controller -> position controller The PX4 controllers are layered [3], which means a higher-level controller passes its results to a lower-level controller. Thus the PID tuning needs to be done from lowest-level controller to highest-level controller. Tip2:  Check if  PWM_MIN  is set correctly. Remove propellers Arm the vehic...
閱讀完整內容

Matlab Pixhawk Support Package installation (Windows)

-
圖片
1. Download the pixhawk support package [1] 2. Open MATLAB R2017b and navigate to the file location. 3. Click "PX4PSP_v3_0_4_351_R2017b" and install it 4. Create a folder for firmware download path (ex: D/PX4) 5. Setting bash environment for windows 10 [2]  (1) Active "Windows subsystem for linux" (2) Download and install Ubuntu (3) Using the terminal like in Ubuntu environment ex: 6. Install all necessary toolchain with " windows_bash_nuttx.sh " [3] or using Cygwin Toolchian [4] or [5] (python27 would show in following folder) 7. Key in command " PixhawkPSP(' D:\PX4 ') " in the Matlab 8. Make sure windows 10 bash and python path are correct => Validate paths 9. Download firmware to the folder we specify before and then validate firmware. 10. Selecting cmake configuration [6] 11. Build firmware *Error: make command not found   Solution: [7] T...
閱讀完整內容