Differences
This shows you the differences between two versions of the page.
|
beobot_2.0_software_system_gistsal_localization_navigation [2013/05/05 17:45] siagian created |
beobot_2.0_software_system_gistsal_localization_navigation [2013/12/05 15:42] (current) siagian |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| - | This system utilizes the salient regions that are recognized by the [http://ilab.usc.edu/siagian/Research/RobotVisionLocalization/RobotVisionLocalization.html localization system] to direct the robot's heading. | + | This [[http://ilab.usc.edu/siagian/Research/RobotVisionNavigation/RobotVisionNavigation.html |system]] |
| + | utilizes the salient regions that are recognized by the | ||
| + | [[http://ilab.usc.edu/siagian/Research/RobotVisionLocalization/RobotVisionLocalization.html | localization system]] | ||
| + | to direct the robot's heading. | ||
| - | We submitted a paper to '''IROS 2010''' and '''will create a webpage''' about the navigation system summarizing it. | + | Here we mostly deal with tools and implementation details that are too specific for our lab (both hardware and software), |
| - | + | and are not included in the papers. | |
| - | Here we mostly deal with tools and implementation details that are too specific for our lab (both hardware and software), and are not included in the papers. | + | |
| ==To Do== | ==To Do== | ||
| improvements: | improvements: | ||
| - | * KAI & CHRISTIAN: change corner db to use salient regions. | + | * KAI & CHRISTIAN: change corner db to use salient regions. |
| - | * CHRISTIAN: '''Local Navigation Map''' | + | * CHRISTIAN: **Local Navigation Map** |
| - | * KAI: encoder based robot control. For example: | + | * KAI: encoder based robot control. For example: |
| - | (trans, vel) of (1.0,0.0) means same number of ticks left and right (no need to worry about slippage). | + | (trans, vel) of (1.0,0.0) means same number of ticks left and right (no need to worry about slippage). |
| - | (trans, vel) of (0.0,1.0) means same number of ticks left and right but in opposite direction (no need to worry about slippage). | + | (trans, vel) of (0.0,1.0) means same number of ticks left and right but in opposite direction (no need to worry about slippage). |
| IEEE-TRobotics data to take: | IEEE-TRobotics data to take: | ||
| - | * better groundtruth than the encoder integration, GPS based maybe. | + | * better ground truth than the encoder integration, GPS based maybe. |
| - | * add trajectory. | + | * add trajectory. |
| - | * sites: 1 indoor with many branches and decision making in the corners. | + | * sites: 1 indoor with many branches and decision making in the corners. |
| - | * add results: success/not scraping, number of recovery, time of travel, speed of robot. | + | * add results: success/not scraping, number of recovery, time of travel, speed of robot. |
| - | * Check the remaining '''references in the googledocs''' | + | * Check the remaining **references in the googledocs** |
| Line 29: | Line 31: | ||
| The steps to create an environment information (map and landmark database) is the following: | The steps to create an environment information (map and landmark database) is the following: | ||
| - | * divide the training images to segments. | + | * divide the training images to segments. |
| - | * run the GSnav programs (bin/beobot-GSnav-master, bin/beobot-GSnav, bin/beobot-GSnav-dorsal) to create a landmark database and gist features for each frame. On 3 separate shell, ssh to bx4 or where the data is (usually where the camera is currently connected to), run in parallel commands below. Note that this has to be done for each session for each segment. Run the GSnav and GSnav-dorsal first. Wait for 5 seconds, then run GSnav-master: | + | * run the GSnav programs (bin/beobot-GSnav-master, bin/beobot-GSnav, bin/beobot-GSnav-dorsal) to create a landmark database and gist features for each frame. On 3 separate shell, ssh to bx4 or where the data is (usually where the camera is currently connected to), run in parallel commands below. Note that this has to be done for each session for each segment. Run the GSnav and GSnav-dorsal first. Wait for 5 seconds, then run GSnav-master: |
| $ bin/beobot-GSnav --ip-port=9791 | $ bin/beobot-GSnav --ip-port=9791 | ||
| $ bin/beobot-GSnav-dorsal --ip-port=9792 | $ bin/beobot-GSnav-dorsal --ip-port=9792 | ||
| Line 44: | Line 46: | ||
| SITE_current_segment_number | SITE_current_segment_number | ||
| - | make sure the image size is '''160x120''' | + | make sure the image size is **160x120** |
| - | * train the '''segment estimator''' using bin/train-FFN (feed-forward neural network) explained below: | + | * train the **segment estimator** using bin/train-FFN (feed-forward neural network) explained below: |
| - | * create a '''topological map''' by hand. We need to measure the distances of each edge and record the locations of each node. | + | * create a **topological map** by hand. We need to measure the distances of each edge and record the locations of each node. |
| Line 53: | Line 55: | ||
| The following are the few steps: | The following are the few steps: | ||
| - | * Calculate the dimension reduction Matrix: | + | * Calculate the dimension reduction Matrix: |
| - | * Open Matlab (may need to move the SITE_sessions.txt and gist files to a computer with Matlab) | + | * Open Matlab (may need to move the SITE_sessions.txt and gist files to a computer with Matlab) |
| - | * Make sure '''FastICA''' is installed. | + | * Make sure **FastICA** is installed. |
| - | * In Matlab command line type '''x = loadData('GistDirectory','SITE_sessions.txt');''' | + | * In Matlab command line type **x = loadData('GistDirectory','SITE_sessions.txt');** |
| - | * fasticag : to load up the fastICA gui | + | * fasticag : to load up the fastICA gui |
| - | * '''Load data''' type variable '''x''' | + | * **Load data** type variable **x** |
| - | * '''Reduce dim.''' for reduce dimension to 80 (as per PAMI07 paper) | + | * **Reduce dim.** for reduce dimension to 80 (as per PAMI07 paper) |
| - | * '''Do ICA''' | + | * **Do ICA** |
| - | * '''Save results''' with '''_SITE''' extension | + | * **Save results** with **_SITE** extension |
| - | * '''Quit''' to close the FastICA gui | + | * **Quit** to close the FastICA gui |
| - | * In Matlab command line type: '''d = saveFile('GistDirectory/SITE.evec', transpose(W_SITE));''' for the dimension reduction matrix | + | * In Matlab command line type: **d = saveFile('GistDirectory/SITE.evec', transpose(W_SITE));** for the dimension reduction matrix |
| - | * move the '''SITE.evec''' file back to the '''SITE/gistTrain''' folder in the robot | + | * move the **SITE.evec** file back to the **SITE/gistTrain** folder in the robot |
| - | * Train the neural Networks: | + | * Train the neural Networks: |
| - | * Setup the SITE_GIST_train.txt | + | * Setup the SITE_GIST_train.txt |
| - | * setup the SITE_gistList.txt | + | * setup the SITE_gistList.txt |
| - | * run bin/train-FFN SITE_GIST_train.txt | + | * run bin/train-FFN SITE_GIST_train.txt |
| In the end we have the following files in the same environment SITE folder (for example we have ACB, AnFpark, FDFpark for the PAMI 2007 paper): | In the end we have the following files in the same environment SITE folder (for example we have ACB, AnFpark, FDFpark for the PAMI 2007 paper): | ||
| - | * '''SITE.env''' environment file | + | * **SITE.env** environment file |
| - | * '''SITE_GIST_train.txt''' gist training sessions files | + | * **SITE_GIST_train.txt** gist training sessions files |
| - | * '''SITE_sessions.txt''' landmark training sessions files | + | * **SITE_sessions.txt** landmark training sessions files |
| - | * '''SITE.tmap''' topological map file | + | * **SITE.tmap** topological map file |
| - | * sub-folder '''SITE/gist''': *.gist files | + | * sub-folder **SITE/gist**: *.gist files |
| - | * sub-folder '''SITE/gistTrain''': all the gist (segment estimation) training files | + | * sub-folder **SITE/gistTrain**: all the gist (segment estimation) training files |
| - | * sub-folder '''SITE/frames''': all the input *.png files. This could be put | + | * sub-folder **SITE/frames**: all the input *.png files. This could be put |
| - | * sub-folder '''SITE/LandmarkDB''': *.lmk landmark files and *.png salient region image files (for display purposes) | + | * sub-folder **SITE/LandmarkDB**: *.lmk landmark files and *.png salient region image files (for display purposes) |
| Back to [[Beobot_2.0/System |Software System]] | Back to [[Beobot_2.0/System |Software System]] | ||
