code:work:lvisf:2024:field_processing:start
Table of Contents
Field Processing
Loaner Mac setup
ESD
- XCode and select-xcode: Install with the IT person, you will need an admin password.
- Google Earth: Install from website.
Homebrew
;download xcode - needs esd (they can remote in to your computer) ;command line tools: xcode-select --install ;do a non sudo homebrew: git clone --depth=1 https://github.com/Homebrew/brew ~/.brew vi ~/.bashrc export PATH="$HOME/.brew/bin:$HOME/.brew/sbin:$PATH" source ~/.bashrc cd brew doctor ;shoudl do something ;test: brew install ghostscript brew install imagemagick brew install md5deep brew install wget brew install exiftool brew install rsync brew install gmt brew install hdf5 brew install gdal
Do gdal last, it takes a while.
690 IDL
Python setup
$ pip3 install --user scipy $ pip3 install --user matplotlib
Pull down code and test data
cd ~ rsync -vaP [your username]@[mrlvis]:/Volumes/XSan4/workspace/sarah/field_tools . rsync -vaP [your username]@[mrlvis]:/Volumes/XSan4/workspace/sarah/field_test_data . vi ~/field_tools/rtp_kmz/tiff2kml.py ; edit the first line to... #![your home dir]/.brew/bin/python3.11
Local compilation of the necessary binaries
cd ~/field_tools/rtp/rtp_lvisf2ql2 make clean make
Setup for processing
Make a binary directory to put all the executables in and put it in your path. Symlink all the necessary executables into it.
mkdir ~/bin vi ~/.bashrc export PATH="$HOME/bin:$HOME/.brew/bin:$HOME/.brew/sbin:$PATH" source ~/.bashrc cd ~/bin ln -s ~/field_tools/vegas . ln -s ~/field_tools/interpolate_dlrdem . ln -s ~/field_tools/rtp/rtp_navd/rtp_rawpos2attntraj . ln -s ~/field_tools/rtp/rtp_lvisf2ql2/rtp_lvisf2ql2 . ln -s ~/field_tools/rtp/rtp_lvisf2ql2/rtp_ql2vegas . ln -s ~/field_tools/rtp/rtp_lvisf2ql2/rtp_ql2filter . ln -s ~/field_tools/rtp_kmz/tiff2kml.py
Let's test!
Quicklook coverage maps
Edit the end of the 610i config file in ~/field_tools/local/config_610i.cfg to:
nano ~/field_tools/local/config_610i.cfg
sourcedir /Users/sastory/field_test_data demdir /Users/sastory/field_test_data/dlr_90mdem/DEM aircraft GLF3_N520NA suffix .dat smoothwidth 2.5 threshold 3.0 elev_cpt /Users/sastory/field_tools/local/elev.cpt height_cpt /Users/sastory/field_tools/local/rh100.cpt energy_cpt /Users/sastory/field_tools/local/energy.cpt dem_cut 150.0 energy_cut 1000.0 grid_res 10 imu 610i
geolocation_only obs_bias -208.232 0 time_tag_bias_roll_to_obs -0.0007 0 time_tag_bias_pitch_to_obs -0.0016 0 roll_pitch_alignment_z 90.0000000000000000 0.0 scan_angle_roll_scale -1.007488 0 scan_angle_pitch_scale 1 0 instrument_roll_bias 1.735 0 instrument_pitch_bias 0.354 0 instrument_yaw_bias 0.10442 0 fiber_speed_factor 1.0 use_channel_a use_channel_b use_channel_c use_range_frrx measurements_per_batch 30000 disable_gphyscorr_all timeseries_pad 10.0000000000000000 #### sourcedir /mnt/archive/mjd demdir /home/lvis/field_test_data/dlr_90mdem/DEM aircraft P3_NASA426 suffix .dat smoothwidth 2.5 threshold 3.0 elev_cpt /home/lvis/field_tools/local/elev_ice.cpt height_cpt /home/lvis/field_tools/local/rh100.cpt energy_cpt /home/lvis/field_tools/local/energy.cpt dem_cut 150.0 energy_cut 1000.0 grid_res 10 imu 610i
Make a proc directory:
cd ~ mkdir -p proc/lvisf/60454 cd proc/lvisf/60454
Run the script:
time ~/field_tools/local/rtp_local_proc.sh ~/field_tools/local/config_610i_arcsix2024.cfg 60460
If you need to clean the directory to rerun with new parameters:
~/field_tools/local/clean.sh all
At this point everything should happen without any required input from you. When it finishes, you should have the following files in your directory:
LVISF60083_Field_Elevation.kmz LVISF60083_Field_Energy.kmz LVISF60083_Field_Height.kmz
Camera preview kmzs
mkdir /Users/sastory/proc/lvisf/60083/camera cd /Users/sastory/field_tools/camera_kmz vi config.cfg ; edit appropriately with your links ./ExifGPS_Python_Final_Phase1_Preview.py config.cfg ls /Users/sastory/proc/lvisf/60083/camera GB2023_P1_Preview_SF01_60083.kmz OLVIS0_CAM150MP_2023-05-19.txt
Mission meta
cd /Users/sastory/field_tools/mission_meta vi GB2023.cfg ; edit appropriately vi make_mission_data_summary.py ; edit the top line to point it at your /Users/[you]/.brew/bin/python3.11 dir ./make_mission_data_summary.py GB2023.cfg
code/work/lvisf/2024/field_processing/start.txt · Last modified: 2024/05/31 13:36 by david