User Tools

Site Tools


code:work:lvisf:2024:field_processing:start

Field Processing

Loaner Mac setup

ESD

  • XCode and select-xcode: Install with the IT person, you will need an admin password.
  • Google Earth: Install from website.

Homebrew

;download xcode - needs esd (they can remote in to your computer)
 
;command line tools:
xcode-select --install
 
;do a non sudo homebrew:
git clone --depth=1 https://github.com/Homebrew/brew ~/.brew

vi ~/.bashrc
export PATH="$HOME/.brew/bin:$HOME/.brew/sbin:$PATH"
 
source ~/.bashrc
 
cd
brew doctor
;shoudl do something
 
;test:
brew install ghostscript
brew install imagemagick
brew install md5deep
brew install wget
brew install exiftool
brew install rsync
brew install gmt
brew install hdf5
brew install gdal

Do gdal last, it takes a while.

690 IDL

Python setup

$ pip3 install --user scipy
$ pip3 install --user matplotlib

Pull down code and test data

cd ~
rsync -vaP [your username]@[mrlvis]:/Volumes/XSan4/workspace/sarah/field_tools .
rsync -vaP [your username]@[mrlvis]:/Volumes/XSan4/workspace/sarah/field_test_data .

vi ~/field_tools/rtp_kmz/tiff2kml.py
; edit the first line to...
#![your home dir]/.brew/bin/python3.11

Local compilation of the necessary binaries

cd ~/field_tools/rtp/rtp_lvisf2ql2
make clean
make

Setup for processing

Make a binary directory to put all the executables in and put it in your path. Symlink all the necessary executables into it.

mkdir ~/bin
vi ~/.bashrc
export PATH="$HOME/bin:$HOME/.brew/bin:$HOME/.brew/sbin:$PATH"
 
source ~/.bashrc

cd ~/bin
ln -s ~/field_tools/vegas .
ln -s ~/field_tools/interpolate_dlrdem .
ln -s ~/field_tools/rtp/rtp_navd/rtp_rawpos2attntraj .
ln -s ~/field_tools/rtp/rtp_lvisf2ql2/rtp_lvisf2ql2 .
ln -s ~/field_tools/rtp/rtp_lvisf2ql2/rtp_ql2vegas .
ln -s ~/field_tools/rtp/rtp_lvisf2ql2/rtp_ql2filter .
ln -s ~/field_tools/rtp_kmz/tiff2kml.py

Let's test!

Quicklook coverage maps

Edit the end of the 610i config file in ~/field_tools/local/config_610i.cfg to:

nano ~/field_tools/local/config_610i.cfg
sourcedir   /Users/sastory/field_test_data
demdir      /Users/sastory/field_test_data/dlr_90mdem/DEM
aircraft    GLF3_N520NA
suffix      .dat
smoothwidth 2.5
threshold   3.0
elev_cpt    /Users/sastory/field_tools/local/elev.cpt
height_cpt  /Users/sastory/field_tools/local/rh100.cpt
energy_cpt  /Users/sastory/field_tools/local/energy.cpt
dem_cut     150.0
energy_cut  1000.0
grid_res    10
imu        610i
geolocation_only
obs_bias                 -208.232 0
time_tag_bias_roll_to_obs  -0.0007 0
time_tag_bias_pitch_to_obs -0.0016 0
roll_pitch_alignment_z    90.0000000000000000 0.0
scan_angle_roll_scale      -1.007488 0
scan_angle_pitch_scale      1 0
instrument_roll_bias        1.735 0
instrument_pitch_bias       0.354 0
instrument_yaw_bias         0.10442 0
fiber_speed_factor 1.0
use_channel_a
use_channel_b
use_channel_c
use_range_frrx

measurements_per_batch 30000

disable_gphyscorr_all

timeseries_pad       10.0000000000000000


####

sourcedir   /mnt/archive/mjd
demdir      /home/lvis/field_test_data/dlr_90mdem/DEM
aircraft    P3_NASA426
suffix      .dat
smoothwidth 2.5
threshold   3.0
elev_cpt    /home/lvis/field_tools/local/elev_ice.cpt
height_cpt  /home/lvis/field_tools/local/rh100.cpt
energy_cpt  /home/lvis/field_tools/local/energy.cpt
dem_cut     150.0
energy_cut  1000.0
grid_res    10
imu         610i

Make a proc directory:

cd ~
mkdir -p proc/lvisf/60454
cd proc/lvisf/60454

Run the script:

time ~/field_tools/local/rtp_local_proc.sh ~/field_tools/local/config_610i_arcsix2024.cfg 60460

If you need to clean the directory to rerun with new parameters:

~/field_tools/local/clean.sh all

At this point everything should happen without any required input from you. When it finishes, you should have the following files in your directory:

LVISF60083_Field_Elevation.kmz
LVISF60083_Field_Energy.kmz
LVISF60083_Field_Height.kmz
Camera preview kmzs
mkdir /Users/sastory/proc/lvisf/60083/camera
cd /Users/sastory/field_tools/camera_kmz

vi config.cfg
; edit appropriately with your links

./ExifGPS_Python_Final_Phase1_Preview.py config.cfg
ls /Users/sastory/proc/lvisf/60083/camera
   GB2023_P1_Preview_SF01_60083.kmz
   OLVIS0_CAM150MP_2023-05-19.txt
Mission meta
cd /Users/sastory/field_tools/mission_meta

vi GB2023.cfg
; edit appropriately

vi make_mission_data_summary.py
; edit the top line to point it at your /Users/[you]/.brew/bin/python3.11 dir

./make_mission_data_summary.py GB2023.cfg
code/work/lvisf/2024/field_processing/start.txt · Last modified: 2024/05/31 13:36 by david