david.rabine

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== Field Processing ======

  * [[code:work:lvisf:2024:field_processing:arcsix:start|ARCSIX Field Processing]]

====== Loaner Mac setup ======
=== ESD ===
  * XCode and select-xcode: Install with the IT person, you will need an admin password.
  * Google Earth: Install from website.
=== Homebrew ===
<code>
;download xcode - needs esd (they can remote in to your computer)
 
;command line tools:
xcode-select --install
 
;do a non sudo homebrew:
git clone --depth=1 https://github.com/Homebrew/brew ~/.brew

vi ~/.bashrc
export PATH="$HOME/.brew/bin:$HOME/.brew/sbin:$PATH"
 
source ~/.bashrc
 
cd
brew doctor
;shoudl do something
 
;test:
brew install ghostscript
brew install imagemagick
brew install md5deep
brew install wget
brew install exiftool
brew install rsync
brew install gmt
brew install hdf5
brew install gdal
</code>
Do gdal last, it takes a while.

===690 IDL ===
https://sys690.gsfc.nasa.gov/system/idlsoft.html

=== Python setup ===
<code>
$ pip3 install --user scipy
$ pip3 install --user matplotlib
</code>

=== Pull down code and test data ===
<code>
cd ~
rsync -vaP [your username]@[mrlvis]:/Volumes/XSan4/workspace/sarah/field_tools .
rsync -vaP [your username]@[mrlvis]:/Volumes/XSan4/workspace/sarah/field_test_data .

vi ~/field_tools/rtp_kmz/tiff2kml.py
; edit the first line to...
#![your home dir]/.brew/bin/python3.11
</code>

=== Local compilation of the necessary binaries ===
<code>
cd ~/field_tools/rtp/rtp_lvisf2ql2
make clean
make
</code>

=== Setup for processing ===
Make a binary directory to put all the executables in and put it in your path. Symlink all the necessary executables into it.
<code>
mkdir ~/bin
vi ~/.bashrc
export PATH="$HOME/bin:$HOME/.brew/bin:$HOME/.brew/sbin:$PATH"
 
source ~/.bashrc

cd ~/bin
ln -s ~/field_tools/vegas .
ln -s ~/field_tools/interpolate_dlrdem .
ln -s ~/field_tools/rtp/rtp_navd/rtp_rawpos2attntraj .
ln -s ~/field_tools/rtp/rtp_lvisf2ql2/rtp_lvisf2ql2 .
ln -s ~/field_tools/rtp/rtp_lvisf2ql2/rtp_ql2vegas .
ln -s ~/field_tools/rtp/rtp_lvisf2ql2/rtp_ql2filter .
ln -s ~/field_tools/rtp_kmz/tiff2kml.py
</code>

==== Let's test! ====

== Quicklook coverage maps ==
Edit the end of the 610i config file in **~/field_tools/local/config_610i.cfg** to:
<code>
nano ~/field_tools/local/config_610i.cfg
</code>

<code>
sourcedir   /Users/sastory/field_test_data
demdir      /Users/sastory/field_test_data/dlr_90mdem/DEM
aircraft    GLF3_N520NA
suffix      .dat
smoothwidth 2.5
threshold   3.0
elev_cpt    /Users/sastory/field_tools/local/elev.cpt
height_cpt  /Users/sastory/field_tools/local/rh100.cpt
energy_cpt  /Users/sastory/field_tools/local/energy.cpt
dem_cut     150.0
energy_cut  1000.0
grid_res    10
imu        610i
</code>

<code>
geolocation_only
obs_bias                 -208.232 0
time_tag_bias_roll_to_obs  -0.0007 0
time_tag_bias_pitch_to_obs -0.0016 0
roll_pitch_alignment_z    90.0000000000000000 0.0
scan_angle_roll_scale      -1.007488 0
scan_angle_pitch_scale      1 0
instrument_roll_bias        1.735 0
instrument_pitch_bias       0.354 0
instrument_yaw_bias         0.10442 0
fiber_speed_factor 1.0
use_channel_a
use_channel_b
use_channel_c
use_range_frrx

measurements_per_batch 30000

disable_gphyscorr_all

timeseries_pad       10.0000000000000000


####

sourcedir   /mnt/archive/mjd
demdir      /home/lvis/field_test_data/dlr_90mdem/DEM
aircraft    P3_NASA426
suffix      .dat
smoothwidth 2.5
threshold   3.0
elev_cpt    /home/lvis/field_tools/local/elev_ice.cpt
height_cpt  /home/lvis/field_tools/local/rh100.cpt
energy_cpt  /home/lvis/field_tools/local/energy.cpt
dem_cut     150.0
energy_cut  1000.0
grid_res    10
imu         610i
</code>

Make a proc directory:
<code>
cd ~
mkdir -p proc/lvisf/60454
cd proc/lvisf/60454
</code>

Run the script:
<code>
time ~/field_tools/local/rtp_local_proc.sh ~/field_tools/local/config_610i_arcsix2024.cfg 60460
</code>

If you need to clean the directory to rerun with new parameters:
<code>
~/field_tools/local/clean.sh all
</code>

At this point everything should happen without any required input from you. When it finishes, you should have the following files in your directory:
<code>
LVISF60083_Field_Elevation.kmz
LVISF60083_Field_Energy.kmz
LVISF60083_Field_Height.kmz
</code>

== Camera preview kmzs ==
<code>
mkdir /Users/sastory/proc/lvisf/60083/camera
cd /Users/sastory/field_tools/camera_kmz

vi config.cfg
; edit appropriately with your links

./ExifGPS_Python_Final_Phase1_Preview.py config.cfg
ls /Users/sastory/proc/lvisf/60083/camera
   GB2023_P1_Preview_SF01_60083.kmz
   OLVIS0_CAM150MP_2023-05-19.txt
</code>

== Mission meta ==
<code>
cd /Users/sastory/field_tools/mission_meta

vi GB2023.cfg
; edit appropriately

vi make_mission_data_summary.py
; edit the top line to point it at your /Users/[you]/.brew/bin/python3.11 dir

./make_mission_data_summary.py GB2023.cfg
</code>