Differences

This shows you the differences between two versions of the page.

--- computers:tricksandtips [2024/05/10 17:48] – [Windoze] david
+++ computers:tricksandtips [2026/03/13 16:43] (current) – [rclone] david
@@ Line 194: / Line 194: @@
 user    0m29.380s
 sys     33m49.240s
+</code>
+==== Using tar Compress ====
+=== Specific File Types ===
+<code>
+find /path/to/directory -type f -name "*.extension" -print0 | tar -cvf archive_name.tar --null -T -
+</code>
+Add compression
+<code>
+find /path/to/directory -type f -name "*.txt" -print0 | tar -cv --null -T - | pigz --best > archive_name.tar.gz
 </code>
 ====== BIOS Upgrade ======
@@ Line 327: / Line 342: @@
 ====== Networking ======
+===== Copy Very Large Disk =====
+  - Rsync with resume-ability <code>
+sudo rsync -aHAXx --numeric-ids --info=progress2 --partial --partial-dir=.rsync-partial --append-verify --rsync-path="sudo rsync" /Volumes/raid/ user@remote-host:/Volumes/raidcopy/
+</code>
+  - Check after done with this <code>
+sudo rsync -aHAXx --numeric-ids --checksum --dry-run --itemize-changes --rsync-path="sudo rsync" /Volumes/raid/ user@remote-host:/Volumes/raidcopy/
+</code>
+Do not do this, if the transfer is interrupted, you start all over again, but this DOES work.
+<code>
+) run some generic command to authorize sudo remotely (pre-auth sudo)
+ssh -t username@remotesystem "sudo -v"
+) then this script will run sudo on your side and remote side
+time sudo ssh username@remotesystem "sudo tar -cpf - /remote/dir/to/copy | /PATH/TO/pigz --processes 16" | pigz -d | sudo tar -xpf - -C /destination/dir
+</code>
+===== Directory Sync with Unison =====
+  - Install on both machines<code>
+sudo apt install unison
+</code>
+  - Set up Passwordless SSH <code>
+ssh-keygen -t rsa -b 4096
+ssh-copy-id user@remote_host
+</code>
+  - Command to sync directories <code>
+unison /home/user/local_dir/ ssh://user@remote_host//home/user/remote_dir/
+</code>
+  - Creating a Sync Profile <code>
+# Root directories to sync
+root = /home/user/my_code
+root = ssh://user@remote_host//home/user/my_code
+# Automatic settings
+auto = true      # Skip prompts for non-conflicting changes
+batch = true     # Do not ask any questions at all
+times = true     # Preserve modification times
+# Paths to ignore (supports globs)
+ignore = Name {.git,node_modules,*.tmp}
+ignore = Path build
+</code>
+===== rclone =====
+If you want to avoid ssh/encryption (say you are moving many terabytes over 10GBe) to keep from slowing down your network.  You can use **rclone**
+**Server Side:**
+  - Start the server and use a non-standard port (using sudo to dig down into permissions of all files)<code>
+sudo /your/local/path/bin/rclone serve http /Directory/to/share --addr :8080
+</code>
+**Client Side:**
+  - **HDD - Spinny Disks on Both Sides**
+    - Use only 4 transfers at a time to keep heads from trashing <code>
+sudo rclone sync RCLONE_CONFIG: /destination/directory \
+    --metadata \
+    --skip-links \
+    --transfers 4 \
+    --checkers 4 \
+    --buffer-size 256M \
+    --multi-thread-streams 4 \
+    --log-file /somedir/log_file.log \
+    --log-level INFO \
+    -P
+</code>
+  - **SSD - Solid State Drive to Solid State Drive**
+    - To pull using SSD many transfers at once are fine: <code>
+sudo rclone sync RCLONE_CONFIG: /destination/directory \
+    --metadata \
+    --skip-links \
+    --transfers 16 \
+    --checkers 32 \
+    --buffer-size 256M \
+    --multi-thread-streams 8 \
+    --log-file /somedir/log_file.log \
+    --log-level INFO \
+    -P
+</code>
 ===== rsync limiting bandwidth =====
@@ Line 372: / Line 468: @@
 </code>
+===== rsync Windoze Files =====
+You need to expand the time stamp difference for Windoze to not re-copy everything;
+<code>
+# always have vP for verbose and progress
+rsync --modify-window=5 -vPrltD NORMAL THING
+# NO LUCK for me like this, but adding this does only check file size
+rsync --size-only -vaP FROM/ TO/
+# try this
+rsync --size-only -vPrltD # OR remove -t
+# doing this on windows backup drive:
+rsync --size-only -vPrlD
+</code>
 ===== sshd Piping =====
@@ Line 696: / Line 808: @@
 # pipe to less if you want to page up / page down have a look (and reverse to so newest at top) q to exit less
 find /pool/media/video/hd -xdev -type f -exec stat --format="%Y %n" {} \; | sort -k 1,1nr | less
+# AI suggested this for nice file formatting 2025
+# Alternative using printf for better formatting
+find /path/to/search -type f -printf '%T+ %p\n' | sort -r | head -10
 </code>
+==== Find and Copy Files Between Two Dates ====
+Use **newermt** switch to **find** and copy files that are human readable times / dates from one place to another.
+<code>
+find /Volumes/6608 -newermt "2024-11-01 00:00:00" ! -newermt "2024-12-01 00:00:00" -exec cp -a "{}" .  \;
+</code>
 ==== Sort Text File By Second Column ====
@@ Line 979: / Line 1106: @@
 After upgrading from 10.04 to 11.04, grub2 got broken.  Found the answer quickly here:  [[http://www.webupd8.org/2010/05/fix-symbol-grubputs-not-found-when.html]]
+==== Grub Boot Parameters ====
+  - mount your partition to /mnt (assuming /dev/sda5 is the drive) <code>
+sudo mount /dev/sda5 /mnt
+</code>
+  - Then mount a few more directories that are needed <code>
+sudo mount --bind /dev /mnt/dev
+sudo mount --bind /sys /mnt/sys
+sudo mount --bind /proc /mnt/proc
+</code>
+  - Also, if you have a separate Ubuntu boot partition (pretty uncommon these days, but it may be the case) <code>
+sudo mount /dev/sdaX /mnt/boot
+</code>
+  - make your /root drive /mnt <code>
+sudo chroot /mnt
+</code>
+  - make any changes to etc/default/grub <code>
+sudo nano /etc/default/grub
+</code>
+  - run update grub (already chroot, when i tried sudo it gave me some lookup error) <code>
+update-grub
+</code>
+  - exit
+  - check that /etc/grub/grub.cfg is updated (recent file time)
+  - reboot
+  - profit
 ==== KDE ====