User Tools

Site Tools


sift:batch_processing

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
sift:batch_processing [2026/03/24 15:47] – [Batch Processing Overview] wikisysopsift:batch_processing [2026/06/09 17:44] (current) – [Batch Processing Overview] wikisysop
Line 1: Line 1:
 ====== Batch Processing Overview ====== ====== Batch Processing Overview ======
  
-Batch processing is great for quickly processing large datasetsand ensuring consistent results across projects, labs, and time.+Batch processing enables rapid processing of large datasets and ensures consistent results across projects, labs, and time.
  
-There are two methods to batch processing in Sift. Using:+Sift provides two methods of batch processing:
   - the GUI, and manually adding the library and pipelines   - the GUI, and manually adding the library and pipelines
   - the command line   - the command line
-  -   * As a one off +      * As a one off 
-    * Time-based automation +      * Time-based automation 
-    * Directory scanning for new data automation+      * Directory scanning for new data automation
  
 ===== V3D Engine ===== ===== V3D Engine =====
  
-Sift runs on Visual3D's engine, and can batch run V3D pipelines across multiple CMZ'concurrently. +Sift runs on Visual3D's engine, and can batch run V3D pipelines across multiple CMZs concurrently. 
  
-**When to use**: Either of these methods may be appropriate for the same applications. Use this tool when needing to batch update in smaller dosesin a single instance, or when just getting started in Sift.+**When to use**: Use the V3D Engine for processing smaller datasets, single-instance runs, or when first getting started with Sift.
  
   * Learn more: [[sift:application:run_v3d_engine_dialog|V3D Engine Dialog]]   * Learn more: [[sift:application:run_v3d_engine_dialog|V3D Engine Dialog]]
-  * Tutorial: [[sift:tutorials:compute_gps_and_gdi#run_v3d_engine_dialog|Compute GPS and GDI tutorial]]: uses the V3D Engine to run scripts on multiple CMZ'at once+  * Tutorial: [[sift:tutorials:compute_gps_and_gdi#run_v3d_engine_dialog|Compute GPS and GDI tutorial]]: uses the V3D Engine to run scripts on multiple CMZs at once
    
 ===== Sift Command Line ===== ===== Sift Command Line =====
Line 23: Line 23:
 The Sift command line enables large scale batch processing right from the command line. The Sift command line enables large scale batch processing right from the command line.
  
-**When to use**: Use this option to batch update large quantities of data, or batch updating continuously over time, or for those with experience in development.+**When to use**: Use the Sift Command Line to process large quantities of data, to run continuous automated updates over time, orfor those with experience in development.
  
   * Learn more: [[sift:command_line|Sift command line]]   * Learn more: [[sift:command_line|Sift command line]]
Line 31: Line 31:
 Set up automatic processes to run at specific times. Set up automatic processes to run at specific times.
  
-**When to use**: Use this method for continuous processing on a daily, weekly, or monthly bases.+**When to use**: Use this method for continuous processing on a daily, weekly, or monthly basis.
  
   * Learn more:   * Learn more:
Line 38: Line 38:
 ==== Directory Watchers ==== ==== Directory Watchers ====
  
-Set up automatic processes to run when new data enters a specific directory. +**When to use**: Use this method for automated processing when new data enters a specific directory.
- +
-**When to use**: Use this method for automated processing when new data is added.+
  
   * Learn more: [[sift:directory_watchers|Directory Watchers]]   * Learn more: [[sift:directory_watchers|Directory Watchers]]
   * Tutorial: [[sift:tutorials:using_directory_watchers|Directory Watchers Tutorial]]   * Tutorial: [[sift:tutorials:using_directory_watchers|Directory Watchers Tutorial]]
  
sift/batch_processing.1774367251.txt.gz · Last modified: by wikisysop