Wiki Documentation Site

User Tools

Site Tools

You are here: Main Page » sift » Batch Processing Overview
sift:batch_processing

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
sift:batch_processing [2026/03/24 15:50] – [Batch Processing Overview] wikisysopsift:batch_processing [2026/06/09 17:44] (current) – [Batch Processing Overview] wikisysop
Line 3: Line 3:
 Batch processing enables rapid processing of large datasets and ensures consistent results across projects, labs, and time. Batch processing enables rapid processing of large datasets and ensures consistent results across projects, labs, and time.
  
-Sift provides two methods to batch processing:+Sift provides two methods of batch processing:
   - the GUI, and manually adding the library and pipelines   - the GUI, and manually adding the library and pipelines
   - the command line   - the command line
Line 12: Line 12:
 ===== V3D Engine ===== ===== V3D Engine =====
  
-Sift runs on Visual3D's engine, and can batch run V3D pipelines across multiple CMZ's concurrently. +Sift runs on Visual3D's engine, and can batch run V3D pipelines across multiple CMZs concurrently. 
  
-**When to use**: Either of these methods may be appropriate for the same applications. Use this tool when needing to batch update in smaller doses, in a single instance, or when just getting started in Sift.+**When to use**: Use the V3D Engine for processing smaller datasets, single-instance runs, or when first getting started with Sift.
  
   * Learn more: [[sift:application:run_v3d_engine_dialog|V3D Engine Dialog]]   * Learn more: [[sift:application:run_v3d_engine_dialog|V3D Engine Dialog]]
-  * Tutorial: [[sift:tutorials:compute_gps_and_gdi#run_v3d_engine_dialog|Compute GPS and GDI tutorial]]: uses the V3D Engine to run scripts on multiple CMZ's at once+  * Tutorial: [[sift:tutorials:compute_gps_and_gdi#run_v3d_engine_dialog|Compute GPS and GDI tutorial]]: uses the V3D Engine to run scripts on multiple CMZs at once
    
 ===== Sift Command Line ===== ===== Sift Command Line =====
Line 23: Line 23:
 The Sift command line enables large scale batch processing right from the command line. The Sift command line enables large scale batch processing right from the command line.
  
-**When to use**: Use this option to batch update large quantities of data, or batch updating continuously over time, or for those with experience in development.+**When to use**: Use the Sift Command Line to process large quantities of data, to run continuous automated updates over time, or, for those with experience in development.
  
   * Learn more: [[sift:command_line|Sift command line]]   * Learn more: [[sift:command_line|Sift command line]]
Line 31: Line 31:
 Set up automatic processes to run at specific times. Set up automatic processes to run at specific times.
  
-**When to use**: Use this method for continuous processing on a daily, weekly, or monthly bases.+**When to use**: Use this method for continuous processing on a daily, weekly, or monthly basis.
  
   * Learn more:   * Learn more:
Line 38: Line 38:
 ==== Directory Watchers ==== ==== Directory Watchers ====
  
-Set up automatic processes to run when new data enters a specific directory. +**When to use**: Use this method for automated processing when new data enters a specific directory.
- +
-**When to use**: Use this method for automated processing when new data is added.+
  
   * Learn more: [[sift:directory_watchers|Directory Watchers]]   * Learn more: [[sift:directory_watchers|Directory Watchers]]
   * Tutorial: [[sift:tutorials:using_directory_watchers|Directory Watchers Tutorial]]   * Tutorial: [[sift:tutorials:using_directory_watchers|Directory Watchers Tutorial]]
  
sift/batch_processing.1774367407.txt.gz · Last modified: by wikisysop