User Tools

Site Tools


sift:batch_processing

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
sift:batch_processing [2026/03/24 15:52] – [Time-Based Triggers] wikisysopsift:batch_processing [2026/06/09 17:44] (current) – [Batch Processing Overview] wikisysop
Line 3: Line 3:
 Batch processing enables rapid processing of large datasets and ensures consistent results across projects, labs, and time. Batch processing enables rapid processing of large datasets and ensures consistent results across projects, labs, and time.
  
-Sift provides two methods to batch processing:+Sift provides two methods of batch processing:
   - the GUI, and manually adding the library and pipelines   - the GUI, and manually adding the library and pipelines
   - the command line   - the command line
Line 12: Line 12:
 ===== V3D Engine ===== ===== V3D Engine =====
  
-Sift runs on Visual3D's engine, and can batch run V3D pipelines across multiple CMZ'concurrently. +Sift runs on Visual3D's engine, and can batch run V3D pipelines across multiple CMZs concurrently. 
  
 **When to use**: Use the V3D Engine for processing smaller datasets, single-instance runs, or when first getting started with Sift. **When to use**: Use the V3D Engine for processing smaller datasets, single-instance runs, or when first getting started with Sift.
  
   * Learn more: [[sift:application:run_v3d_engine_dialog|V3D Engine Dialog]]   * Learn more: [[sift:application:run_v3d_engine_dialog|V3D Engine Dialog]]
-  * Tutorial: [[sift:tutorials:compute_gps_and_gdi#run_v3d_engine_dialog|Compute GPS and GDI tutorial]]: uses the V3D Engine to run scripts on multiple CMZ'at once+  * Tutorial: [[sift:tutorials:compute_gps_and_gdi#run_v3d_engine_dialog|Compute GPS and GDI tutorial]]: uses the V3D Engine to run scripts on multiple CMZs at once
    
 ===== Sift Command Line ===== ===== Sift Command Line =====
Line 38: Line 38:
 ==== Directory Watchers ==== ==== Directory Watchers ====
  
-Set up automatic processes to run when new data enters a specific directory. +**When to use**: Use this method for automated processing when new data enters a specific directory.
- +
-**When to use**: Use this method for automated processing when new data is added.+
  
   * Learn more: [[sift:directory_watchers|Directory Watchers]]   * Learn more: [[sift:directory_watchers|Directory Watchers]]
   * Tutorial: [[sift:tutorials:using_directory_watchers|Directory Watchers Tutorial]]   * Tutorial: [[sift:tutorials:using_directory_watchers|Directory Watchers Tutorial]]
  
sift/batch_processing.1774367534.txt.gz · Last modified: by wikisysop