HAS-Motion Software Documentation

User Tools

Site Tools

You are here: Main Page » other » inspect3d » tutorials » Clean your Data
other:inspect3d:tutorials:clean_your_data

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
other:inspect3d:tutorials:clean_your_data [2025/01/16 19:05] – wikisysopother:inspect3d:tutorials:clean_your_data [2025/01/16 19:33] (current) – wikisysop
Line 9: Line 9:
 These data files can be downloaded using this link: [[https://www.has-motion.com/download/examples/FourSubjectsWalkingData.zip|Four Subjects Walking Data Set]]. These data files can be downloaded using this link: [[https://www.has-motion.com/download/examples/FourSubjectsWalkingData.zip|Four Subjects Walking Data Set]].
 {{ :Inspect3D_Four_Subjects_Loaded.png?350}} {{ :Inspect3D_Four_Subjects_Loaded.png?350}}
 +
 +
 ==== Loading the library ==== ==== Loading the library ====
  
Line 24: Line 26:
  
  
 +\\
 +\\
  
 ==== Defining queries and calculating groups ==== ==== Defining queries and calculating groups ====
Line 29: Line 33:
 1. Click on the {{:I3DGroups.png?20}} **Query Definitions** icon on the [[Other:Inspect3D:Documentation:Dialogs:ToolBar|toolbar]] and then click on {{:I3DGroups.png?20}} **Query Definitions** to open the Query Builder dialog. 1. Click on the {{:I3DGroups.png?20}} **Query Definitions** icon on the [[Other:Inspect3D:Documentation:Dialogs:ToolBar|toolbar]] and then click on {{:I3DGroups.png?20}} **Query Definitions** to open the Query Builder dialog.
  
-2. To create a new query definition, click the {{:ActionAdd48x48.png}} green addition button in the empty **Queries** list.+2. To create a new query definition, click the {{:ActionAdd48x48.png?20}} green addition button in the empty **Queries** list.
  
 2.1. Type GRF in the **Query Name** text box in top-right and click **Save**. 2.1. Type GRF in the **Query Name** text box in top-right and click **Save**.
  
-{{:Inspect3D_Creating_Query_(Four_Subjects_Walking).png}}+{{:inspect3d_creating_query_four_subjects_walking.png}}
  
-3. While the GRF query is selected, click the {{:ActionAdd48x48.png}} green addition button in the empty **Conditions** list.+3. While the GRF query is selected, click the {{:ActionAdd48x48.png?20}} green addition button in the empty **Conditions** list.
  
 3.1. Type R_GRF in the **Condition Name** text box in the top-right. 3.1. Type R_GRF in the **Condition Name** text box in the top-right.
Line 43: Line 47:
 3.2.1. **Signals**: This tab allows the user to select specific signals according to their names in the [[Visual3D:Documentation:Visual3D_Signal_Types:Data_Tree_Summary_|Visual3D Data Tree]]. For this tutorial, select the signal: TYPE - LINK_MODEL_BASED, FOLDER - ORIGINAL, NAME - R_GRF, and COMPONENT - Z. 3.2.1. **Signals**: This tab allows the user to select specific signals according to their names in the [[Visual3D:Documentation:Visual3D_Signal_Types:Data_Tree_Summary_|Visual3D Data Tree]]. For this tutorial, select the signal: TYPE - LINK_MODEL_BASED, FOLDER - ORIGINAL, NAME - R_GRF, and COMPONENT - Z.
  
-{{:Inspect3D_Signal_Tab_(Four_Subjects_Walking).png}}+{{:Inspect3D_Signal_Tab_four_subjects_walking.png}}
  
 3.2.2. **Events**: This tab allows the user to specify the desired event sequence to extract data from. For instance, the right gait cycle could be extracted using the event sequences RON, ROFF or RHS, RHS. For this tutorial select the RON and ROFF events and leave the default normalization values of 101 for the number of points and cubic for the spline type. 3.2.2. **Events**: This tab allows the user to specify the desired event sequence to extract data from. For instance, the right gait cycle could be extracted using the event sequences RON, ROFF or RHS, RHS. For this tutorial select the RON and ROFF events and leave the default normalization values of 101 for the number of points and cubic for the spline type.
  
-{{:Inspect3D_Events_Tab_(Four_Subjects_Walking).png}}+{{:Inspect3D_Events_Tab_Four_Subjects_Walking.png}}
  
 3.2.3. **Refinements**: This tab allows the user to refine their selected signal using two separate and distinct methods: according to the signals contained within the [[Visual3D:Documentation:Definitions:File_Formats:CMO_Format|CMO files]], or according to Tags. For this tutorial, Refine using tags by leaving the **Use AND Logic** checkbox unchecked and selecting the SLOW, NORMAL, and FAST tags. 3.2.3. **Refinements**: This tab allows the user to refine their selected signal using two separate and distinct methods: according to the signals contained within the [[Visual3D:Documentation:Definitions:File_Formats:CMO_Format|CMO files]], or according to Tags. For this tutorial, Refine using tags by leaving the **Use AND Logic** checkbox unchecked and selecting the SLOW, NORMAL, and FAST tags.
  
-{{:Inspect3D_Refinement_Tab_(Four_Subjects_Walking).png}}+{{:Inspect3D_Refinement_Tab_Four_Subjects_Walking.png}}
  
 3.3. Click **Save** to create the condition. 3.3. Click **Save** to create the condition.
Line 57: Line 61:
 4. For this tutorial, define a second condition within the same group to account for the left side. This can be done by modifying the existing sub-group: 4. For this tutorial, define a second condition within the same group to account for the left side. This can be done by modifying the existing sub-group:
  
-4.1. While the GRF group is selected, click the {{:ActionAdd48x48.png}} green addition button in the **Sub-Groups** list and type L_GRF in the **Sub-Group Name** text box.+4.1. While the GRF group is selected, click the {{:ActionAdd48x48.png?20}} green addition button in the **Sub-Groups** list and type L_GRF in the **Sub-Group Name** text box.
  
 4.1.1. In the Signals tab, change the NAME to L_GRF and leave the other parameters as they are. 4.1.1. In the Signals tab, change the NAME to L_GRF and leave the other parameters as they are.
Line 67: Line 71:
 4.2. Click **Save** to create this second condition. 4.2. Click **Save** to create this second condition.
  
-{{:Inspect3D_Two_Conditions_(Four_Subjects_Walking).png}}+{{:Inspect3D_Two_Conditions_Four_Subjects_Walking.png}}
  
 You should now see one query (GRF) in the **Queries** list and two conditions (R_GRF and L_GRF) in the **Conditions** list. At this point in the tutorial these definitions have been created but they have not been applied to the signals in the loaded library. To do this, click on **Calculate All Queries** (or **Calculate Selected Queries**, since there is only one group in this tutorial). You should now see one query (GRF) in the **Queries** list and two conditions (R_GRF and L_GRF) in the **Conditions** list. At this point in the tutorial these definitions have been created but they have not been applied to the signals in the loaded library. To do this, click on **Calculate All Queries** (or **Calculate Selected Queries**, since there is only one group in this tutorial).
Line 84: Line 88:
  
  
-3. When Inspect3D tries to plot [[Other:Inspect3D:Documentation:Troubleshooting#Data_Missing_Graph|missing data]], your y-axis will go to -999 999.0 and the axis scale will cause the data to be compressed into lines. To avoid this, open the {{:I3DShowOptions.png}} **[[Other:Inspect3D:Documentation:Dialogs:Load_Library_Dialogue#Plotting_options|Options]]** dialog and deselect the **Show data not found** checkbox in the **Plotting options** section.+3. When Inspect3D tries to plot [[Other:Inspect3D:Documentation:Troubleshooting#Data_Missing_Graph|missing data]], your y-axis will go to -999 999.0 and the axis scale will cause the data to be compressed into lines. To avoid this, open the {{:I3DShowOptions.png?20}} **[[Other:Inspect3D:Documentation:Dialogs:Load_Library_Dialogue#Plotting_options|Options]]** dialog and deselect the **Show data not found** checkbox in the **Plotting options** section.
  
 3.1. Update your plot by clicking **Refresh Plot**; it should now resemble the graph below. 3.1. Update your plot by clicking **Refresh Plot**; it should now resemble the graph below.
  
-{{:Inspect3D_Queried_Data_(Four_Subjects_Walking).png}}+{{:Inspect3D_Queried_Data_Four_Subjects_Walking.png}}
  
  
 4. Use your cursor to select only lines on the graph that you wish to inspect. Click on single traces in order to examine individual curves without the other curves 'polluting' the graph. When a trace is clicked, a tooltip will appear to describe the source of the trace in terms of both Inspect3D's groups and workspaces and the underlying .c3d files. 4. Use your cursor to select only lines on the graph that you wish to inspect. Click on single traces in order to examine individual curves without the other curves 'polluting' the graph. When a trace is clicked, a tooltip will appear to describe the source of the trace in terms of both Inspect3D's groups and workspaces and the underlying .c3d files.
  
-{{:Inspect3D_Select_Trace_(Four_Subjects_Walking).png}}+{{:Inspect3D_Select_Trace_Four_Subjects_Walking.png}}
  
  
Line 109: Line 113:
 3.1 When traces are excluded, two notable differences should appear in the Queried Data subwindow. First, the previously selected, but now excluded data should not be visible on the graph. Second, the **Workspaces** widget will indicate when traces have been excluded. Specifically, an X should replace the original check mark beside each workspace where signal traces have been excluded, two horizontal bars should replace the check mark beside each .c3d file with excluded traces, and a red X should replace the checkmark beside each excluded trace. Additionally, the fraction of traces excluded for each workspace is displayed on the right-hand side of the **Workspaces** widget: in this case all of the workspaces contained poor quality events. If unintentional exclusion occurred for a subject, you can right click on the subject and select 'Re-Include Data'. 3.1 When traces are excluded, two notable differences should appear in the Queried Data subwindow. First, the previously selected, but now excluded data should not be visible on the graph. Second, the **Workspaces** widget will indicate when traces have been excluded. Specifically, an X should replace the original check mark beside each workspace where signal traces have been excluded, two horizontal bars should replace the check mark beside each .c3d file with excluded traces, and a red X should replace the checkmark beside each excluded trace. Additionally, the fraction of traces excluded for each workspace is displayed on the right-hand side of the **Workspaces** widget: in this case all of the workspaces contained poor quality events. If unintentional exclusion occurred for a subject, you can right click on the subject and select 'Re-Include Data'.
  
-{{:Inspect3D_Excluded_Traces_(Four_Subjects_Walking).png}}+{{:Inspect3D_Excluded_Traces_Four_Subjects_Walking.png}}
  
 4. If you want to visualize the data you have excluded alongside the remaining data, go to the [[Other:Inspect3D:Documentation:Dialogs:Load_Library_Dialogue|Show Options]] dialog and select the "Show excluded data" option. You can choose to use a specific line style for excluded data and specify this style in the [[Other:Inspect3D:Documentation:Dialogs:Load_Library_Dialogue#Line_Style|Line Styles]] tab. 4. If you want to visualize the data you have excluded alongside the remaining data, go to the [[Other:Inspect3D:Documentation:Dialogs:Load_Library_Dialogue|Show Options]] dialog and select the "Show excluded data" option. You can choose to use a specific line style for excluded data and specify this style in the [[Other:Inspect3D:Documentation:Dialogs:Load_Library_Dialogue#Line_Style|Line Styles]] tab.
  
-{{:Inspect3D_Excluded_Traces_Shown_(Four_Subjects_Walking).png}}+{{:Inspect3D_Excluded_Traces_Shown_Four_Subjects_Walking.png}}
  
 +{{ :Inspect3D_Animate_Trace_Four_Subjects_Walking.png?350}}
  
-5. +5.Traces can also be examined more closely before deciding to include or exclude them.
-{{:Inspect3D_Animate_Trace_(Four_Subjects_Walking).png}}+
  
-Traces can also be examined more closely before deciding to include or exclude them. 
 5.1 Select the traces of interest by clicking and dragging on the plot. 5.1 Select the traces of interest by clicking and dragging on the plot.
  
-5.2 Click the {{:I3DShowAnimation.png}} **Show Animation** button.+5.2 Click the {{:I3DShowAnimation.png?20}} **Show Animation** button.
  
 5.3 The Show Animation dialog can display animations for those selected traces with enough data in the .cmz file to permit a recreation. Each of the selected traces can be selected from the drop-down box near the top of the dialog. This view can be used to determine what (if any) issue exists in the data and whether this merits exclusions. Excluded traces are removed from the drop-down box within the dialog as well as the Queried Data subwindow. 5.3 The Show Animation dialog can display animations for those selected traces with enough data in the .cmz file to permit a recreation. Each of the selected traces can be selected from the drop-down box near the top of the dialog. This view can be used to determine what (if any) issue exists in the data and whether this merits exclusions. Excluded traces are removed from the drop-down box within the dialog as well as the Queried Data subwindow.
Line 128: Line 131:
 6. Once all of the desired exclusions have been made, the original data is ready to be updated. 6. Once all of the desired exclusions have been made, the original data is ready to be updated.
  
 +\\
 +\\
  
 +\\
 +\\
 ==== Updating the original data ==== ==== Updating the original data ====
 +{{ :Inspect3D_Update_CMZ_Four_Subjects_Walking.png?350}}
 +1.Now that the incorrect force assignments have been identified in our data set, it is possible to update the original [[Visual3D:Documentation:Definitions:CMO_Library_|CMZ]] data by clicking the {{:I3DUpdateCMOsWithBadEvents.png?20}} **UpdateCMZs** item in the application's tool bar. This opens a dialog that provides different options for processing excluded data.
  
-1. 
-{{:Inspect3D_Update_CMZ_(Four_Subjects_Walking).png}} 
- 
-Now that the incorrect force assignments have been identified in our data set, it is possible to update the original [[Visual3D:Documentation:Definitions:CMO_Library_|CMZ]] data by clicking the {{:I3DUpdateCMOsWithBadEvents.png}} **UpdateCMZs** item in the application's tool bar. This opens a dialog that provides different options for processing excluded data. 
 2. The **Excluded Traces** options allow the user to add a BAD event to the excluded traces. This option is helpful if the intention is to [[Visual3D:Documentation:Definitions:Tag|tag]] the bad data, re-open the original data, and make manual corrections one trace at a time. 2. The **Excluded Traces** options allow the user to add a BAD event to the excluded traces. This option is helpful if the intention is to [[Visual3D:Documentation:Definitions:Tag|tag]] the bad data, re-open the original data, and make manual corrections one trace at a time.
  
other/inspect3d/tutorials/clean_your_data.1737054336.txt.gz · Last modified: 2025/01/16 19:05 by wikisysop