Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: processing components #6099

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open

docs: processing components #6099

wants to merge 3 commits into from

Conversation

mendonk
Copy link
Collaborator

@mendonk mendonk commented Feb 3, 2025

  • Address components that were renamed
  • Link to Data and Message objects for more context
  • Consistent headings

@mendonk mendonk self-assigned this Feb 3, 2025
@dosubot dosubot bot added size:L This PR changes 100-499 lines, ignoring generated files. documentation Improvements or additions to documentation labels Feb 3, 2025
@github-actions github-actions bot added documentation Improvements or additions to documentation and removed documentation Improvements or additions to documentation labels Feb 3, 2025
Copy link
Collaborator

@KimberlyFields KimberlyFields left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left a few suggestions, but approving.


### Inputs

| Name | Display Name | Info |
|------|--------------|------|
| input_value | Input | Objects to which Metadata should be added |
| text_in | User Text | Text input; value will be in 'text' attribute of Data object. Empty text entries are ignored. |
| text_in | User Text | Text input; value will be in 'text' attribute of [Data](/concepts-objects#data-object) object. Empty text entries are ignored. |
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
| text_in | User Text | Text input; value will be in 'text' attribute of [Data](/concepts-objects#data-object) object. Empty text entries are ignored. |
| text_in | User Text | Text input; the value will be in the 'text' attribute of the [Data](/concepts-objects#data-object) object. Empty text entries are ignored. |

Comment on lines +137 to +138
| filter_key | Filter Key | The key to filter on (for example, 'route'). |
| filter_value | Filter Value | The value to filter by (for example, 'CMIP'). |
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
| filter_key | Filter Key | The key to filter on (for example, 'route'). |
| filter_value | Filter Value | The value to filter by (for example, 'CMIP'). |
| filter_key | Filter Key | The key to filter on, for example, 'route'. |
| filter_value | Filter Value | The value to filter by, for example, 'CMIP'. |


### Inputs

| Name | Display Name | Info |
|------|--------------|------|
| data_inputs | Data Inputs | Data to combine (minimum 2 inputs required) |
| operation | Operation Type | Operation to perform (Concatenate/Append/Merge/Join) |
| data | Data | A list of data objects to be merged |
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
| data | Data | A list of data objects to be merged |
| data | Data | A list of data objects to be merged. |


### Outputs

| Name | Display Name | Info |
|------|--------------|------|
| combined_data | DataFrame | The combined data result |
| merged_data | Merged Data | A single [Data](/concepts-objects#data-object) object containing the combined information from all input data objects |
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
| merged_data | Merged Data | A single [Data](/concepts-objects#data-object) object containing the combined information from all input data objects |
| merged_data | Merged Data | A single [Data](/concepts-objects#data-object) object containing the combined information from all input data objects. |


### Inputs

| Name | Display Name | Info |
|------|--------------|------|
| message | Message | The Message object to convert to a Data object |
| message | Message | The [Message](/concepts-objects#message-object) object to convert to a [Data](/concepts-objects#data-object) object |
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
| message | Message | The [Message](/concepts-objects#message-object) object to convert to a [Data](/concepts-objects#data-object) object |
| message | Message | The [Message](/concepts-objects#message-object) object to convert to a [Data](/concepts-objects#data-object) object. |


This component converts and extracts JSON fields using JQ queries.

### Inputs

| Name | Display Name | Info |
|------|--------------|------|
| input_value | Input | Data object to filter (Message or Data) |
| input_value | Input | Data object to filter ([Message](/concepts-objects#message-object) or [Data](/concepts-objects#data-object)) |
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
| input_value | Input | Data object to filter ([Message](/concepts-objects#message-object) or [Data](/concepts-objects#data-object)) |
| input_value | Input | Data object to filter ([Message](/concepts-objects#message-object) or [Data](/concepts-objects#data-object)). |

| query | JQ Query | JQ Query to filter the data |

### Outputs

| Name | Display Name | Info |
|------|--------------|------|
| filtered_data | Filtered Data | Filtered data as list of Data objects |
| filtered_data | Filtered Data | Filtered data as list of [Data](/concepts-objects#data-object) objects |
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
| filtered_data | Filtered Data | Filtered data as list of [Data](/concepts-objects#data-object) objects |
| filtered_data | Filtered Data | Filtered data as list of [Data](/concepts-objects#data-object) objects. |

@@ -295,9 +288,9 @@ This component selects a single data item from a list.

| Name | Display Name | Info |
|------|--------------|------|
| selected_data | Selected Data | The selected Data object |
| selected_data | Selected Data | The selected [Data](/concepts-objects#data-object) object |
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
| selected_data | Selected Data | The selected [Data](/concepts-objects#data-object) object |
| selected_data | Selected Data | The selected [Data](/concepts-objects#data-object) object. |

@@ -314,10 +307,10 @@ This component splits text into chunks based on specified criteria.

| Name | Display Name | Info |
|------|--------------|------|
| chunks | Chunks | List of split text chunks as Data objects |
| chunks | Chunks | List of split text chunks as [Data](/concepts-objects#data-object) objects |
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
| chunks | Chunks | List of split text chunks as [Data](/concepts-objects#data-object) objects |
| chunks | Chunks | List of split text chunks as [Data](/concepts-objects#data-object) objects. |

@@ -334,4 +327,4 @@ This component dynamically updates or appends data with specified fields.

| Name | Display Name | Info |
|------|--------------|------|
| data | Data | Updated Data objects |
| data | Data | Updated [Data](/concepts-objects#data-object) objects |
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
| data | Data | Updated [Data](/concepts-objects#data-object) objects |
| data | Data | Updated [Data](/concepts-objects#data-object) objects. |

@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Feb 4, 2025
@github-actions github-actions bot added documentation Improvements or additions to documentation and removed documentation Improvements or additions to documentation labels Feb 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation lgtm This PR has been approved by a maintainer size:L This PR changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants