-
Notifications
You must be signed in to change notification settings - Fork 5.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
docs: processing components #6099
base: main
Are you sure you want to change the base?
Conversation
mendonk
commented
Feb 3, 2025
- Address components that were renamed
- Link to Data and Message objects for more context
- Consistent headings
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Left a few suggestions, but approving.
|
||
### Inputs | ||
|
||
| Name | Display Name | Info | | ||
|------|--------------|------| | ||
| input_value | Input | Objects to which Metadata should be added | | ||
| text_in | User Text | Text input; value will be in 'text' attribute of Data object. Empty text entries are ignored. | | ||
| text_in | User Text | Text input; value will be in 'text' attribute of [Data](/concepts-objects#data-object) object. Empty text entries are ignored. | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| text_in | User Text | Text input; value will be in 'text' attribute of [Data](/concepts-objects#data-object) object. Empty text entries are ignored. | | |
| text_in | User Text | Text input; the value will be in the 'text' attribute of the [Data](/concepts-objects#data-object) object. Empty text entries are ignored. | |
| filter_key | Filter Key | The key to filter on (for example, 'route'). | | ||
| filter_value | Filter Value | The value to filter by (for example, 'CMIP'). | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| filter_key | Filter Key | The key to filter on (for example, 'route'). | | |
| filter_value | Filter Value | The value to filter by (for example, 'CMIP'). | | |
| filter_key | Filter Key | The key to filter on, for example, 'route'. | | |
| filter_value | Filter Value | The value to filter by, for example, 'CMIP'. | |
|
||
### Inputs | ||
|
||
| Name | Display Name | Info | | ||
|------|--------------|------| | ||
| data_inputs | Data Inputs | Data to combine (minimum 2 inputs required) | | ||
| operation | Operation Type | Operation to perform (Concatenate/Append/Merge/Join) | | ||
| data | Data | A list of data objects to be merged | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| data | Data | A list of data objects to be merged | | |
| data | Data | A list of data objects to be merged. | |
|
||
### Outputs | ||
|
||
| Name | Display Name | Info | | ||
|------|--------------|------| | ||
| combined_data | DataFrame | The combined data result | | ||
| merged_data | Merged Data | A single [Data](/concepts-objects#data-object) object containing the combined information from all input data objects | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| merged_data | Merged Data | A single [Data](/concepts-objects#data-object) object containing the combined information from all input data objects | | |
| merged_data | Merged Data | A single [Data](/concepts-objects#data-object) object containing the combined information from all input data objects. | |
|
||
### Inputs | ||
|
||
| Name | Display Name | Info | | ||
|------|--------------|------| | ||
| message | Message | The Message object to convert to a Data object | | ||
| message | Message | The [Message](/concepts-objects#message-object) object to convert to a [Data](/concepts-objects#data-object) object | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| message | Message | The [Message](/concepts-objects#message-object) object to convert to a [Data](/concepts-objects#data-object) object | | |
| message | Message | The [Message](/concepts-objects#message-object) object to convert to a [Data](/concepts-objects#data-object) object. | |
|
||
This component converts and extracts JSON fields using JQ queries. | ||
|
||
### Inputs | ||
|
||
| Name | Display Name | Info | | ||
|------|--------------|------| | ||
| input_value | Input | Data object to filter (Message or Data) | | ||
| input_value | Input | Data object to filter ([Message](/concepts-objects#message-object) or [Data](/concepts-objects#data-object)) | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| input_value | Input | Data object to filter ([Message](/concepts-objects#message-object) or [Data](/concepts-objects#data-object)) | | |
| input_value | Input | Data object to filter ([Message](/concepts-objects#message-object) or [Data](/concepts-objects#data-object)). | |
| query | JQ Query | JQ Query to filter the data | | ||
|
||
### Outputs | ||
|
||
| Name | Display Name | Info | | ||
|------|--------------|------| | ||
| filtered_data | Filtered Data | Filtered data as list of Data objects | | ||
| filtered_data | Filtered Data | Filtered data as list of [Data](/concepts-objects#data-object) objects | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| filtered_data | Filtered Data | Filtered data as list of [Data](/concepts-objects#data-object) objects | | |
| filtered_data | Filtered Data | Filtered data as list of [Data](/concepts-objects#data-object) objects. | |
@@ -295,9 +288,9 @@ This component selects a single data item from a list. | |||
|
|||
| Name | Display Name | Info | | |||
|------|--------------|------| | |||
| selected_data | Selected Data | The selected Data object | | |||
| selected_data | Selected Data | The selected [Data](/concepts-objects#data-object) object | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| selected_data | Selected Data | The selected [Data](/concepts-objects#data-object) object | | |
| selected_data | Selected Data | The selected [Data](/concepts-objects#data-object) object. | |
@@ -314,10 +307,10 @@ This component splits text into chunks based on specified criteria. | |||
|
|||
| Name | Display Name | Info | | |||
|------|--------------|------| | |||
| chunks | Chunks | List of split text chunks as Data objects | | |||
| chunks | Chunks | List of split text chunks as [Data](/concepts-objects#data-object) objects | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| chunks | Chunks | List of split text chunks as [Data](/concepts-objects#data-object) objects | | |
| chunks | Chunks | List of split text chunks as [Data](/concepts-objects#data-object) objects. | |
@@ -334,4 +327,4 @@ This component dynamically updates or appends data with specified fields. | |||
|
|||
| Name | Display Name | Info | | |||
|------|--------------|------| | |||
| data | Data | Updated Data objects | | |||
| data | Data | Updated [Data](/concepts-objects#data-object) objects | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| data | Data | Updated [Data](/concepts-objects#data-object) objects | | |
| data | Data | Updated [Data](/concepts-objects#data-object) objects. | |