Add some input in the pipeline on differents nodes

[sinaayyy]

Hello,
I work with a RAG pipeline with retriever reader and generator and when i run the pipeline i give in input : query and params (params for differents nodes like debug and the size of output top_k).

My problem it's how i can give in the pipeline.run() some text.
Because I wan't create a custom nodes in the pipeline to filter some documents thanks to text he give in input for the run() methods

[julian-risch]

Hello @sinaayyy in Haystack version 1.x, pipeline.run() can take any additional parameters via its params. For example, you can have: pipeline.run(query="Who is the father of Arya Stark?", params={"Retriever": {"top_k": 10}}).
You can specify the name of your custom component when you add it to the pipeline:
pipeline.add_node(component=my_component, name="Custom", inputs=["Retriever"]).
And then you can run the pipeline and pass a parameter text to the component called Custom:
pipeline.run(query="Who is the father of Arya Stark?", params={"Retriever": {"top_k": 10}, "Custom": {"text": "my_text"}}).

When you define your custom component, make sure its run method has a parameter text:

class CustomNode(BaseComponent):
    outgoing_edges = 1

    def run(self, query: str, text: Optional[str]):
        ...

Our tutorial 11 shows how to create a custom component in detail: https://haystack.deepset.ai/tutorials/11_pipelines