I would like to create a pipeline that i can run each time with a different number of components. Each component calls some function, the function can be ran from within a container or an installed package, How can i utilize the kfp framework to create such a pipeline that can be ran with different function sequences without needing to write the pipeline for each case? Should the pipeline be compiled dynamically for a given sequence or can it be compiled once and evaluate the sequence in run time? e.g: @kfp.dsl.pipeline(name="sequenced components pipeline") def sequenced_components_pipeline( ... ): # ?? Continue reading...
