I am working on Document AI solution where I extracts the texts from a group of pdf documents to document AI processors and upload some of the extracted informations to BigQuery,
Basically, I have two python scripts, very long codes, in vertex ai benchmark jupyter notebook environment. Now I want to build a pipeline to automate the sequence of execution of these two python script.
I have been searching the possible way to run a jupyter notebook from Vertex Pipeline which is basically Kubeflow without success. I know that I can execute python functions from vertex pipeline but what I need is to run the whole python script from vertex benchmark jupyter notebook.
Any help will be very much appreciated.