[Python] Trying to setup data pipeline between Informix application database and GCP

Discussão em 'Python' iniciado por Stack, Setembro 30, 2024.

  1. Stack

    Stack Membro Participativo

    My goal is to set up a data pipeline from an Informix database to a BigQuery. I managed to make it work on my local workstation by using Python (pyodbc); But I do not seem to be able to deploy my script in the cloud (GCP).

    The main two hurdles are:

    • The ODBC driver need to be installed for the connection to work. I know how to install it on my Windows laptop, but I am not sure how to do so in GCP or if I even need to.
    • The connection to the database is restricted by whitelisted IP addresses. I would need the connection to work through a static IP address only.

    I don't really care what GCP tool I must use (cloud function, data fusion, etc.); I just need to make it work.

    Can anyone put me on the right track and/or point me to some documentation that could help me get to where I need to go?

    Continue reading...

Compartilhe esta Página