I am working on a ETL code template using VS Code which has the building blocks for most of the ETL workflows my team uses. Idea is that folks will git clone the repo and use this as a base for building ETLs rather than writing all the code from scratch. root/ └── src/ ├── python/ │ ├── __init__.py │ ├── sample_etl1.py │ ├── sample_etl2.py │ │ │ └── dependencies/ │ ├── __init__.py │ ├── file_manager.py # Contain helper functions to manage directories and files │ ├── functions.py # Placeholder module for any additional custom functions required │ ├── logfusion.py # Helps instantiate a python logger │ ├── outlook_manager.py # Creates an outlook instance to access mailbox folders & send emails │ ├── pygmentation.py #Syntax Highlights log messages before sending via email │ ├── sqalchemist.py #SQL Toolkit to create database connections and improve data load functionality │ └── utils.py #Placeholder for any utility items like SQLAlchemy dtype mappings │ ├── sql/ #Store SQL Queries here │ ├── query1.sql │ └── query2.sql │ └── main.py All the python code runs within the src directory using main.py. During development, when I select some python code and press shift+enter to run the code in the shell, the shell launches in the root directory. I have to then manually exit the shell, cd to src directory, again enter shell for me to run selected python code which is a bit annoying. Is there a way for me to launch the python shell directly into the source directory when I select any python code and hit shift+enter? This would allow developers to test pieces of code as they go along I have tried a bunch of settings using .vscode\settings.json but nothing seems to have worked so far. Hope my query is clear. Happy to provide more information. Any suggestions would be very helpful. Continue reading...
