I'm currently using AWS Apache Airflow service (MWAA) and I've been needing to run some web scraping code using selenium, I did manage to add "chromedriver" and "selenium" to the dependencies of the project, but I've been struggling to add chromium to it (or any headless web browser). AWS only allows a requirements.txt as dependencies to be installed using pip for MWAA, therefore I can't just add a "sudo yum install -y chromium" to the building cycle. I would like to know if it would be possible to add a chromedriver to the environment. Thanks in advance! Continue reading...
