[Python] Read and modify only the column names in a very large CSV or Parquet file stored in S3

I have a very large CSV or Parquet file stored in AWS S3, I want to rename a few of the columns however I don't want to read the entire file because it's very large (several TB) so I would need to download the entire file then change the column name and re-upload it which will be slow and can be expensive (egress/storage/transfer costs). Is there a way to change the column names without downloading the entire file?

Continue reading...