This is the information for the column provided in the Data Dictionary given to me to work with. Improvement_surcharge : 0.30 USD improvement surcharge assessed trips at the flag drop. The improvement surcharge began being levied in 2015. When i do a value count of my dataset which belongs to the year 2023, and data dictionary i have been told to work with is of the year 2022. ImprovementSurcharge 1.0 3585218 0.3 1473 0.0 24 Name: count, dtype: int64 There is a significant high amount of 1.0$ this could indicate change in price, issues with data integrity. I would like to know how should one go around handling a scenario like this, should he update 1.0$ to 0.3$ or Leave the data unchanged and include it while reporting. I am open to more suggestions from experience people in the field. So even if the data gives us insights that the new indicator is 1.0$ should i be treating 0.3$ and 0.0$ as an outlier and dropping or replacing them to 1.0$ Continue reading...
