← All projectsData cleaning · CASE STUDY
Making messy transactions make sense
Standardizing schemas, resolving inconsistent category labels, and recovering missing values across 12,575 multi-location retail transactions.
Goals
- Audit and remediate data quality issues across 12,575 multi-channel retail transactions.
- Handle missing values using context-aware strategies rather than blindly dropping rows.
- Standardize column names, categories, and date formats for downstream consistency.
- Produce a clean, validated CSV ready for analysis and reporting.
Process
- Explored dataset structure using
df.info(), df.isna().sum() and df.describe()
- Standardized column names — stripped whitespace, lowercased, replaced spaces with underscores.
- Handled nulls per column based on context — filled, calculated, or dropped where justified.
- Cleaned and standardized the
category column formatting
Insights
- Nearly 5% of transactions had no recoverable quantity or spending data — dropping them was justified and had minimal impact on the dataset
- The
item column encoded category information in its naming pattern (Item_[number]_[category]), which revealed a way to validate the category column
discount_applied nulls were meaningful — they represented transactions with no discount, not truly missing data. Context matters when handling nulls
- Standardizing text columns early (before any grouping or analysis) prevents silent bugs where
"Food" and "food" are treated as different categories
This case study documents a portfolio analysis. Findings describe this dataset and should be interpreted within its limitations.
Dataset source ↗ Explore more projects