Loading...
This recipe calculates an objective 0-100 Criticality Score for every table by analyzing usage, downstream lineage impact, structural classification, and sensitive data (PII) presence. It uses statistical Standard Deviation (Sigma) logic to categorize assets into five actionable governance tiers, transforming months of manual prioritization into a data-driven roadmap.
Organizations often manage tens of thousands of tables, creating decision paralysis where every asset appears equally important. This recipe computes a composite 0–100 Criticality Score that automatically surfaces the tables that carry the highest business risk and impact—such as those containing PII or feeding executive dashboards—so governance and security efforts focus where they matter most.
Step 1 — Baseline Importance Selection
Extract foundational metadata such as usage metrics, row counts, and lineage signals while filtering out temporary structures and technical noise.
Step 2 — Recursive Lineage Impact Amplification
Trace downstream lineage up to five levels toward reports and dashboards; each table receives a +5 point impact bonus for every unique report it ultimately feeds.
Step 3 — Structural Table Classification
Classify assets structurally based on row volume and connectivity: Transactional tables receive 10 points, Master tables receive 8 points, and Reference tables receive 5 points.
Step 4 — Exhaustive PII Detection
Perform a deep scan across column names using 50+ PII keywords to identify sensitive data fields; detected PII contributes a 30-point risk weight to the table.
Step 5 — Composite Criticality Scoring & Triage
Compute a final 0–100 Criticality Score using a weighted formula: 50% Value (usage & lineage impact), 30% Risk (PII presence), and 20% Structure (table classification). The recipe then applies standard deviation (σ) calculations to automatically bucket assets into five governance tiers: Critical, High, Medium, Low, and Deprioritize.
| Table Name | Table Classification | Contains PII | Criticality Score | Governance Bucket |
|---|---|---|---|---|
| DimCustomer | Master | Yes | 96.0 | 🚨 Critical - Immediate Audit |
| Transactions | Transactional | No | 51.0 | 🔥 High - Prioritize Curation |
| Staging_Temp | Unsure | No | 12.0 | 💤 Deprioritize |
Make sure the following ingredients are available in your workspace: