Profiling

Profiling is the process by which Qualdo determines Data Quality.

Data is creatively examined to quantify properties which are stored and managed as metrics, which are then further analyzed. This process uncovers information concealed by complex nuances within your data, while also monitoring straightforward business standards, goals and constraints, and ensuring that your data is valid in terms of standard statistical measures.

Data Profiling broadly falls under three categories:
  1. Structure - Focuses on the data formats, make sure everything is uniform and consistent. The validity of the data is identified using statistical analysis.

  2. Content - Assesses the quality of every piece of data. For example, outliers, incomplete, and null values are identified.

  3. Relationship - Detects connections, similarities, differences, and associations between Datasets.

Qualdo profiles data and provides detailed visualizations and insights into the Data Quality.

Data profiling

As part of the Data Profile process, Qualdo performs Structure, Content and Relationship Discovery. Qualdo also discovers metadata, identifies data types, business rule types, collects descriptive statistics like mean, min, max etc., identifies distribution, inter-Dataset dependencies, missing or unknown data, distinct values, and memory/storage utilization.