Information quality management is a grand challenge in computing, NLP, or AI. Ground.News (https://ground.news) is an organization making significant strides toward handling some data quality dimensions: bias, factuality, and ownership in multi-source and multi-modal environments.
No unified data quality standards exist at this time and might not be created any time soon at an algorithmic level. Notably, the International Organization for Standardization (ISO) publishes standards that might be a foundation. However, much research is needed to determine the methods, metrics, and algorithms.
A good reference for further research is documents published by the U.S. National Institute of Statistical Sciences (NISS) discussing definitions in the context of data as a product, purpose, usage, timelines, criticality, etc. Many guidelines are researched and implemented across such dimensions as:
-availability
-usability
-reliability
-relevance
-presentation quality, etc.
(source: Cai, L. and Zhu, Y., 2015. The Challenges of Data Quality and Data Quality Assessment in the Big Data Era. Data Science Journal, 14, p.2. ) #datascience #bigdata #ai #management #nlp #quality #algorithms #informationquality #dataanalytics #dataquality #dataqualitymanagement
No comments:
Post a Comment
Note: Only a member of this blog may post a comment.