Friday, September 16, 2016

Data Management and Data Analytics

Information and data management is getting more challenging these days, with the velocity of data we are producing and the tendency of increased data production. Actually, the key for the solution is beyond information and data management. It is about how and what data should be collected.

I still remembered the data collection from web sites for data preservation. The amount of data growing makes me wonder even we can store them, how we can catch up in processing them to make them meaningful, e.g. to transform the data into information, let alone transform information into useful knowledge, or perform data analytics. If data processing speeds continue lagging behind data collection speeds, the data collected will not be useful, but add burden to the slow process. If more meaningless data involved, it’ll add more burden to the process. Therefore, we need to improve the data collection machanism, to collect the data with purpose, e.g. use a Service Oriented Data Collection and Management mechanism, and collect the data cleanly, or have a data cleansing process in place.