Identifying Value Mappings for Data Integration: An Unsupervised Approach

@incollection{citeulike:1837316, abstract = {The Web is a distributed network of information sources where the individual sources are autonomously created and maintained. Consequently, syntactic and semantic heterogeneity of data among sources abound. Most of the current data cleaning solutions assume that the data values referencing the same object bear some textual similarity. However, this assumption is often violated in practice. “Two-door front wheel drive” can be represented as “2DR-FWD” or “R2FD”, or even as “CAR TYPE 3” in different data sources. To address this problem, we propose a novel two-step automated technique that exploits statistical dependency structures among objects which is invariant to the tokens representing the objects. The algorithm achieved a high accuracy in our empirical study, suggesting that it can be a useful addition to the existing information integration techniques.}, author = {Kang, Jaewoo and Lee, Dongwon and Mitra, Prasenjit }, citeulike-article-id = {1837316}, doi = {http://dx.doi.org/10.1007/11581062\_46}, journal = {Web Information Systems Engineering – WISE 2005}, pages = {544--551}, posted-at = {2007-10-29 21:06:22}, priority = {2}, title = {Identifying Value Mappings for Data Integration: An Unsupervised Approach}, url = {http://dx.doi.org/10.1007/11581062\_46}, year = {2005} }

TY - CHAP ID - citeulike:1837316 L3 - citeulike-article-id:1837316 TI - Identifying Value Mappings for Data Integration: An Unsupervised Approach JF - Web Information Systems Engineering – WISE 2005 SP - 544 EP - 551 N2 - The Web is a distributed network of information sources where the individual sources are autonomously created and maintained. Consequently, syntactic and semantic heterogeneity of data among sources abound. Most of the current data cleaning solutions assume that the data values referencing the same object bear some textual similarity. However, this assumption is often violated in practice. “Two-door front wheel drive” can be represented as “2DR-FWD” or “R2FD”, or even as “CAR TYPE 3” in different data sources. To address this problem, we propose a novel two-step automated technique that exploits statistical dependency structures among objects which is invariant to the tokens representing the objects. The algorithm achieved a high accuracy in our empirical study, suggesting that it can be a useful addition to the existing information integration techniques. AU - Kang, Jaewoo AU - Lee, Dongwon AU - Mitra, Prasenjit PY - 2005/// UR - http://dx.doi.org/10.1007/11581062_46 ER -