Use this component when you wish to identify when two entities are the same entity or when they are related in some ways.
pydeduple is a deduplication tool developed in Python, originally developed as an internal tool for linking a directory database. It first identifies groups of records based on some measures, and then for each group, compare each pair of records within the group before classifying whether each pair is a match or not a match. There is also a data matching package in R called recordlinkage.
febrl (Freely Extensible Biomedical Record Linkage) developed in Python by Australian National University, matches entities by standardizing and cleaning data before “fuzzily matching” the records.
dedupe, developed in Python by datamade, uses machine learning techniques to match, deduplicate and match entities over structured data.
Magellan is a publicly available entity matching tool in Python (py_entitymatching package) developed by University of Wisconsin. It enables matching two tables (or one table against itself) using supervised learning techniques. The website provides further documentation on the py_entitymatching package.
Both schema and data matching uses string matching as a fundamental building block. Magellan also includes a py_stringmatching package for string matching. See their website for a discussion on available open-source string matching packages.