Habr has published an article (habr.com/ru/articles/1098614/) on normalizing millions of MDM rows — a nomenclature reference catalog. The author describes a no-frills setup: an ordinary server with 8 cores and 16 GB of RAM, with a claimed record-matching accuracy of 98%. No GPU farms and no "golden fish" that grants wishes on demand. The genie-and-lamp metaphor is about architecture, not pretty prose. The model isn't thrown at raw data "as is": it's placed inside a narrow set of constraints defined by the surrounding infrastructure, and within those boundaries it processes millions of rows. What exactly those constraints are — response format, matching rules, or catalog preprocessing — the author breaks down in the article itself.
MDM normalization is an eternal pain point: the same product in a catalog exists in a dozen spellings, abbreviations, and typos. This case shows that millions of rows can be run through AI on hardware that's already sitting in the rack, with no cloud bills and no shipping data outside. For teams with on-prem infrastructure, this is a working scenario, not a lab experiment; the details and limitations of the approach are in the article itself.
Source: habr.com · post in Telegram