Domain-Driven Data Migration: How Domain-Specific Languages Enabled Large-Scale Legacy Data Transformation
Moving to microservices requires transforming legacy data. This case study covers migrating over one million records, where challenges extended beyond format conversions to understanding complex business rules and data interdependencies. Netum created a domain-specific modeling language enabling domain experts to specify and validate migration rules in a high-level. Models automatically transformed into production code, eliminating specification-execution gaps. The collaborative approach proved essential. Languages evolved continuously—even three times daily over 2-year period—supporting complex scenarios. Domain experts verified rules early, catching issues before production. We share lessons combining domain expertise with modeling for large-scale data transformations during migrations.
Value for the audience:
Audience learn a proven way to manage migrating highly complex and large data sets from one architecture (here monolith) to another (here microservices). The data shows how quality of migration rules is improved by specifying them together with data experts with easy-to-use modeling language. Audience gains insights into the practical implementation and benefits of applying domain-specific language that is used by both domain-experts and technical developers. The software team and team leaders will get insights into creating modeling and code generation support for migration projects. Guidelines are demonstrated with examples from practice.
Problems addressed:
Migration of different data schemas with complex structures together with domain experts
Un-validated and tested requirements
Poor collaboration between domain experts and developers
Talk language: English
Level: Advanced
Target group: architects, managers, process and quality managers
Company:
MetaCase
Dr Juha-Pekka Tolvanen
Risto Pohjonen