Legacy Data Migration Engine
Data Engineering & System Modernisation
Migrated large legacy desktop databases (FoxPro / DBF) into modern relational systems with full validation and reconciliation.
500+
Legacy forms
200+
Reports
Parallel run
Strategy
PostgreSQL
Target
Overview
A migration toolchain that moves large legacy desktop ERPs — hundreds of FoxPro forms and reports backed by DBF files — into a modern relational database, with schema modernisation, data cleansing, report recreation and a parallel-run reconciliation strategy.
The business problem
Mission-critical operations ran on ageing FoxPro/DBF systems with business logic locked in procedural code, blocking modernisation and remote access.
The solution
I built custom Python migration scripts that map legacy DBF schemas to a normalised relational model, validate and cleanse data, recreate reports with PDF generation, and run old and new systems in parallel for reconciliation before cut-over.
My responsibilities
- Mapped legacy DBF schemas to a normalised relational model
- Built data validation, cleansing and integrity checks
- Recreated legacy reports with modern PDF generation
- Designed an incremental, parallel-run migration strategy
Challenges solved
- Extracting business logic embedded in 500+ legacy forms
- Preserving historical data integrity during migration
- Reconciling old and new systems during a parallel-run period
Key features
Architecture highlights
- ETL pipeline mapping DBF → relational schema
- Validation and reconciliation stages with integrity checks
- Form-to-Angular and report-to-PDF migration templates
- Incremental, module-by-module cut-over
Technologies used
Scalability
The pipeline processes modules independently, so large systems migrate incrementally without a risky big-bang cut-over.
Performance
- Batched extraction and load for large datasets
- Streaming transforms to bound memory
- Parallelised module processing
Security
- Integrity checks on every migrated record
- Reconciliation reports before cut-over
- Controlled access migration
Screenshots
Product screenshots available on request (NDA-protected).
Architecture diagram
Detailed system architecture available on request.
Related work
View allEnterprise Investment Management Platform
Wealth & Investment Management (PMS / AIF)
A multi-entity platform managing assets under management, distributor structures and investor reporting for institutional portfolios.
Performance & Fee Reporting Engine
Investment Analytics & Fund Performance
A calculation and reporting engine that turns raw NAV and cash movements into auditable performance and fee statements.
Asset Tracking & Management Platform
Asset & Rental Inventory Management
Real-time, up-to-the-second visibility and financial intelligence across a fleet of rental and organizational assets.