Cross-system data migration at petabyte scale: Best practices and frameworks

Sura, Rajesh (2025) Cross-system data migration at petabyte scale: Best practices and frameworks. World Journal of Advanced Engineering Technology and Sciences, 16 (1). pp. 575-584. ISSN 2582-8266

[thumbnail of WJAETS-2025-1236.pdf] Article PDF
WJAETS-2025-1236.pdf - Published Version
Available under License Creative Commons Attribution Non-commercial Share Alike.

Download ( 828kB)

Abstract

Enterprise context is different nowadays, and the process of regulating and migrating petabyte-scale data between heterogeneous systems is no longer an exception; it is a rather standard practice. Inspired by adopting cloud environments, modernization of the platforms, or legal changes, the demand for an effective, reliable, and sustainable cross-system data migration methodology has become a burning issue. The architectural underpinnings, implementations, performance stipulations, and transitive obstacles of the implementation of large-scale data migration across various environments and properties, including cloud data warehouses, legacy systems, and real-time platforms, are discussed in this review. The review uses the analysis of the current practice and case studies to analyze the state-of-the-art frameworks and find gaps in the current methodology. It ends by moving forward to explore automation, security, explainability, and sustainability within next-gen data migration ecosystems.

Item Type: Article
Official URL: https://doi.org/10.30574/wjaets.2025.16.1.1236
Uncontrolled Keywords: Data Migration; Petabyte-Scale; Cloud Data Warehouses; Migration Orchestration; Data Validation; Airflow
Depositing User: Editor Engineering Section
Date Deposited: 22 Aug 2025 08:56
Related URLs:
URI: https://eprint.scholarsrepository.com/id/eprint/5258