• There are no suggestions because the search field is empty.

Data migration in CSV: definition, purpose, and best practices

Author Avatar
Leslie Cisneros, Validation & Qualification Specialist at QbD Group
Software Solutions & Services
In Vitro Diagnostics
Medical Devices
Pharma & Biotech
Sometimes it is necessary to perform data migration in computer systems, applications, or software. Learn more about the goal, importance and risks here.
Data migration in CSV: definition, purpose and best practices | QbD Group
6:12

Ever wondered why it is necessary – and sometimes absolutely essential – to perform a Data Migration in computer systems, applications or software, what the risks are and what strategy should be followed? 

In this blog, you will learn more about the following topics:

  • What is Data Migration? 
  • What is the goal of Data Migration? 
  • Data Migration Plan 
  • Data Migration Report 

Curious? Then be sure to read on!

 

What is Data Migration in CSV?

 

Data migration takes place in the last phase of the life cycle of a computerized system, called ‘retirement‘, where the system is withdrawn, decommissioned, removed and the required data is migrated.

It can occur frequently during the life cycle of the various computerized systems used by regulated companies.

Data Migration is the activity of transferring electronic data from one system to another, or simply the transition from one state to another. In practice, data migration efforts can vary widely in scope, complexity, and risk, e.g.:

 

  • An in-place version upgrade of a database or application
  • Data conversion (e.g., from one supplier’s database to another)
  • Same-system migration (e.g., transporting an application’s data from one server platform to another)
  • Migration from one source system to one target system
  • Migration from multiple source systems to one target system
 

The complexity and risk of Data Migration can also increase significantly if rules are used to select a subset of data from the source system, or if data is transformed (e.g., data type conversion, filtering, cleansing, aggregation, renormalization) before it is inserted into the target system.  

 

What is the goal of data migration?

 

The goal of any data migration is to have data that remains usable and retains its contextual meaning. Quality control measures must be in place to ensure that the data migration is successful, compliant, and repeatable.

 

As part of the best practices recommended by the GAMP, each data migration should be managed within the framework of a data migration plan and report.

 
 

Data Migration Plan: detailed description of the migration process

 

A data migration plan is essential to coordinate the activities that need to be followed during the migration.

It also helps to identify who is responsible for implementing what has been determined, when and how, and it facilitates the documentation of all the activities of the data migration. The last point is important if your data migration is a GxP system/application. 

According to GAMP, the data migration plan should describe the entire migration process, including, at a minimum:

 

  • Migration project purpose and scope
  • System description(s)
  • Roles and responsibilities
  • Required deliverables
  • Risk management strategy
  • Configuration management strategy, including the source, staging, and target environments
  • Software tool overview and strategy for ensuring compliance and fitness for the intended use
  • Migration steps and technical activities
  • Data mapping and modeling activities
  • Transformation rules
  • Data verification strategy and acceptance standards
  • Cutover plan
  • Roll back strategy

 

Data Migration report: summary of all migration activities

 
A data migration report makes it easier to keep track of what was performed, when, by whom and what the result of the migration was. Any issues are also explained in this report.

The data migration report summarizes the activities performed during the data migration. It includes a description of any anomalies or discrepancies found and a list of the results of the verification activities, with objective evidence as necessary.

Because the report will be used to determine the reliability of the migrated data, it should clearly state the overall outcome of the migration activity, such as: complete success, partial success, or failure.

If the data migration is performed as part of a computerized system project, such as a system replacement or upgrade, the data migration report may be documented within the project documentation, where appropriate, and need not be a separate document.

 

Drafting a Data Migration Plan

 

First, determine if the system/application requires data migration. Once you have confirmed the migration requirement, you can start preparing the document with the following basic sections:

  1. Purpose
  2. Scope
  3. Abbreviations/ Definitions / Glossary
  4. References
  5. Procedure
    • Risk management strategy
    • Configuration management strategy
    • Software tool overview and strategy
    • Migration steps and technical activities
    • Initial Loading plan
    • Data mapping and modeling activities
    • Transformation rules
    • Data verification strategy
    • Cutover plan
    • Rollback strategy
  6. Responsibilities (RACI Matrix)
 

Do you need help performing the Data Migration of a computerized system? Or do you need support in preparing a Data Migration Plan? Then don’t hesitate to contact us. We will be happy to help you!

 
 

Stay ahead in life sciences

Keeping up with the fast-paced life sciences industry doesn’t have to be overwhelming.

Our newsletter delivers the latest insights, industry updates, and expert content directly to your inbox, helping you stay informed and make smarter decisions.

Circles-banner-short

Discover more expert content

preview_image
Whitepaper

A Complete Guide to Computer System Validation

This guide aims to bring context and define the necessary and appropriate strategies for the validation of computerized systems. Download now.
preview_image
Whitepaper

Digital Health - Exploring the landscape and future opportunities

This whitepaper informs you about digital health, key technology pillars, and new opportunities to anticipate future trends in your healthcare sector.
preview_image
Whitepaper

How to keep computerized systems in the operational phase

Ensure compliance and efficiency with best practices for maintaining computerized systems in the operational phase. Download our expert whitepaper now!
preview_image
Webinar

From Requirements to Code: a unified MDSW development cycle that covers all requirements

Watch our webinar on demand to master medical device software development. Learn about IEC standards, cybersecurity, AI integration, and FDA expectations.
preview_image
Whitepaper

Mobile health on the rise: exploring the regulatory landscape for reimbursement

This whitepaper will help you navigate the maze of the DTx regulatory environment, highlighting several important countries and regulations.
preview_image
Whitepaper

GAMP 5 Software Validation Approach for GMP, GCP and GLP regulations

Learn how to comply with GMP, GCP, and GLP regulations using the GAMP 5 Software Validation Approach. Download the whitepaper for more insights.
preview_image
Webinar

Getting Started: Overcoming Initial Obstacles in Medical Device Software Development

Watch our webinar on demand and learn about regulatory obstacles, MDR, AI Act, and best practices for medical device software development and market entry.
preview_image
Whitepaper

Standards and regulations for software used in Medical Devices

Explore the essential standards and regulations for software used in Medical Devices, including IEC 62304 and IEC 82304. Download now.
preview_image
Whitepaper

Annual Product Quality Review in Pharma

Want to learn more about the importance, benefits, and key challenges related to the Annual Product Quality Review in Pharma? Then read on quickly!
preview_image
Whitepaper

21 CFR Part 11 compliance checklist

Want to assess whether a computer system generates electronic records and uses electronic signatures, and whether the system complies with Part 11 of 21 CFR? Download this free checklist.
preview_image
Webinar

Second edition of GAMP 5: A Risk-Based Approach to compliant GxP Computerized Systems

This webinar on demand will tell you more about the second edition of GAMP 5.
preview_image
Webinar

Verification & Validation of Artificial Intelligence/ Machine Learning Medical Devices

Explore the impact of Artificial Intelligence and Machine Learning on medical device validation and verification processes.
preview_image
Whitepaper

GAMP categories for computerized systems: what are they and what are they for?

In this whitepaper, you will learn what GAMP is, what GAMP categories are for, and where to start if you are facing computerized systems validation.
preview_image
Whitepaper

EUDRALEX Volume 4 Annex 11 Compliance Checklist

Assess your computer system's compliance with EudraLex Volume 4 Annex 11 guidelines using our checklist. Download now for GMP assurance.
preview_image
Whitepaper

From V-model to Agile: how to embrace automation as part of the computerized system validation approach

This white paper explores why IT is shifting to agile, focuses on the prevalent Scrum methodology, and concludes with guidance on adapting system validation processes.