Hi Dear,
I have expert level knowledge in data migration from on prim to cloud. I recently transferred 19tb data for one of my client from their on prim to RDS postgresql database.
I used AWS glue service to transform this data from source structure to destination structure. I yet to know about your in prim database and it's structure. Once we have discussion and have insight, we will plan our data workflow for transformation.
AWS Glue works on their Lambda based architecture. So performance is a major plus point in AWS glue. The another good thing is, since it is managed by AWS only, there is no need of looking after infrastructure.
Glue has provided their own transformation logic that we need to consume in Python. So comparatively it gives more filtering and sorting to transform data in right structure.
Please let me know your convenient time to discuss further so we can plan for next step.
Thanks,
Vimal Santoki