Hi all, we have a AWS MySQL RDS instance and planning to use S3 integration to GoodData. Is there anyone who implemented a similar data pipiline and can recommend any tools or techniques we can use to convert MySQL data into Parquet format in S3?

Hello @Dilaksha Attanayake, can I ask why do you prefer to use S3 over MySQL? https://help.gooddata.com/doc/enterprise/en/data-integration/data-preparation-and-dis[…]-object-storage-services/gooddata-mysql-integration-details/

As it stands, we don't want to connect our production MySQL instance for performance reasons. We have a replica but that's not in a usable state

I see thank you for the explanation. Makes sense.

Personally, I would try to use Meltano, specifically tap-mysql and target-s3-parquet. It is easy to onboard and to extend it by many other taps/loaders

Thanks, will check it out @Jan Soubusta

I recommend to join their Slack community, they are almost as responsive as we are here 😉