Hi,
I am Lead Data Engineer at Cluster Deutsche Bahn (as an external Consultant). I have 5 years of experience working with Python, Pyspark, SQL, Airflow, Google Cloud Storage, Google Big Query, AWS S3, Athena, Glue, EMR, RDS, DDB, EC2.
What I do on a daily basis is exactly what you are looking for.
Building Data pipelines using a Microservices architecture on AWS.
Collaborating with all stakeholders (Architects, Scrum masters, Business Engineers)
Regular Data Architecture reviews, and proposals for improvement.
Maintenance of custom created libraries, and Doku
Please have a look at my portfolio, and I am happy to give more info in a call.
Best regards,
Mohamad