Data Engineer

Hi, I am an experienced Data Engineer with a solid background in Spark. I have worked on many Big Data projects with Spark, Scala, Python, Cassandra, Snowflake, AWS,... Let's have a call for more details about the project. Regards

I am currently working in an enterprise company with the exact same tech stack as mentioned here. My current is about creating data pipelines to ingest, transform, store streaming & batch data using glue/lambda. The processed data gets stored in to redshift currently.

I certified aws data engineer having experience in lambda, glue, emr, step function using python/pyspark as programming language.

I am working on the exact same design and development with Step function glue(pySpark) and Snowflake. This will be my first Project here if provided the chance. But I Have 9+ years of Overall experience and 5+years of experience on AWS. I have worked on most of the AWS services. I will be able to help you to develop the solution. If interested please contact.

I am having 6 years of experience in various AWS services like Glue, S3, Redshift, lambda, step function etc. Also having good experience in pyspark, python, postgresql, shell scripting etc. I have very good hands-on experience in Glue job creation. I have worked on various file formats like parquet, glueparquet, orc, csv, avro, json etc. I can help you to set up Glue Jobs, along with catalog objects - Crawler, Connection, databases and tables for both S3 and any of the database. Looking forward to discuss more on the requirements. Thanks.