We are seeking a skilled ETL (Extract, Transform, Load) Engineer to join our team and lead the development of a Customer Master Project on the AWS cloud platform. The successful candidate will be responsible for designing, implementing, and optimizing ETL processes using AWS Glue, S3, Snowflake, Python, and PySpark. If you are passionate about data integration, cloud technology, and have expertise in Python and PySpark, we encourage you to apply.

Key Responsibilities:

1. ETL Design: Collaborate with the Solution Architect and business stakeholders to design ETL processes that meet business requirements and data quality standards.
2. AWS Glue Development: Develop ETL workflows and data pipelines using AWS Glue, leveraging its capabilities for data extraction, transformation, and loading.
3. Data Extraction: Extract data from various source systems, including databases, APIs, and flat files, ensuring data completeness and accuracy.
4. Data Transformation: Apply data transformation logic using Python and PySpark to standardize, cleanse, and enrich data, aligning it with the customer master data model.
5. Data Loading: Load transformed data into the Snowflake data warehouse, optimizing the loading process for efficiency and performance.
6. Data Quality: Implement data quality checks and monitoring processes to identify and resolve data anomalies or issues.
7. Documentation: Create and maintain documentation of ETL processes, data mappings, and transformations.
8. Collaboration: Collaborate with cross-functional teams, including Solution Architects, Data Analysts, and Business Analysts, to ensure data integration solutions align with project goals.