AWS Data Platform Engineer

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a AWS Data Platform Engineer based in Brazil. We are seeking a Senior AWS Data Platform Engineer to design, build, and optimize scalable, secure, and high-performance cloud data platforms. In this role, you will develop efficient data pipelines, implement modern Data Lake and Data Fabric architectures, and help ensure data quality, security, and governance. You will work extensively with AWS data services, Python, PySpark, and SQL to deliver reliable data solutions. The position also involves automating cloud infrastructure and deployments using Terraform and infrastructure-as-code practices. You will collaborate with engineering teams to improve platform performance, reliability, and scalability in a fully remote, international environment. Accountabilities - Design, build, and manage cloud data platforms on AWS using services such as AWS Glue, EMR, Lake Formation, EC2, and CloudWatch. - Develop, maintain, and optimize data pipelines using Python, PySpark, and advanced SQL. - Implement open table formats, including Apache Hudi or Apache Iceberg, to support modern data platform architectures. - Automate infrastructure provisioning and deployment processes using Terraform and infrastructure-as-code best practices. - Implement data validation, cleansing, security, governance, and monitoring mechanisms to maintain data quality and reliability. - Monitor and optimize data platform performance, scalability, and resource utilization. - Collaborate with engineering teams and stakeholders to deliver dependable, secure, and scalable data products. - Contribute to modern data architecture initiatives and continuous improvements in cloud data engineering practices.

Requirements - Demonstrated hands-on experience designing and developing data platforms using AWS services, particularly AWS Glue, EMR, and Lake Formation. - Strong programming skills in Python and practical experience developing production-grade data engineering solutions. - Advanced SQL skills and experience building and optimizing complex data pipelines. - Experience using Apache Spark and PySpark for distributed data processing. - Hands-on experience implementing Apache Hudi or Apache Iceberg in data platforms. - Practical knowledge of Terraform and infrastructure-as-code principles for cloud infrastructure automation. - Understanding of data security, governance, quality assurance, monitoring, and performance optimization. - Advanced English proficiency at C1 level, with excellent written and verbal communication skills. - Ability to collaborate effectively with distributed engineering teams in a fully remote environment. - Experience in financial services or investment banking, real-time data processing with Apache Flink or Kafka Streams, and event-driven architectures is considered an advantage. Benefits - Competitive compensation: For Brazil, the advertised gross monthly salary is up to R$27,000 BRL , subject to the applicable compensation terms. - Fully remote work: Work remotely from Brazil. - International collaboration: Opportunity to work with engineering teams in a distributed environment. - Technical impact: Contribute to scalable AWS data platforms and modern cloud data engineering initiatives.