Inscreva-se para aceder a todos os recursos do nosso serviço
  • Pesquisa de emprego
  • Favorito
  • Criar um CV
    Novo
  • Salários
  • Alertas de emprego

Mid-Level Data Engineer

Tata Consultancy Services

Come to one of the biggest IT Services companies in the world! Here you can transform your career!

Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to our success in a collaborative environment. We are looking for Mid-Level Data Engineer who wants to learn and transform his career In this role you wil l:Design and Improve an AWS Serverless DataLake architecture to efficiently handle large volumes of data and support various data processing workflow s.Collaborate with cross-functional teams to understand business requirements, prioritize tasks, and deliver high-quality solutions within defined timeline s;Mentor and provide technical guidance to junior data engineers, fostering their growth and ensuring adherence to best practice s.Continuously evaluate new AWS services and technologies to enhance the DataLake architecture, improve data processing efficiency, and drive innovatio n.Monitor and troubleshoot the DataLake infrastructure, identifying and resolving performance bottlenecks, data processing errors, and other issue s.Optimize data storage and retrieval mechanisms, leveraging AWS services such as S3, Athena, Redshift, or DynamoDB, to provide high-performance access to the dat a.Collaborate with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the DataLak e.Demonstrated experience with container orchestration technologie s.Implement data ingestion pipelines, transformation and data enrichment processes using AWS Lambda, Glue, or similar serverless technologies to ensure data quality and consistency Mandatory Skil ls:3+ years Hands-on experience leading the modeling, development and deployment of Data & Analytics solutio ns;Agile Methodologi es;English (speake r);At least experience in 3-4 projects with Multidimensional data modeli ng;Cloud Services (AWS) data applications building and data pipelines creation/curati on;Database programming advanced level (AWS Redshift, SQLDW, Postgres, SQL exper t);Strong understanding of Linux and distributed systems is a plus;Experience with Kubernetes is requir ed;Experience with Infrastructure as Code tools (e.g., Terrafor m);Understanding of CI/CD pipelines (Jenkins) and GitOps practic es;Knowledge of application metric monitoring tools and logs (Grafana, Kibana, Cloud Logging/Log based metrics, etc );Knowledge of open-source table formats (Delta Lake and Iceber g);Previous experience on serverless architecture (Spark, glue, Lambda function s);Previous experience with Stored Procedures and UDF's and Talend to ol;Multidimensional modeling (Star Schema and Snowflake) and Data Warehouse concepts Desirable Skills High level of autonomy & good communicat ion;Opening to understand what has been required by the PO;Adaptabil ity;Good attitude and insatiable hunger for knowledge is an extreme mandatory
Vaga publicada Há 2 meses atrás

Deseja receber mais vagas?

Assine e receba vagas semelhantes a Mid-Level Data Engineer. Seja o primeiro a se candidatar!