Senior Data Engineer (Databricks & Azure)
Jobtome
Descrição da vaga
Buscamos um(a) profissional com experiência em plataformas analíticas modernas, especialmente Databricks e Azure Data Lake, para atuar na construção, governança e sustentação de ambientes de consumo analítico corporativo.
A pessoa será responsável por garantir escalabilidade, rastreabilidade e alta disponibilidade dos dados, suportando dashboards executivos, soluções de BI e aplicações analíticas dentro de um ecossistema Lakehouse.
Responsabilidades e atribuições
- Estruturar e sustentar a camada de consumo e monitoramento analítico da plataforma
- Implementar e administrar ambientes de consulta utilizando Databricks SQL Warehouse
- Garantir a separação entre camadas de processamento e consumo analítico
- Disponibilizar datasets governados para Power BI e demais aplicações corporativas
- Atuar na integração entre Databricks, Power BI e Azure Data Lake Storage (ADLS)
- Gerenciar armazenamento histórico e persistência utilizando Delta Lake
- Garantir rastreabilidade, auditoria e capacidade de reprocessamento dos dados
- Estruturar estratégias de armazenamento RAW, curated e histórico no Lakehouse
- Implementar práticas de monitoramento, governança e observabilidade de dados
- Apoiar áreas de negócio e analytics na construção de dashboards executivos e indicadores estratégicos
Requisitos e qualificações
Obrigatórios
- Experiência com Databricks SQL Warehouse
- Conhecimento em arquitetura Lakehouse
- Experiência com Azure Data Lake Storage (ADLS)
- Conhecimento em Delta Lake e tabelas Delta
- Experiência com Power BI e modelagem analítica
- Domínio de SQL avançado
- Experiência com pipelines ETL/ELT
- Vivência em governança, qualidade e monitoramento de dados
- Experiência com ambiente Cloud Azure
Diferenciais
- Experiência com Unity Catalog (Databricks)
- Conhecimento em DataOps / MLOps
- Experiência com ferramentas de orquestração (ex: Azure Data Factory)
- Noções de segurança e controle de acesso em dados (RBAC/ABAC)
Sobre a empresa
Become a Compasser, be part of AI/R.
Compass UOL is a global firm and part of the AI Revolution Company, together transforming organizations using Artificial Intelligence, Generative AI, and other of today’s most advanced techno
logies.We equip our team with proprietary and external AI-driven tools to design and build digital-native platforms, integrating cutting-edge technologies and enabling companies to innovate, transform their businesses, and drive success in their m
arkets.To achieve this, we attract and develop the best talent, creating opportunities that enhance people’s lives and highlight the positive impact of disruptive techno
logies.We empower borderless talent and promote knowledge and opportunities in the latest market trends, driving significant personal and professional
growth.
Vaga publicada há 7 dias atrás
Empregos semelhantes que podem ser interessantes para vocêCom base na vaga Senior Data Engineer (Databricks & Azure) em Duque de Caxias, RJ
- Descrição da vaga Estamos em busca de um(a) Engenheiro(a) de Dados Sênior para atuar no desenvolvimento, evolução e sustentação de... ..., evoluir e manter pipelines de dados em ambientes Azure, GCP e Databricks , garantindo eficiência, performance e confiabilidade; Estruturar...
- ...collaborative environment. We are looking for a Senior Data Engineer. We are looking for an experienced... ...and optimize data storage solutions (Azure Data Lake, SQL Database, Delta Lake).... ...the Azure ecosystem (ADF, Data Lake, Databricks, SQL DB, Cosmos DB). - Proficiency in...
- ...Lead / Architect Data Engineer (Azure Stack) Location: Remote Working Hours: Overlap until 8:... ...Define technical strategies, mentor mid-to-senior engineers, and act as a trusted... ...Azure Data Lake Storage (ADLS), Azure Databricks, and pySpark. Database Administration...
- Data Engineer Brazil Data Analyst II Important Information Location: Brazil Job Mode: Full-time Work Mode: Work from home Job Summary... ..., or dbt). Highly Desirable Skills Cloud knowledge (AWS/Azure/GCP) regarding data storage (S3/Blob); Experience with Python...
- ...success in a collaborative environment. We are looking for a Data Engineer Senior (Data Backbone) . In this role you will: Act as the go-to... ...CI/CD: Terraform, Jenkins Other Cloud Platforms (Optional): Azure, Google Cloud Soft Skills: Strong communication skills, Problem...
- ...pipelines de dados escaláveis com foco em ingestão via CDC (Change Data Capture) utilizando Oracle GoldenGate; Configurar e... ...Desenvolver e manter pipelines de processamento de dados utilizando Azure e Databricks (Spark); Implementar transformações seguindo arquitetura...
- ...Opportunity – Data Engineer (Senior) | Brazil | Remote Hi everyone, We are currently looking for a Senior Data Engineer to join a global project supporting a leading multinational company. This role is ideal for someone who enjoys working at the intersection of...
- Job Title: Azure DevOps Engineer Location: Brazil (Remote) Mode: Full-Time Job Description: 10 Years of experience in cloud migration of on-prem... ...Experience in migrating modernization of Applications and Data Expertise in at least one cloud platform Azure AWS or GCP Excellent...
- ...contract, permanent or project management based resources. Title: Data Engineer Location : Remote from anywhere in Brazil as long as candidate... ...cloud-based data solutions on platforms such as AWS, Azure, or Google Cloud. Collaborate with cross-functional teams to understand...
- ...across 100+ countries. Introduction: We are seeking a Senior Data Analyst to join our global advanced analytics team. In this... ...preparation, modeling, validation, and reporting. Partner with engineering, product, and analytics teams to operationalize solutions at...
- ...success in a collaborative environment. We are looking for a Senior Azure Python Full Stack Developer @ Sao Paulo - Brazil, who... ...automation. Bachelor’s degree in computer science, Engineering, or equivalent experience. Required Technical Skills: Backend...
- ...vocabularies Run CLI-based workflows to upload metadata and processed data into databases Write SQL, shell, and Python scripts to validate... ...Coordinate with scientists, bioinformaticians, and data engineers to ensure metadata quality and usability Mandatory Skills : SQL...
- ...in a collaborative environment. We are looking for a Senior BI & Data Analyst . We are looking for a highly skilled Senior... ...insights . Experience working with cross‑functional teams (engineering, product, business). What do we offer? TCS Benefits –...
- ...difference. What are we looking for? +3 experience as a DevOps Engineer, with experience with Azure. Solid expertise in IaC tools, including Terraform and... ...The future is waiting for you — and so are we! Personal Data collected by AUBAY PORTUGAL as Data Controller, regarding...
- Senior .Net Engineer Resume: English Version only. Resume should have detailed discussion of... ...to an Agile development workflow using Azure DevOps. You will begin with automated testing... ...Preferred Experience with regulated or data-sensitive software environments (e.g.,...
- ...expand ideas through the right tools, contributing to our success in a collaborative environment. We are looking for Mid-Level Data Engineer who wants to learn and transform his career In this role you wil l:Design and Improve an AWS Serverless DataLake architecture to...
- ...degree in Computer science or Electrical engineering or related field is required Seven years... ...using CI/CD tools such as Jenkins, GoCD, Azure Devops etc. Deploying and maintaining software... ...of computer science fundamentals like data structures and algorithms. Ability to...
- Role Summary The Lead AWS Data Engineer provides technical leadership and hands‐on execution for enterprise data platforms hosted on Amazon Web Services (AWS). This role leads the design, migration, modernization, and operation of cloud‐native data architectures supporting...
- ...package management, and Twig templating engine. API Experience: 3+ years experience designing... ...in microservices-based architectures. Data & Search: Strong SQL skills and hands-... ...and languages. We are seeking a Senior Software Engineer to be a key member of...
- ...environment. We are looking for Data Architect (Azure) who wants to learn and transform... ...and performance Collaborate with data engineers, analysts, and platform teams to support... ...: Cloud Platforms & Services: Azure Databricks, Azure Data Factory, Azure Synapse,...
- ...Team The Cint Technology team is looking for a Senior Software Engineer II to join our international Measurement team. This... ...: Spring framework, microservices Background in data analytics tools such as Spark, Hive, Databricks, or similar Additional Information Our Values...
- ...looking for? 8+ years of experience in Data, AI, or Machine Learning Engineering roles; 3+ years of experience... ...scale; Strong hands-on experience with Databricks, Apache Spark, Python, and SQL;... ...Experience with cloud platforms (AWS, Azure, or GCP); Proven ability to deploy...
- Key Responsibilities: Automate data quality and reconciliation checks across varied storage layers, including Snowflake, SQL, and RDF... ...APIs, GraphQL, and AWS APIs (specifically S3) Must Haves: Data engineering & data testing: dbt, data lakehouse concepts, Medallion...
- We are seeking a full-time, remote Senior AI Engineer with 5+ years of software development experience and a strong background building AI native... ...grounding in cloud-native architectures (e.g., AWS, GCP, Azure) Proven ability to stay self-motivated, work hard, own problems...
- Estamos em busca de uma pessoa Machine Learning Engineer Sênior com forte experiência em Databricks e MLflow para liderar a construção de uma nova Feature Store... ...componentes modulares e reutilizáveis (Writer, Data Quality, Feature Functions) baseados em boas práticas...
- ...directly into applications and workflows. Their API-first, developer-first platform turns complex data into faster, smarter, actionable decision As a Solutions Engineer, you will be a key technical partner to our Account Executives, helping to prove the value during...
- ...completion of major projects including skyscrapers, hospitals, data centers, stadiums, and schools. It streamlines the management of... ...schemas that power the federated API gateway Partner with Engineering, Product, and UX to design and build solutions that address user...
R$ 10.000
Java Software Engineer, AI Imaging (Backend) About the Company Our client is a retail AI platform powering real-world, repeatable success... ...’t just what their AI can generate but the 10+ years of retail data, workflows, tools, experts, and QA systems behind it. These are...- We're looking for a kind, curious, and collaborative Senior Software Engineer to join our Customer Experience team. You'll build seamless, high-quality experiences for consignment and luxury retail, while mentoring engineers and influencing engineering direction. What...
- ...Business Intelligence platform enabling customers to connect multiple data sources (e.G., Excel, SQL) into a unified environment, build... ..., and Infra. About Role and Team: As a Technical Support Engineer you will work with leading enterprise organizations and startups...
Deseja receber mais vagas?
Assine e receba vagas semelhantes a Senior Data Engineer (Databricks & Azure). Seja o primeiro a se candidatar!
