Senior Data Engineer (Databricks & Azure)
Compass UOL
Descrição da vaga
Buscamos um(a) profissional com experiência em plataformas analíticas modernas, especialmente Databricks e Azure Data Lake, para atuar na construção, governança e sustentação de ambientes de consumo analítico corporativo.
A pessoa será responsável por garantir escalabilidade, rastreabilidade e alta disponibilidade dos dados, suportando dashboards executivos, soluções de BI e aplicações analíticas dentro de um ecossistema Lakehouse. Responsabilidades e atribuições
Estruturar e sustentar a camada de consumo e monitoramento analítico da plataforma
Implementar e administrar ambientes de consulta utilizando Databricks SQL Warehouse
Garantir a separação entre camadas de processamento e consumo analítico
Disponibilizar datasets governados para Power BI e demais aplicações corporativas
Atuar na integração entre Databricks, Power BI e Azure Data Lake Storage (ADLS)
Gerenciar armazenamento histórico e persistência utilizando Delta Lake
Garantir rastreabilidade, auditoria e capacidade de reprocessamento dos dados
Estruturar estratégias de armazenamento RAW, curated e histórico no Lakehouse
Implementar práticas de monitoramento, governança e observabilidade de dados
Apoiar áreas de negócio e analytics na construção de dashboards executivos e indicadores estratégicos Requisitos e qualificações
Obrigatórios
Experiência com Databricks SQL Warehouse
Conhecimento em arquitetura Lakehouse
Experiência com Azure Data Lake Storage (ADLS)
Conhecimento em Delta Lake e tabelas Delta
Experiência com Power BI e modelagem analítica
Domínio de SQL avançado
Experiência com pipelines ETL/ELT
Vivência em governança, qualidade e monitoramento de dados
Experiência com ambiente Cloud Azure Diferenciais
Experiência com Unity Catalog (Databricks)
Conhecimento em DataOps / MLOps
Experiência com ferramentas de orquestração (ex: Azure Data Factory)
Noções de segurança e controle de acesso em dados (RBAC/ABAC) Sobre a empresa
Become a Compasser, be part of AI/R.
Compass UOL is a global firm and part of the AI Revolution Company, together transforming organizations using Artificial Intelligence, Generative AI, and other of today’s most advanced techno
logies.We equip our team with proprietary and external AI-driven tools to design and build digital-native platforms, integrating cutting-edge technologies and enabling companies to innovate, transform their businesses, and drive success in their m
arkets.To achieve this, we attract and develop the best talent, creating opportunities that enhance people’s lives and highlight the positive impact of disruptive techno
logies.We empower borderless talent and promote knowledge and opportunities in the latest market trends, driving significant personal and professional growth.
Vaga publicada há 13 dias atrás
Empregos semelhantes que podem ser interessantes para vocêCom base na vaga Senior Data Engineer (Databricks & Azure) em Ananindeua, PA
- ...vaga Estamos em busca de um(a) Engenheiro(a) de Dados Sênior para atuar no desenvolvimento, evolução e sustentação de... ...Desenvolver, evoluir e manter pipelines de dados em ambientes Azure, GCP e Databricks , garantindo eficiência, performance e confiabilidade;...
- ...environment. We are looking for a Senior Data Engineer. We are looking for an experienced... ...optimize data storage solutions (Azure Data Lake, SQL Database, Delta Lake).... ...Azure ecosystem (ADF, Data Lake, Databricks, SQL DB, Cosmos DB). Proficiency in...
- ...in a collaborative environment. We are looking for a Senior Data Engineer (API). We are looking for a highly skilled Senior Data... ...data, and infrastructure layers . Deploy solutions on Azure (SQL Server, Redis, App Services, API Management). Develop...
- Data Engineer Brazil Data Analyst II Important Information Location: Brazil Job Mode: Full-time Work Mode: Work from home Job Summary... ..., or dbt). Highly Desirable Skills Cloud knowledge (AWS/Azure/GCP) regarding data storage (S3/Blob); Experience with Python...
- ...in a collaborative environment. We are looking for a Data Engineer Senior (Data Backbone) . In this role you will: Act as the go-... ...CI/CD: Terraform, Jenkins Other Cloud Platforms (Optional): Azure, Google Cloud Soft Skills: Strong communication skills, Problem...
- ...pipelines de dados escaláveis com foco em ingestão via CDC (Change Data Capture) utilizando Oracle GoldenGate; Configurar e... ...Desenvolver e manter pipelines de processamento de dados utilizando Azure e Databricks (Spark); Implementar transformações seguindo arquitetura...
- Opportunity – Data Engineer (Senior) | Brazil | Remote Hi everyone, We are currently looking for a Senior Data Engineer to join a global project supporting a leading multinational company. This role is ideal for someone who enjoys working at the intersection of data...
- Job Title: Azure DevOps Engineer Location: Brazil (Remote) Mode: Full-Time Job Description: 10 Years of experience in cloud migration of on-prem... ...Experience in migrating modernization of Applications and Data Expertise in at least one cloud platform Azure AWS or GCP Excellent...
- ...contract, permanent or project management based resources. Title: Data Engineer Location : Remote from anywhere in Brazil as long as... ...implement cloud-based data solutions on platforms such as AWS, Azure, or Google Cloud. Collaborate with cross-functional teams to...
- ...across 100+ countries. Introduction: We are seeking a Senior Data Analyst to join our global advanced analytics team. In this... ...preparation, modeling, validation, and reporting. Partner with engineering, product, and analytics teams to operationalize solutions at...
- ...in a collaborative environment. We are looking for a Senior BI & Data Analyst . We are looking for a highly skilled Senior... ...insights . Experience working with cross‑functional teams (engineering, product, business). What do we offer? TCS Benefits –...
- ...success in a collaborative environment. We are looking for a Senior Azure Python Full Stack Developer @ Sao Paulo - Brazil, who... ...automation. Bachelor’s degree in computer science, Engineering, or equivalent experience. Required Technical Skills: Backend...
- Senior .Net Engineer Resume: English Version only. Resume should have detailed discussion of... ...to an Agile development workflow using Azure DevOps. You will begin with automated testing... ...Preferred Experience with regulated or data-sensitive software environments (e.g.,...
- ...vocabularies Run CLI-based workflows to upload metadata and processed data into databases Write SQL, shell, and Python scripts to validate... ...Coordinate with scientists, bioinformaticians, and data engineers to ensure metadata quality and usability Mandatory Skills...
- ...difference. What are we looking for? +3 experience as a DevOps Engineer, with experience with Azure. Solid expertise in IaC tools, including Terraform and... ...future is waiting for you — and so are we! Personal Data collected by AUBAY PORTUGAL as Data Controller, regarding...
- ...Key Responsibilities: Automate data quality and reconciliation checks across varied storage layers, including Snowflake, SQL,... ...GraphQL, and AWS APIs (specifically S3) Must Haves: Data engineering & data testing: dbt, data lakehouse concepts, Medallion...
- ...We are looking for a Senior Cloud Engineer to join an international team and work remotely from Brazil, supporting global cloud infrastructure... ...complex cloud infrastructure solutions ~ Strong expertise with Azure Cloud (experience with other cloud providers is a plus) ~...
- ...collaborative environment. We are looking for Mid-Level Data Enginee r who wants to learn and transform his career In... ...timeline s;Mentor and provide technical guidance to junior data engineers, fostering their growth and ensuring adherence to best practice...
- Role Summary The Lead AWS Data Engineer provides technical leadership and hands‑on execution for enterprise data platforms hosted on Amazon Web Services (AWS) . This role leads the design, migration, modernization, and operation of cloud‑native data architectures...
- ...The Cint Technology team is looking for a Senior Software Engineer II to join our international Measurement team. This... ...Spring framework, microservices Background in data analytics tools such as Spark, Hive, Databricks, or similar Additional Information Our...
- ...collaborative environment. We are looking for Data Architect (Azure) who wants to learn and transform his... ...performance Collaborate with data engineers, analysts, and platform teams to... ...Cloud Platforms & Services: Azure Databricks, Azure Data Factory, Azure Synapse,...
- ...história e 16x eleita uma das melhores empresas para se trabalhar em tecnologia no Brasil (GPTW). Estamos buscando um(a) Senior Full Stack Engineer para atuar alocado(a) em um dos nossos grandes clientes do segmento de tecnologia e informação, com produtos utilizados...
- ...founded in 2017 in Zürich, , we are growing fast. We connect data from 300+ sources (Facebook Ads, Google Ads, HubSpot,... ...We are solving this problem. Role: We are looking for a Senior Python Engineer to join our team, focusing on Python services, API integrations...
- ...package management, and Twig templating engine. API Experience: 3+ years experience designing... ...in microservices-based architectures. Data & Search: Strong SQL skills and hands-... ...and languages. We are seeking a Senior Software Engineer to be a key member of...
- ...Business Intelligence platform enabling customers to connect multiple data sources (e.G., Excel, SQL) into a unified environment, build... ..., and Infra. About Role and Team: As a Technical Support Engineer you will work with leading enterprise organizations and startups...
- ...Senior Backend Engineer (PHP/Laravel) Location: Brazil About Sphise Technologies Sphise Technologies is a global outsourcing and... ...by implementing and maintaining robust security measures and data protection protocols. Additional Responsibilities:...
- Estamos em busca de uma pessoa Machine Learning Engineer Sênior com forte experiência em Databricks e MLflow para liderar a construção de uma nova Feature Store... ...componentes modulares e reutilizáveis (Writer, Data Quality, Feature Functions) baseados em boas práticas...
- We are seeking a full-time, remote Senior AI Engineer with 5+ years of software development experience and a strong background building... ...Strong grounding in cloud-native architectures (e.g., AWS, GCP, Azure) Proven ability to stay self-motivated, work hard, own...
- ...directly into applications and workflows. Their API-first, developer-first platform turns complex data into faster, smarter, actionable decision As a Solutions Engineer, you will be a key technical partner to our Account Executives, helping to prove the value during...
- We're looking for a kind, curious, and collaborative Senior Software Engineer to join our Customer Experience team. You'll build seamless, high-quality experiences for consignment and luxury retail, while mentoring engineers and influencing engineering direction. What...
Deseja receber mais vagas?
Assine e receba vagas semelhantes a Senior Data Engineer (Databricks & Azure). Seja o primeiro a se candidatar!
