Senior Data Engineer (Databricks & Azure)
Jobtome
Descrição da vaga
Buscamos um(a) profissional com experiência em plataformas analíticas modernas, especialmente Databricks e Azure Data Lake, para atuar na construção, governança e sustentação de ambientes de consumo analítico corporativo.
A pessoa será responsável por garantir escalabilidade, rastreabilidade e alta disponibilidade dos dados, suportando dashboards executivos, soluções de BI e aplicações analíticas dentro de um ecossistema Lakehouse.
Responsabilidades e atribuições
- Estruturar e sustentar a camada de consumo e monitoramento analítico da plataforma
- Implementar e administrar ambientes de consulta utilizando Databricks SQL Warehouse
- Garantir a separação entre camadas de processamento e consumo analítico
- Disponibilizar datasets governados para Power BI e demais aplicações corporativas
- Atuar na integração entre Databricks, Power BI e Azure Data Lake Storage (ADLS)
- Gerenciar armazenamento histórico e persistência utilizando Delta Lake
- Garantir rastreabilidade, auditoria e capacidade de reprocessamento dos dados
- Estruturar estratégias de armazenamento RAW, curated e histórico no Lakehouse
- Implementar práticas de monitoramento, governança e observabilidade de dados
- Apoiar áreas de negócio e analytics na construção de dashboards executivos e indicadores estratégicos
Requisitos e qualificações
Obrigatórios
- Experiência com Databricks SQL Warehouse
- Conhecimento em arquitetura Lakehouse
- Experiência com Azure Data Lake Storage (ADLS)
- Conhecimento em Delta Lake e tabelas Delta
- Experiência com Power BI e modelagem analítica
- Domínio de SQL avançado
- Experiência com pipelines ETL/ELT
- Vivência em governança, qualidade e monitoramento de dados
- Experiência com ambiente Cloud Azure
Diferenciais
- Experiência com Unity Catalog (Databricks)
- Conhecimento em DataOps / MLOps
- Experiência com ferramentas de orquestração (ex: Azure Data Factory)
- Noções de segurança e controle de acesso em dados (RBAC/ABAC)
Sobre a empresa
Become a Compasser, be part of AI/R.
Compass UOL is a global firm and part of the AI Revolution Company, together transforming organizations using Artificial Intelligence, Generative AI, and other of today’s most advanced techno
logies.We equip our team with proprietary and external AI-driven tools to design and build digital-native platforms, integrating cutting-edge technologies and enabling companies to innovate, transform their businesses, and drive success in their m
arkets.To achieve this, we attract and develop the best talent, creating opportunities that enhance people’s lives and highlight the positive impact of disruptive techno
logies.We empower borderless talent and promote knowledge and opportunities in the latest market trends, driving significant personal and professional
growth.
Vaga publicada há 7 dias atrás
Empregos semelhantes que podem ser interessantes para vocêCom base na vaga Senior Data Engineer (Databricks & Azure) em Embu, SP
- ...vaga Estamos em busca de um(a) Engenheiro(a) de Dados Sênior para atuar no desenvolvimento, evolução e sustentação de... ...Desenvolver, evoluir e manter pipelines de dados em ambientes Azure, GCP e Databricks , garantindo eficiência, performance e confiabilidade;...
- ...Data Engineer Brazil Data Analyst II Important Information Location: Brazil Job Mode: Full-time Work Mode: Work from... ...dbt). Highly Desirable Skills Cloud knowledge (AWS/Azure/GCP) regarding data storage (S3/Blob); Experience with Python...
- ...pipelines de dados escaláveis com foco em ingestão via CDC (Change Data Capture) utilizando Oracle GoldenGate; Configurar e... ...Desenvolver e manter pipelines de processamento de dados utilizando Azure e Databricks (Spark); Implementar transformações seguindo arquitetura...
- We are looking for a Senior Cloud Engineer to join an international team and work remotely from Brazil, supporting global cloud infrastructure... ...complex cloud infrastructure solutions Strong expertise with Azure Cloud (experience with other cloud providers is a plus)...
- ...história e 16x eleita uma das melhores empresas para se trabalhar em tecnologia no Brasil (GPTW). Estamos buscando um(a) Senior Full Stack Engineer para atuar alocado(a) em um dos nossos grandes clientes do segmento de tecnologia e informação, com produtos utilizados...
- ...Senior Backend Engineer (PHP/Laravel) Location: Brazil About Sphise Technologies Sphise Technologies is a global outsourcing and... ...by implementing and maintaining robust security measures and data protection protocols. Additional Responsibilities:...
- ...What are we looking for? ~+3 experience as a DevOps Engineer, with experience with Azure. ~ Solid expertise in IaC tools, including Terraform and... ...The future is waiting for you — and so are we! Personal Data collected by AUBAY PORTUGAL as Data Controller, regarding...
- ...Estamos em busca de uma pessoa Machine Learning Engineer Sênior com forte experiência em Databricks e MLflow para liderar a construção de uma nova Feature Store... ...componentes modulares e reutilizáveis (Writer, Data Quality, Feature Functions) baseados em boas práticas...
- ...environment. We are looking for Data Architect (Azure) who wants to learn and transform... ...and performance Collaborate with data engineers, analysts, and platform teams to support... ...: Cloud Platforms & Services: Azure Databricks, Azure Data Factory, Azure Synapse,...
- ...Business Intelligence platform enabling customers to connect multiple data sources (e.G., Excel, SQL) into a unified environment, build... ..., and Infra. About Role and Team: As a Technical Support Engineer you will work with leading enterprise organizations and startups...
- ...completion of major projects including skyscrapers, hospitals, data centers, stadiums, and schools. It streamlines the management of... ...schemas that power the federated API gateway Partner with Engineering, Product, and UX to design and build solutions that address user...
- ...Java Software Engineer, AI Imaging (Backend) About the Company Our client is a retail AI platform powering real-world, repeatable... ...’t just what their AI can generate but the 10+ years of retail data, workflows, tools, experts, and QA systems behind it. These are...
- ...collaborative environment. We are looking for Data Architect who wants to learn and... ...performance Collaborate with data engineers, analysts, and platform teams to... ...Skills: Cloud Platforms & Services: Azure Databricks, Azure Data Factory, Azure Synapse, Azure...
- ...native B2B platform for hospitality. We’re looking for a Senior Machine Learning Engineer who is excited about the craft of machine learning—especially... ...design). Experience building ML solutions in practice: data understanding, feature design, training, evaluation, and...
- ...ML/AI Engineer (Databricks) Location: Remote (Brazil) | Type: Contract | Experience... ...top of a modern Databricks data platform. You'll work close... ...Spark and Delta Lake (Azure Databricks is a plus) ~ Comfort... ...Us You'll join a small, senior team that has been steadily...
- ...Contract: Senior AI / Agentic AI Engineer Location: Brazil (Remote/Hybrid) Key... ...solutions Collaborate with Data Engineering teams to... ...Large Language Models (OpenAI, Azure OpenAI, Anthropic, or similar... ...similar Azure OpenAI Databricks MLflow MLOps Knowledge...
- ...Job Title: AI Engineer Location: Remote (Brazil) Mode: Full... ...of 5+ years of experience on Azure having technically guided, managed... ...and practices in AI, data engineering, and large data processions... ...Data Scientist Associate Databricks Professional Certificate in...
- ...anywhere, in order to reduce symptoms of stress, anxiety, and depression. Role Description: Headspace is looking for a Senior Software Engineer (Fullstack with Flutter focus) to support our Employer Solutions team. This team builds the foundational capabilities that...
- Vaga: Staff Full Stack Software Engineer – Marketing Automation & Data Pipelines Estamos em busca de um(a) Staff Full Stack Software Engineer para... ...Power BI. Procuramos uma pessoa com perfil técnico sênior/staff, visão arquitetural, boa comunicação e capacidade...
- Role: Azure Migration Architect (Windows Architect) Location: Brazil (Remote) Mode: Full-Time Competency P5 for Architecture Role Over all 13 years of IT experience with 5 years in Azure Infra Database Migration Experience leading and managing technical teams 5 members...
- ...Jobbex It, a company that empowers people & organizations by matching great talents to great projects is looking for the next Senior IBM Maximo Engineer (Relocation to Portugal) to help one of our clients. If you feel inspired to make a change and if you want to be...
- ...IT Project Manager – Data Migration | Banking & Treasury Join NFQ! We are a global consulting firm specialized in business,... ...reconciliation Strong SQL and data analysis skills Experience with Azure, Databricks, Hadoop, or cloud data platforms Experience coordinating...
- ...qualidade no processo seletivo, baixo Turn Over e isenção de riscos e passivos trabalhistas. O que Buscamos? Arquiteto de soluções Azure/IA Descrição: Estamos procurando um(a) Arquiteto de soluções Azure/IA para ajudar clientes a levar suas aplicações com IA para...
- ...projetos de dados de média e alta complexidade (data warehouse, data lake, ETL/ELT, BI,... ...Experiência com ferramentas de gestão (Jira, Azure DevOps, Monday, Asana ou similares).... ...Background técnico prévio (Data Analyst, Data Engineer ou BI Developer). Experiência com...
- ...success in a collaborative environment. We are looking for a Data Scientist PhD or MSc . In this role you will: Design,... ...false positives Collaborate with cross-functional teams (engineering, product, manufacturing) Develop scalable and robust data science...
- Sr. Workday Application Engineer – Workday Integrations (Corporate Services) Overview Join a leading retail organization as a Senior Application Engineer focused on Workday integrations... ...strategy, standards, and roadmap Own data flow and connectivity for employee (P&...
- ...Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4 out of 5 of the world's biggest technology companies, as well as leading...
- We are looking for a Senior Generative AI Engineer to join the Customer Delivery team at CI&T. This person will work embedded within strategic client... ...databases. Experience with cloud platforms such as Azure, AWS, or GCP, including AI services like Azure OpenAI, AWS...
- Site Reliability Engineer We are looking for a full-time, remote Site Reliability / DevOps... ...provide enterprise-wide visibility and data-driven insights that fuel asset... ...and optimize CI/CD pipelines using Azure DevOps + AWS integrations Analyze and manage...
- ...About YipitData: YipitData is the market-leading data and analytics firm. We analyze billions of data points every day to provide... ...outputs. Collaborate cross-functionally with Research, Engineering, and other teams — coordinating across functions to unblock work...
Deseja receber mais vagas?
Assine e receba vagas semelhantes a Senior Data Engineer (Databricks & Azure). Seja o primeiro a se candidatar!
