Senior Data Engineer (Databricks & Azure)
Jobtome
Descrição da vaga
Buscamos um(a) profissional com experiência em plataformas analíticas modernas, especialmente Databricks e Azure Data Lake, para atuar na construção, governança e sustentação de ambientes de consumo analítico corporativo.
A pessoa será responsável por garantir escalabilidade, rastreabilidade e alta disponibilidade dos dados, suportando dashboards executivos, soluções de BI e aplicações analíticas dentro de um ecossistema Lakehouse.
Responsabilidades e atribuições
- Estruturar e sustentar a camada de consumo e monitoramento analítico da plataforma
- Implementar e administrar ambientes de consulta utilizando Databricks SQL Warehouse
- Garantir a separação entre camadas de processamento e consumo analítico
- Disponibilizar datasets governados para Power BI e demais aplicações corporativas
- Atuar na integração entre Databricks, Power BI e Azure Data Lake Storage (ADLS)
- Gerenciar armazenamento histórico e persistência utilizando Delta Lake
- Garantir rastreabilidade, auditoria e capacidade de reprocessamento dos dados
- Estruturar estratégias de armazenamento RAW, curated e histórico no Lakehouse
- Implementar práticas de monitoramento, governança e observabilidade de dados
- Apoiar áreas de negócio e analytics na construção de dashboards executivos e indicadores estratégicos
Requisitos e qualificações
Obrigatórios
- Experiência com Databricks SQL Warehouse
- Conhecimento em arquitetura Lakehouse
- Experiência com Azure Data Lake Storage (ADLS)
- Conhecimento em Delta Lake e tabelas Delta
- Experiência com Power BI e modelagem analítica
- Domínio de SQL avançado
- Experiência com pipelines ETL/ELT
- Vivência em governança, qualidade e monitoramento de dados
- Experiência com ambiente Cloud Azure
Diferenciais
- Experiência com Unity Catalog (Databricks)
- Conhecimento em DataOps / MLOps
- Experiência com ferramentas de orquestração (ex: Azure Data Factory)
- Noções de segurança e controle de acesso em dados (RBAC/ABAC)
Sobre a empresa
Become a Compasser, be part of AI/R.
Compass UOL is a global firm and part of the AI Revolution Company, together transforming organizations using Artificial Intelligence, Generative AI, and other of today’s most advanced techno
logies.We equip our team with proprietary and external AI-driven tools to design and build digital-native platforms, integrating cutting-edge technologies and enabling companies to innovate, transform their businesses, and drive success in their m
arkets.To achieve this, we attract and develop the best talent, creating opportunities that enhance people’s lives and highlight the positive impact of disruptive techno
logies.We empower borderless talent and promote knowledge and opportunities in the latest market trends, driving significant personal and professional
growth.
Vaga publicada há 6 dias atrás
Empregos semelhantes que podem ser interessantes para vocêCom base na vaga Senior Data Engineer (Databricks & Azure) em Gaspar, SC
- ...pipelines de dados escaláveis com foco em ingestão via CDC (Change Data Capture) utilizando Oracle GoldenGate; Configurar e... ...Desenvolver e manter pipelines de processamento de dados utilizando Azure e Databricks (Spark); Implementar transformações seguindo arquitetura...
- ...vocabularies Run CLI-based workflows to upload metadata and processed data into databases Write SQL, shell, and Python scripts to... ...Coordinate with scientists, bioinformaticians, and data engineers to ensure metadata quality and usability Mandatory Skills...
- ...for? ~8+ years of experience in Data, AI, or Machine Learning Engineering roles; ~3+ years of experience... ...~ Strong hands-on experience with Databricks, Apache Spark, Python, and SQL;... ...Experience with cloud platforms (AWS, Azure, or GCP); ~ Proven ability to deploy...
- ...Senior .Net Engineer Resume: English Version only. Resume should have detailed discussion of... ...to an Agile development workflow using Azure DevOps. You will begin with automated... ...Preferred Experience with regulated or data-sensitive software environments (e.G.,...
- We are looking for a Senior Cloud Engineer to join an international team and work remotely from Brazil, supporting global cloud infrastructure... ...complex cloud infrastructure solutions Strong expertise with Azure Cloud (experience with other cloud providers is a plus)...
- ...história e 16x eleita uma das melhores empresas para se trabalhar em tecnologia no Brasil (GPTW). Estamos buscando um(a) Senior Full Stack Engineer para atuar alocado(a) em um dos nossos grandes clientes do segmento de tecnologia e informação, com produtos utilizados...
- ...Estamos em busca de uma pessoa Machine Learning Engineer Sênior com forte experiência em Databricks e MLflow para liderar a construção de uma nova Feature Store... ...componentes modulares e reutilizáveis (Writer, Data Quality, Feature Functions) baseados em boas práticas...
- ...environment. We are looking for Data Architect (Azure) who wants to learn and transform... ...and performance Collaborate with data engineers, analysts, and platform teams to support... ...: Cloud Platforms & Services: Azure Databricks, Azure Data Factory, Azure Synapse,...
- ...Business Intelligence platform enabling customers to connect multiple data sources (e.g., Excel, SQL) into a unified environment, build... ..., and Infra. About Role and Team: As a Technical Support Engineer you will work with leading enterprise organizations and...
- ...environment. We are looking for Data Architect who wants to learn and transform... ...performance Collaborate with data engineers, analysts, and platform teams to... ...Skills : Cloud Platforms & Services: Azure Databricks, Azure Data Factory, Azure Synapse, Azure...
- ML/AI Engineer (Databricks) Location: Remote (Brazil) | Type: Contract | Experience... ...top of a modern Databricks data platform. You'll work close... ...Spark and Delta Lake (Azure Databricks is a plus) Comfort... ...Us You'll join a small, senior team that has been steadily...
- ...Senior Front End Engineer About Sphise Technologies Sphise Technologies is a global outsourcing and talent solutions company, partnering with high-growth businesses to build strong, high-impact teams across finance, technology, and operations. For one of our...
- ...Contract: Senior AI / Agentic AI Engineer Location: Brazil (Remote/Hybrid) Key... ...solutions Collaborate with Data Engineering teams to... ...Large Language Models (OpenAI, Azure OpenAI, Anthropic, or similar... ...similar Azure OpenAI Databricks MLflow MLOps Knowledge...
- ...Position Summary The Data Analyst supports the company’s data and analytics initiatives by designing, developing, and... ...statistical techniques to support business planning. Leverage Azure Data Factory, Databricks, and Microsoft Fabric to support advanced analytics...
- ...Job Title: AI Engineer Location: Remote (Brazil) Mode: Full... ...of 5+ years of experience on Azure having technically guided, managed... ...and practices in AI, data engineering, and large data processions... ...Data Scientist Associate Databricks Professional Certificate in...
- Vaga: Staff Full Stack Software Engineer – Marketing Automation & Data Pipelines Estamos em busca de um(a) Staff Full Stack Software Engineer para... ...Power BI. Procuramos uma pessoa com perfil técnico sênior/staff, visão arquitetural, boa comunicação e capacidade...
- Role: Azure Migration Architect (Windows Architect) Location: Brazil (Remote) Mode: Full-Time Competency P5 for Architecture Role Over all 13 years of IT experience with 5 years in Azure Infra Database Migration Experience leading and managing technical teams 5 members...
- ...Jobbex It, a company that empowers people & organizations by matching great talents to great projects is looking for the next Senior IBM Maximo Engineer (Relocation to Portugal) to help one of our clients. If you feel inspired to make a change and if you want to be...
- ...IT Project Manager – Data Migration | Banking & Treasury Join NFQ! We are a global consulting firm specialized in business,... ...reconciliation Strong SQL and data analysis skills Experience with Azure, Databricks, Hadoop, or cloud data platforms Experience coordinating...
- ...projetos de dados de média e alta complexidade (data warehouse, data lake, ETL/ELT, BI,... ...Experiência com ferramentas de gestão (Jira, Azure DevOps, Monday, Asana ou similares).... ...Background técnico prévio (Data Analyst, Data Engineer ou BI Developer). Experiência com...
- ...success in a collaborative environment. We are looking for a Data Scientist PhD or MSc . In this role you will: Design,... ...false positives Collaborate with cross-functional teams (engineering, product, manufacturing) Develop scalable and robust data science...
- ...Sr. Workday Application Engineer – Workday Integrations (Corporate Services) Overview Join a leading retail organization as a Senior Application Engineer focused on Workday integrations... ...strategy, standards, and roadmap Own data flow and connectivity for employee (P&...
- ...qualidade no processo seletivo, baixo Turn Over e isenção de riscos e passivos trabalhistas. O que Buscamos? Arquiteto de soluções Azure/IA Descrição: Estamos procurando um(a) Arquiteto de soluções Azure/IA para ajudar clientes a levar suas aplicações com IA para escala...
- We are looking for a Senior Generative AI Engineer to join the Customer Delivery team at CI&T. This person will work embedded within strategic client... ...databases. Experience with cloud platforms such as Azure, AWS, or GCP, including AI services like Azure OpenAI, AWS...
- ...About YipitData: YipitData is the market-leading data and analytics firm. We analyze billions of data points every day to provide... ...generated outputs. Collaborate cross-functionally with Research, Engineering, and other teams — coordinating across functions to unblock...
- Site Reliability Engineer We are looking for a full-time, remote Site Reliability / DevOps... ...provide enterprise-wide visibility and data-driven insights that fuel asset... ...and optimize CI/CD pipelines using Azure DevOps + AWS integrations Analyze and manage...
- ...For our international customer in Valencia, we are looking for a ServiceNow Application Portfolio Management (APM) & Data Quality Engineer. The role focuses on ongoing APM data maintenance in ServiceNow (APM/CMDB-related records as applicable), identifying data gaps and...
- Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4 out of 5 of the world’s biggest technology companies, as well as leading...
- Buscamos um(a) AI Engineer para atuar no coração do Sankhya RH, sendo a ponte de integração... ...desde o planejamento do nosso Data Lake até a transformação de protótipos de... ...ferramentas de dados modernas, como BigQuery, Databricks ou Data Lakes.Experiência prática com arquitetura...
- ...Cloud Windows Infrastructure Engineer Job Purpose As Senior Windows Infrastructure Engineer, you are the technical anchor for the Windows estate... ...↔ AWS Managed Microsoft AD, federation with Entra ID (Azure AD) / AD FS, SAML / OIDC / OAuth, Kerberos, MFA....
Deseja receber mais vagas?
Assine e receba vagas semelhantes a Senior Data Engineer (Databricks & Azure). Seja o primeiro a se candidatar!
