Senior Data Engineer (Databricks & Azure)
Compass UOL
Descrição da vaga Buscamos um(a) profissional com experiência em plataformas analíticas modernas, especialmente Databricks e Azure Data Lake, para atuar na construção, governança e sustentação de ambientes de consumo analítico corporativo. A pessoa será responsável por garantir escalabilidade, rastreabilidade e alta disponibilidade dos dados, suportando dashboards executivos, soluções de BI e aplicações analíticas dentro de um ecossistema Lakehouse. Responsabilidades e atribuições Estruturar e sustentar a camada de consumo e monitoramento analítico da plataforma Implementar e administrar ambientes de consulta utilizando Databricks SQL Warehouse Garantir a separação entre camadas de processamento e consumo analítico Disponibilizar datasets governados para Power BI e demais aplicações corporativas Atuar na integração entre Databricks, Power BI e Azure Data Lake Storage (ADLS) Gerenciar armazenamento histórico e persistência utilizando Delta Lake Garantir rastreabilidade, auditoria e capacidade de reprocessamento dos dados Estruturar estratégias de armazenamento RAW, curated e histórico no Lakehouse Implementar práticas de monitoramento, governança e observabilidade de dados Apoiar áreas de negócio e analytics na construção de dashboards executivos e indicadores estratégicos Requisitos e qualificações Obrigatórios Experiência com Databricks SQL Warehouse Conhecimento em arquitetura Lakehouse Experiência com Azure Data Lake Storage (ADLS) Conhecimento em Delta Lake e tabelas Delta Experiência com Power BI e modelagem analítica Domínio de SQL avançado Experiência com pipelines ETL/ELT Vivência em governança, qualidade e monitoramento de dados Experiência com ambiente Cloud Azure Diferenciais Experiência com Unity Catalog (Databricks) Conhecimento em DataOps / MLOps Experiência com ferramentas de orquestração (ex: Azure Data Factory) Noções de segurança e controle de acesso em dados (RBAC/ABAC) Sobre a empresa Become a Compasser, be part of AI/R. Compass UOL is a global firm and part of the AI Revolution Company, together transforming organizations using Artificial Intelligence, Generative AI, and other of today's most advanced techno logies.We equip our team with proprietary and external AI-driven tools to design and build digital-native platforms, integrating cutting-edge technologies and enabling companies to innovate, transform their businesses, and drive success in their m arkets.To achieve this, we attract and develop the best talent, creating opportunities that enhance people's lives and highlight the positive impact of disruptive techno logies.We empower borderless talent and promote knowledge and opportunities in the latest market trends, driving significant personal and professional growth.
Vaga publicada há 13 dias atrás
Empregos semelhantes que podem ser interessantes para vocêCom base na vaga Senior Data Engineer (Databricks & Azure) em Três Lagoas, MS
- ...vaga Estamos em busca de um(a) Engenheiro(a) de Dados Sênior para atuar no desenvolvimento, evolução e sustentação de... ...Desenvolver, evoluir e manter pipelines de dados em ambientes Azure, GCP e Databricks , garantindo eficiência, performance e confiabilidade;...
- ...environment. We are looking for a Senior Data Engineer. We are looking for an experienced... ...optimize data storage solutions (Azure Data Lake, SQL Database, Delta Lake).... ...Azure ecosystem (ADF, Data Lake, Databricks, SQL DB, Cosmos DB). Proficiency in...
- Lead / Architect Data Engineer (Azure Stack) Location: Remote Working Hours: Overlap until 8:00 PM... ...technical strategies, mentor mid-to-senior engineers, and act as a trusted advisor... ...Azure Data Lake Storage (ADLS), Azure Databricks, and pySpark . Database Administration...
- ...Data Engineer Brazil Data Analyst II Important Information Location: Brazil Job Mode: Full-time Work Mode: Work from home... ..., or dbt). Highly Desirable Skills Cloud knowledge (AWS/Azure/GCP) regarding data storage (S3/Blob); Experience with Python...
- ...in a collaborative environment. We are looking for a Data Engineer Senior (Data Backbone) . In this role you will: Act as the go-... ...CI/CD: Terraform, Jenkins Other Cloud Platforms (Optional): Azure, Google Cloud Soft Skills: Strong communication skills, Problem...
- ...pipelines de dados escaláveis com foco em ingestão via CDC (Change Data Capture) utilizando Oracle GoldenGate; Configurar e... ...emanter pipelines de processamento de dados utilizando Azure e Databricks (Spark); Implementar transformações seguindo arquitetura...
- Opportunity – Data Engineer (Senior) | Brazil | Remote Hi everyone, We are currently looking for a Senior Data Engineer to join a global project supporting a leading multinational company. This role is ideal for someone who enjoys working at the intersection of data engineering...
- ...Job Title: Azure DevOps Engineer Location: Brazil (Remote) Mode: Full-Time Job Description: ~10 Years of experience in cloud migration... ...applications Experience in migrating modernization of Applications and Data Expertise in at least one cloud platform Azure AWS or GCP...
- ...contract, permanent or project management based resources. Title: Data Engineer Location : Remote from anywhere in Brazil as long as... ...implement cloud-based data solutions on platforms such as AWS, Azure, or Google Cloud. Collaborate with cross-functional teams to...
- ...vocabularies Run CLI-based workflows to upload metadata and processed data into databases Write SQL, shell, and Python scripts to... ...Coordinate with scientists, bioinformaticians, and data engineers to ensure metadata quality and usability Mandatory Skills...
- ...community across 100+ countries. Introduction: We are seeking a Senior Data Analyst to join our global advanced analytics team. In this... ..., modeling, validation, and reporting. Partner with engineering, product, and analytics teams to operationalize solutions at...
- ...success in a collaborative environment. We are looking for a Senior Azure Python Full Stack Developer @ Sao Paulo - Brazil, who wants to... ...automation. Bachelor's degree in computer science, Engineering, or equivalent experience. Required Technical Skills: Backend...
- ...Senior .Net Engineer Resume: English Version only. Resume should have detailed discussion of... ...to an Agile development workflow using Azure DevOps. You will begin with automated... ...Preferred Experience with regulated or data-sensitive software environments (e.G.,...
- ...difference. What are we looking for? +3 experience as a DevOps Engineer, with experience with Azure. Solid expertise in IaC tools, including Terraform and... ...The future is waiting for you — and so are we! Personal Data collected by AUBAY PORTUGAL as Data Controller, regarding...
- ...success in a collaborative environment. We are looking for a Senior BI & Data Analyst. We are looking for a highly skilled Senior BI &... ...data insights. Experience working with cross‐functional teams (engineering, product, business). What do we offer? TCS Benefits – Brazil...
- ...degree in Computer science or Electrical engineering or related field is required Seven years... ...using CI/CD tools such as Jenkins, GoCD, Azure Devops etc. Deploying and maintaining software... ...of computer science fundamentals like data structures and algorithms. Ability to...
- ...expand ideas through the right tools, contributing to our success in a collaborative environment. We are looking for Mid-Level Data Engineer who wants to learn and transform his career In this role you wil l:Design and Improve an AWS Serverless DataLake architecture to...
- ...Role Summary The Lead AWS Data Engineer provides technical leadership and hands‐on execution for enterprise data platforms hosted on Amazon Web Services (AWS). This role leads the design, migration, modernization, and operation of cloud‐native data architectures supporting...
- ...directly into applications and workflows. Their API-first, developer-first platform turns complex data into faster, smarter, actionable decision As a Solutions Engineer, you will be a key technical partner to our Account Executives, helping to prove the value during...
- ...conversational, predictive, and agentic intelligence directly into applications and workflows. Their API-first, developer-first platform turns complex data into faster, smarter, actionable decision As a Solutions Engineer, you will be a key technical partner to our...
- ...package management, and Twig templating engine. ~ API Experience: 3+ years experience... ...in microservices-based architectures. ~ Data & Search: Strong SQL skills and hands-on... ...frameworks and languages. We are seeking a Senior Software Engineer to be a key member of...
- ...environment. We are looking for Data Architect (Azure) who wants to learn and transform... ...and performance Collaborate with data engineers, analysts, and platform teams to support... ...: Cloud Platforms & Services: Azure Databricks, Azure Data Factory, Azure Synapse,...
- ...Team The Cint Technology team is looking for a Senior Software Engineer II to join our international Measurement team.... ...Spring framework, microservices Background in data analytics tools such as Spark, Hive, Databricks, or similar Additional Information Our...
- ...looking for? 8+ years of experience in Data, AI, or Machine Learning Engineering roles; 3+ years of experience... ...scale; Strong hands-on experience with Databricks, Apache Spark, Python, and SQL;... ...Experience with cloud platforms (AWS, Azure, or GCP); Proven ability to deploy...
- Key Responsibilities: Automate data quality and reconciliation checks across varied storage layers, including Snowflake, SQL, and RDF... ...APIs, GraphQL, and AWS APIs (specifically S3) Must Haves: Data engineering & data testing: dbt, data lakehouse concepts, Medallion...
- We are seeking a full-time, remote Senior AI Engineer with 5+ years of software development experience and a strong background building... ...Strong grounding in cloud-native architectures (e.g., AWS, GCP, Azure) Proven ability to stay self-motivated, work hard, own...
- ...founded in 2017 in Zürich,, we are growing fast. We connect data from 300+ sources (Facebook Ads, Google Ads, HubSpot, Salesforce... ...We are solving this problem. Role: We are looking for a Senior Python Engineer to join our team, focusing on Python services, API...
- Estamos em busca de uma pessoa Machine Learning Engineer Sênior com forte experiência em Databricks e MLflow para liderar a construção de uma nova Feature Store... ...componentes modulares e reutilizáveis (Writer, Data Quality, Feature Functions) baseados em boas práticas...
- ...completion of major projects including skyscrapers, hospitals, data centers, stadiums, and schools. It streamlines the management of... ...schemas that power the federated API gateway Partner with Engineering, Product, and UX to design and build solutions that address user...
- ...Java Software Engineer, AI Imaging (Backend) About the Company Our client is a retail AI platform powering real-world, repeatable success... ...'t just what their AI can generate but the 10+ years of retail data, workflows, tools, experts, and QA systems behind it. These are...
Deseja receber mais vagas?
Assine e receba vagas semelhantes a Senior Data Engineer (Databricks & Azure). Seja o primeiro a se candidatar!
