Data Engineer - Quality Assurance
Jobtome
Key Responsibilities:
- Automate data quality and reconciliation checks across varied storage layers, including Snowflake, SQL, and RDF/SPARQL databases
- Test and verify data lineage, governance, and visualization components using Snowflake, data catalogs (ie. DataHub), Thoughtspot, and other visualization tools
- Integrate test suites into the core infrastructure orchestrated by Apache Airflow and utilizing Iceberg table formats, while monitoring data pipeline health, alerting, and observability metrics using Prometheus and Grafana Cloud
- Establish AI Evaluation Loops (Evals) and Guardrails: Build rigorous verification protocols— including structural tests, checks, and watchdog agents—to validate AI-generated artifacts, catch false positives, and ensure all automated outputs are secure, reliable, and free from hallucinations.
- Integrate automated testing workflows into CI/CD pipelines using GitHub Actions, ensuring continuous stability and quality gates across all deployment environments
- Validate ETL and dbt transformations across Data Lakehouses, rigorously testing data progression through a Medallion Architecture
- Test and automate complex API workflows, validating data payloads across OpenAPI integrations, 3rd party APIs, GraphQL, and AWS APIs (specifically S3)
Must Haves:
- Data engineering & data testing: dbt, data lakehouse concepts, Medallion architecture
- Databases & storage testing: SQL, Snowflake, AWS S3, Iceberg
- Integrating quality check into data pipelines: Apache Airflow
- API testing & automation: REST/OpenAPI, GraphQL
- Integrating test automation into CI/CD: GitHub Actions (or similar like ArgoCD/GoCD)
- Cloud / infrastructure and observability basics: Kubernetes (K8s), Prometheus, Grafana
Nice to Have:
- Graph databases: RDF / SPARQL
- Data governance & analytics tools: DataHub, Thoughtspot
- AI/ML testing & MLOps: AI evals, guardrails, RAG, vector databases, AI drift monitoring
- Advanced / emerging data tech: StarRocks, DuckDB
- Regulated environments: GxP, 21 CFR Part 11, HIPAA
- Clinical / domain-specific data standards: CDISC, ODM, FHIR
- AI-native tooling: Cursor, Claude Code, Copilot, QA Wolf
Vaga publicada há 5 dias atrás
Empregos semelhantes que podem ser interessantes para vocêCom base na vaga Data Engineer - Quality Assurance em Praia Grande, SP
- ...Key Responsibilities: Automate data quality and reconciliation checks across varied storage layers, including Snowflake, SQL, and... ...GraphQL, and AWS APIs (specifically S3) Must Haves: Data engineering & data testing: dbt, data lakehouse concepts, Medallion...
- A Genesis Consulting tem oportunidade imediata para profissional especialista em Qualidade de Softwares com verdadeira paixão por crescimento profissional e entrega de valor através da tecnologia. Nossos clientes são alguns dos principais líderes mundiais em diferentes...
- ...Join our elite team of Senior Raters as a critical contributor to high-quality validation data that directly influences product development and quality assurance for leading search engines and AI technologies. This flexible, remote opportunity allows you to apply your...
- ...organization, we are urgently looking for a Full Remote Senior Quality Assurance Analyst with strong understanding of the ServiceNow suite.... ...Azure DevOps projects; Creating and managing test cases, test data, and defects in Azure DevOps; Participating in Sprint...
- ...contract, permanent or project management based resources. Title: Data Engineer Location : Remote from anywhere in Brazil as long as... ...data requirements and deliver actionable insights. Ensure data quality, integrity, and security across all systems. Optimize data...
- ...For our international customer in Valencia, we are looking for a ServiceNow Application Portfolio Management (APM) & Data Quality Engineer. The role focuses on ongoing APM data maintenance in ServiceNow (APM/CMDB-related records as applicable), identifying data gaps and...
- ...collaborative environment. We are looking for a Senior Data Engineer. We are looking for an experienced Senior Data Engineer... ...practices and Infrastructure as Code. Experience with MDM and Data Quality tools. REST API development (Java Spring Boot or Python)....
- ...Data Engineer Brazil Data Analyst II Important Information Location: Brazil Job Mode: Full-time Work Mode: Work from... ...the engineering team understand underlying data patterns and quality issues. Responsibilities and Duties Digest requirements...
- ...Run CLI-based workflows to upload metadata and processed data into databases Write SQL, shell, and Python scripts to validate... ...Coordinate with scientists, bioinformaticians, and data engineers to ensure metadata quality and usability Mandatory Skills : SQL (writing...
- ...collaborative environment. We are looking for a Senior Data Engineer (API). We are looking for a highly skilled Senior Data Engineer... ...). Develop test automation frameworks to ensure data quality and reliability. Mentor junior engineers and promote...
- Role Summary The Lead AWS Data Engineer provides technical leadership and hands‑on execution for enterprise data platforms hosted on... ...across financial, mobility, and corporate datase ts.Ensure data quality, reconciliation, lineage, and auditability across all layers...
- ...environment. We are looking for Mid-Level Data Enginee r who wants to learn and... ..., prioritize tasks, and deliver high-quality solutions within defined timeline s;Mentor... ...provide technical guidance to junior data engineers, fostering their growth and ensuring adherence...
- ...success in a collaborative environment. We are looking for a Data Engineer Senior (Data Backbone) . In this role you will: Act as... ...critical data issues with a proactive approach Ensure data quality, integrity, and performance across systems Ownership & Initiative...
- ...Preferred Qualifications: Bachelors degree or undergraduate in Engineering, Literature, Journalism, Communications, Arts, Statistics, or a related field. Proven experience of 2+ yrs in Quality Assurance, data annotation, or content review workflows Strong attention to...
- Opportunity – Data Engineer (Senior) | Brazil | Remote Hi everyone, We are currently looking for a Senior Data Engineer to join a global... ...warehouse solutions) Strong knowledge of data modeling, data quality, and governance Experience with Git / version control Strong problem...
- ...Business Intelligence platform enabling customers to connect multiple data sources (e.G., Excel, SQL) into a unified environment, build... ..., and Infra. About Role and Team: As a Technical Support Engineer you will work with leading enterprise organizations and startups...
- ...Descrição da vaga Buscamos um(a) profissional com experiência em plataformas analíticas modernas, especialmente Databricks e Azure Data Lake, para atuar na construção, governança e sustentação de ambientes de consumo analítico corporativo. A pessoa será responsável...
- ...companies in building technological solutions that make a difference. What are we looking for? At least 3 years of experience as a Data Engineer; Experience designing, developing, and maintaining data pipelines and data integration solutions. Strong knowledge of SQL and...
- Descrição da vaga Estamos em busca de um(a) Engenheiro(a) de Dados Sênior para atuar no desenvolvimento, evolução e sustentação de pipelines de dados em ambientes cloud modernos. Essa pessoa terá papel estratégico na construção de soluções escaláveis, confiáveis...
- ...Responsabilidades e atribuições Projetar, desenvolver e sustentar pipelines de dados escaláveis com foco em ingestão via CDC (Change Data Capture) utilizando Oracle GoldenGate; Configurar e administrar replicações de dados em tempo real e quase tempo real entre...
- ...Team The Cint Technology team is looking for a Senior Software Engineer II to join our international Measurement team. This position is... ...to have: Spring framework, microservices Background in data analytics tools such as Spark, Hive, Databricks, or similar Additional...
- ...collaborative environment. We are looking for Data Architect who wants to learn and... ...and performance Collaborate with data engineers, analysts, and platform teams to support... ...pipelines Additional Data Skills: Data quality frameworks (SODA, Great Expectations) Project...
- Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world,... ...combination of both digital data solutions and easy-to-use, high-quality platforms. Our global workforce includes over 5,000...
- ...Vaga: Staff Full Stack Software Engineer – Marketing Automation & Data Pipelines Estamos em busca de um(a) Staff Full Stack Software Engineer para atuar como liderança técnica em uma frente estratégica de Marketing Technology , com foco em Marketo, automação...
- ...YipitData: YipitData is the market-leading data and analytics firm. We analyze billions... ...a high bar for correctness and quality while validating AI-generated outputs.... ...Collaborate cross-functionally with Research, Engineering, and other teams — coordinating across functions...
- ...Introduction: We are seeking a Senior Data Analyst to join our global advanced... ...projects, ensuring methodological rigor, quality, and business relevance. Translate complex... ..., and reporting. Partner with engineering, product, and analytics teams to operationalize...
R$ 10.000
Position : Software Engineer (AI Integration) Location: Remote/Work From Home in... ...21+) and Spring Boot (REST APIs, Spring Data JPA, Spring Security) -Experience with... ...prompt testing frameworks or evals for LLM quality assurance About the Role We're looking for...- ...success in a collaborative environment. We are looking for a Data Scientist PhD or MSc . In this role you will: Design,... ...false positives Collaborate with cross-functional teams (engineering, product, manufacturing) Develop scalable and robust data science...
$ 3.000
...Mobile Engineer (React + React Native) LATAM | Remote | EST-Aligned | International Independent... ...investors access and analyze real estate data. Their platform serves over one million... ...using React Native. Deliver high-quality features across web and mobile platforms...- ...environment We are looking for a Support Engineer. In this role, you will: Collaborate closely... ..., including system unavailability and data integrity problems, and propose resolutions... ...RIM Training module within the eLMS Quality Suite, enabling streamlined training compliance...
Deseja receber mais vagas?
Assine e receba vagas semelhantes a Data Engineer - Quality Assurance. Seja o primeiro a se candidatar!
