Data Engineer - Quality Assurance
Jobtome
Key Responsibilities:
- Automate data quality and reconciliation checks across varied storage layers, including Snowflake, SQL, and RDF/SPARQL databases
- Test and verify data lineage, governance, and visualization components using Snowflake, data catalogs (ie. DataHub), Thoughtspot, and other visualization tools
- Integrate test suites into the core infrastructure orchestrated by Apache Airflow and utilizing Iceberg table formats, while monitoring data pipeline health, alerting, and observability metrics using Prometheus and Grafana Cloud
- Establish AI Evaluation Loops (Evals) and Guardrails: Build rigorous verification protocols— including structural tests, checks, and watchdog agents—to validate AI-generated artifacts, catch false positives, and ensure all automated outputs are secure, reliable, and free from hallucinations.
- Integrate automated testing workflows into CI/CD pipelines using GitHub Actions, ensuring continuous stability and quality gates across all deployment environments
- Validate ETL and dbt transformations across Data Lakehouses, rigorously testing data progression through a Medallion Architecture
- Test and automate complex API workflows, validating data payloads across OpenAPI integrations, 3rd party APIs, GraphQL, and AWS APIs (specifically S3)
Must Haves:
- Data engineering & data testing: dbt, data lakehouse concepts, Medallion architecture
- Databases & storage testing: SQL, Snowflake, AWS S3, Iceberg
- Integrating quality check into data pipelines: Apache Airflow
- API testing & automation: REST/OpenAPI, GraphQL
- Integrating test automation into CI/CD: GitHub Actions (or similar like ArgoCD/GoCD)
- Cloud / infrastructure and observability basics: Kubernetes (K8s), Prometheus, Grafana
Nice to Have:
- Graph databases: RDF / SPARQL
- Data governance & analytics tools: DataHub, Thoughtspot
- AI/ML testing & MLOps: AI evals, guardrails, RAG, vector databases, AI drift monitoring
- Advanced / emerging data tech: StarRocks, DuckDB
- Regulated environments: GxP, 21 CFR Part 11, HIPAA
- Clinical / domain-specific data standards: CDISC, ODM, FHIR
- AI-native tooling: Cursor, Claude Code, Copilot, QA Wolf
Vaga publicada há 5 dias atrás
Empregos semelhantes que podem ser interessantes para vocêCom base na vaga Data Engineer - Quality Assurance em Boa Vista, RR
- A Genesis Consulting tem oportunidade imediata para profissional especialista em Qualidade de Softwares com verdadeira paixão por crescimento profissional e entrega de valor através da tecnologia. Nossos clientes são alguns dos principais líderes mundiais em diferentes ...
- Join our elite team of Senior Raters as a critical contributor to high-quality validation data that directly influences product development and quality assurance for leading search engines and AI technologies. This flexible, remote opportunity allows you to apply...
- ...organization, we are urgently looking for a Full Remote Senior Quality Assurance Analyst with strong understanding of the ServiceNow suite.... ...Azure DevOps projects; Creating and managing test cases, test data, and defects in Azure DevOps; Participating in Sprint...
- ...For our international customer in Valencia, we are looking for a ServiceNow Application Portfolio Management (APM) & Data Quality Engineer. The role focuses on ongoing APM data maintenance in ServiceNow (APM/CMDB-related records as applicable), identifying data gaps and...
- ...Descrição da vaga Buscamos um(a) profissional com experiência em plataformas analíticas modernas, especialmente Databricks e Azure Data Lake, para atuar na construção, governança e sustentação de ambientes de consumo analítico corporativo. A pessoa será responsável...
- ...Preferred Qualifications: Bachelors degree or undergraduate in Engineering, Literature, Journalism, Communications, Arts, Statistics, or a related field. Proven experience of 2+ yrs in Quality Assurance, data annotation, or content review workflows Strong attention to...
- ...Business Intelligence platform enabling customers to connect multiple data sources (e.G., Excel, SQL) into a unified environment, build... ..., and Infra. About Role and Team: As a Technical Support Engineer you will work with leading enterprise organizations and startups...
- Descrição da vaga Estamos em busca de um(a) Engenheiro(a) de Dados Sênior para atuar no desenvolvimento, evolução e sustentação de pipelines de dados em ambientes cloud modernos. Essa pessoa terá papel estratégico na construção de soluções escaláveis, confiáveis...
- ...Responsabilidades e atribuições Projetar, desenvolver e sustentar pipelines de dados escaláveis com foco em ingestão via CDC (Change Data Capture) utilizando Oracle GoldenGate; Configurar e administrar replicações de dados em tempo real e quase tempo real entre...
- ...Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world... ...combination of both digital data solutions and easy-to-use, high-quality platforms. Our global workforce includes over 5,000...
- ...collaborative environment. We are looking for Data Architect who wants to learn and... ...and performance Collaborate with data engineers, analysts, and platform teams to support... ...pipelines Additional Data Skills: Data quality frameworks (SODA, Great Expectations) Project...
- ...YipitData: YipitData is the market-leading data and analytics firm. We analyze billions... ...a high bar for correctness and quality while validating AI-generated outputs.... ...Collaborate cross-functionally with Research, Engineering, and other teams — coordinating across...
- Vaga: Staff Full Stack Software Engineer – Marketing Automation & Data Pipelines Estamos em busca de um(a) Staff Full Stack Software Engineer para atuar como liderança técnica em uma frente estratégica de Marketing Technology , com foco em Marketo, automação...
- ...Introduction: We are seeking a Senior Data Analyst to join our global advanced... ...projects, ensuring methodological rigor, quality, and business relevance. Translate complex... ..., and reporting. Partner with engineering, product, and analytics teams to operationalize...
- ...success in a collaborative environment. We are looking for a Data Scientist PhD or MSc . In this role you will: Design,... ...false positives Collaborate with cross-functional teams (engineering, product, manufacturing) Develop scalable and robust data science...
- ...environment We are looking for a Support Engineer . In this role, you will:... ...issues, including system unavailability and data integrity problems, and propose resolutions... ...Veeva RIM Training module within the eLMS Quality Suite, enabling streamlined training compliance...
$ 3.000
...Mobile Engineer (React + React Native) LATAM | Remote | EST-Aligned | International Independent... ...investors access and analyze real estate data. Their platform serves over one million... ...using React Native. Deliver high-quality features across web and mobile platforms...- ...Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know... ...enrichment, and standardization activities to improve overall data quality. Governance & Compliance Ensure compliance with global governance...
- ...building technological solutions that make a difference. What are we looking for? Minimum of 5 years of experience as a Senior Data Engineer or similar role, with a strong backend focus; Deep expertise in Snowflake for data warehousing (+2y with the tool);...
- About Theta Data Theta Data is a pioneering data company specializing... ..., and serve at scale. We take engineering seriously. The Role We're hiring a Technical Support Engineer to be the front line of the... ...related to API behavior, data quality, authentication, request...
- ...Senior Backend Engineer (PHP/Laravel) Location: Brazil About Sphise Technologies... ...maintaining robust security measures and data protection protocols. Additional Responsibilities... ...to ensure timely delivery of high-quality software. Competencies/Requirements:...
- ...Foretellix is the gold standard for data-driven autonomy development... ...Be part of the Application Engineering Team responsible for adapting... ...ability to deliver high quality, safe products. What will... ...Product Manager / Methodology Engineer. Knowledge & experience with...
- A Jusfy está em busca de uma pessoa Analista de Dados Pleno para compor o time de Operações!
- Transmission Line Engineer - LATAM Our client is seeking a Transmission Line Engineer to join their growing engineering team. This role... ...and competing deadlines. Detail-oriented with a commitment to quality and accuracy. Customer-focused mindset with excellent...
- Sr. Workday Application Engineer – Workday Integrations (Corporate Services) Overview Join a leading retail organization as a Senior Application... ...to align on integration strategy, standards, and roadmap Own data flow and connectivity for employee (P&C) data across internal...
- ...Java Software Engineer, AI Imaging (Backend) About the Company Our client is a retail... ...can generate but the 10+ years of retail data, workflows, tools, experts, and QA... ...We care deeply about delivering high-quality work We work to be the best partners possible...
- ...Job Title: AI Engineer Location: Remote (Brazil) Mode: Full Time Job Summary 10+ years of IT experience, currently hands... ...with good understanding of various patterns and practices in AI, data engineering, and large data processions Hands-on in Prompt...
- ...responsabilidades Liderar projetos de dados de média e alta complexidade (data warehouse, data lake, ETL/ELT, BI, migração de dados, entre... .... Diferenciais Background técnico prévio (Data Analyst, Data Engineer ou BI Developer). Experiência com cloud (Azure, AWS ou GCP). Uso...
- ...global commerce through innovative payment technologies for retailers, brands, and consumers. Job Summary We are looking for a Data Management Coordinator to join our team. This role is fully remote in Brazil (CLT) and supports day-to-day operations related to...
- IT Project Manager – Data Migration | Banking & Treasury Join NFQ! We are a global consulting firm specialized in business, technology... ...Cognos reports, packages, and reporting structures Ensure data quality, lineage, and continuity throughout migration cycles Provide...
Deseja receber mais vagas?
Assine e receba vagas semelhantes a Data Engineer - Quality Assurance. Seja o primeiro a se candidatar!
