Data Engineer - Quality Assurance
Jobtome
Key Responsibilities:
- Automate data quality and reconciliation checks across varied storage layers, including Snowflake, SQL, and RDF/SPARQL databases
- Test and verify data lineage, governance, and visualization components using Snowflake, data catalogs (ie. DataHub), Thoughtspot, and other visualization tools
- Integrate test suites into the core infrastructure orchestrated by Apache Airflow and utilizing Iceberg table formats, while monitoring data pipeline health, alerting, and observability metrics using Prometheus and Grafana Cloud
- Establish AI Evaluation Loops (Evals) and Guardrails: Build rigorous verification protocols— including structural tests, checks, and watchdog agents—to validate AI-generated artifacts, catch false positives, and ensure all automated outputs are secure, reliable, and free from hallucinations.
- Integrate automated testing workflows into CI/CD pipelines using GitHub Actions, ensuring continuous stability and quality gates across all deployment environments
- Validate ETL and dbt transformations across Data Lakehouses, rigorously testing data progression through a Medallion Architecture
- Test and automate complex API workflows, validating data payloads across OpenAPI integrations, 3rd party APIs, GraphQL, and AWS APIs (specifically S3)
Must Haves:
- Data engineering & data testing: dbt, data lakehouse concepts, Medallion architecture
- Databases & storage testing: SQL, Snowflake, AWS S3, Iceberg
- Integrating quality check into data pipelines: Apache Airflow
- API testing & automation: REST/OpenAPI, GraphQL
- Integrating test automation into CI/CD: GitHub Actions (or similar like ArgoCD/GoCD)
- Cloud / infrastructure and observability basics: Kubernetes (K8s), Prometheus, Grafana
Nice to Have:
- Graph databases: RDF / SPARQL
- Data governance & analytics tools: DataHub, Thoughtspot
- AI/ML testing & MLOps: AI evals, guardrails, RAG, vector databases, AI drift monitoring
- Advanced / emerging data tech: StarRocks, DuckDB
- Regulated environments: GxP, 21 CFR Part 11, HIPAA
- Clinical / domain-specific data standards: CDISC, ODM, FHIR
- AI-native tooling: Cursor, Claude Code, Copilot, QA Wolf
Vaga publicada há 4 dias atrás
Empregos semelhantes que podem ser interessantes para vocêCom base na vaga Data Engineer - Quality Assurance em Aracaju, SE
- A Genesis Consulting tem oportunidade imediata para profissional especialista em Qualidade de Softwares com verdadeira paixão por crescimento profissional e entrega de valor através da tecnologia. Nossos clientes são alguns dos principais líderes mundiais em diferentes ...
- Join our elite team of Senior Raters as a critical contributor to high-quality validation data that directly influences product development and quality assurance for leading search engines and AI technologies. This flexible, remote opportunity allows you to apply your...
- ...organization, we are urgently looking for a Full Remote Senior Quality Assurance Analyst with strong understanding of the ServiceNow suite.... ...Azure DevOps projects; Creating and managing test cases, test data, and defects in Azure DevOps; Participating in Sprint...
- ...For our international customer in Valencia, we are looking for a ServiceNow Application Portfolio Management (APM) & Data Quality Engineer. The role focuses on ongoing APM data maintenance in ServiceNow (APM/CMDB-related records as applicable), identifying data gaps and...
- ...Preferred Qualifications: Bachelors degree or undergraduate in Engineering, Literature, Journalism, Communications, Arts, Statistics, or a related field. Proven experience of 2+ yrs in Quality Assurance, data annotation, or content review workflows Strong attention to...
- ...Descrição da vaga Buscamos um(a) profissional com experiência em plataformas analíticas modernas, especialmente Databricks e Azure Data Lake, para atuar na construção, governança e sustentação de ambientes de consumo analítico corporativo. A pessoa será responsável...
- ...Business Intelligence platform enabling customers to connect multiple data sources (e.G., Excel, SQL) into a unified environment, build... ..., and Infra. About Role and Team: As a Technical Support Engineer you will work with leading enterprise organizations and startups...
- ...Responsabilidades e atribuições Projetar, desenvolver e sustentar pipelines de dados escaláveis com foco em ingestão via CDC (Change Data Capture) utilizando Oracle GoldenGate; Configurar e administrar replicações de dados em tempo real e quase tempo real entre...
- ...The Cint Technology team is looking for a Senior Software Engineer II to join our international Measurement team. This position is... ...have: Spring framework, microservices Background in data analytics tools such as Spark, Hive, Databricks, or similar...
- Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world,... ...combination of both digital data solutions and easy-to-use, high-quality platforms. Our global workforce includes over 5,000...
- Vaga: Staff Full Stack Software Engineer – Marketing Automation & Data Pipelines Estamos em busca de um(a) Staff Full Stack Software Engineer para atuar como liderança técnica em uma frente estratégica de Marketing Technology, com foco em Marketo, automação de marketing...
- ...YipitData: YipitData is the market-leading data and analytics firm. We analyze billions... ...a high bar for correctness and quality while validating AI-generated outputs.... ...Collaborate cross-functionally with Research, Engineering, and other teams — coordinating across functions...
- ...collaborative environment. We are looking for Data Architect who wants to learn and... ...and performance Collaborate with data engineers, analysts, and platform teams to support... ...Additional Data Skills: Data quality frameworks (SODA, Great Expectations) Project...
- ...environment We are looking for a Support Engineer . In this role, you will: Collaborate closely... ..., including system unavailability and data integrity problems, and propose... ...Veeva RIM Training module within the eLMS Quality Suite, enabling streamlined training compliance...
$ 3.000
...Mobile Engineer (React + React Native) LATAM | Remote | EST-Aligned | International Independent... ...investors access and analyze real estate data. Their platform serves over one million... ...using React Native. Deliver high-quality features across web and mobile platforms...- ...building technological solutions that make a difference. What are we looking for? Minimum of 5 years of experience as a Senior Data Engineer or similar role, with a strong backend focus; Deep expertise in Snowflake for data warehousing (+2y with the tool);...
- ...Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know and... ..., and standardization activities to improve overall data quality. Governance & Compliance Ensure compliance with global governance...
- ...will follow. The Team At Anterior, engineers share a strong “sense of product” and... ...depth is in building integrations, APIs, and data pipelines that connect complex systems... ...and health plan systems Debugging data quality issues — conflicting sources of truth, deduplication...
- About Theta Data Theta Data is a pioneering data company specializing... ...and serve at scale. We take engineering seriously. The Role We'... ...hiring a Technical Support Engineer to be the front line of the... ...to API behavior, data quality, authentication, request handling...
- A Jusfy está em busca de uma pessoa Analista de Dados Pleno para compor o time de Operações!
- ...responsabilidades Liderar projetos de dados de média e alta complexidade (data warehouse, data lake, ETL/ELT, BI, migração de dados, entre... ...Diferenciais Background técnico prévio (Data Analyst, Data Engineer ou BI Developer). Experiência com cloud (Azure, AWS ou GCP)....
- Transmission Line Engineer - LATAM Our client is seeking a Transmission Line Engineer to join their growing engineering team. This role... ...and competing deadlines. Detail-oriented with a commitment to quality and accuracy. Customer-focused mindset with excellent...
- ...projects including skyscrapers, hospitals, data centers, stadiums, and schools. It streamlines the management of finances, quality, teams, and risks, making these processes... ...the federated API gateway Partner with Engineering, Product, and UX to design and build solutions...
- ...Sr. Workday Application Engineer – Workday Integrations (Corporate Services) Overview Join a leading retail organization as a Senior... ...to align on integration strategy, standards, and roadmap Own data flow and connectivity for employee (P&C) data across internal systems...
- Video Data Entry Specialist (LATAM) $6 - $6/hourpay Required Skills attention to detaildata... ...domains such as finance, healthcare, STEM engineering, and more. micro1 transforms that real-world expertise into high-quality training data, evaluations, and feedback loops...
- ...global commerce through innovative payment technologies for retailers, brands, and consumers. Job Summary We are looking for a Data Management Coordinator to join our team. This role is fully remote in Brazil (CLT) and supports day-to-day operations related to...
- ...IT Project Manager – Data Migration | Banking & Treasury Join NFQ! We are a global consulting firm specialized in business, technology... ...reports, packages, and reporting structures Ensure data quality, lineage, and continuity throughout migration cycles Provide...
- ...We are looking for a Senior Generative AI Engineer to join the Customer Delivery team at CI&T. This person will work embedded within... ...solutions to improve software development lifecycle efficiency and quality. Support technical discovery, architecture definition, and...
- ...We are looking for a remote, full-time AI / ML Engineer with 4+ years of machine learning experience, preferably within MarTech SaaS companies... ...transformation. You will work with the AI / ML Manager on the Data Science team, developing agentic AI workflows with customized...
- ...About the Role This is a senior full‐stack engineering role focused on building and scaling the... .... What Success Looks Like A successful engineer in this role: Builds scalable, reliable... ...into technical solutions. Ships high‐quality features quickly while maintaining engineering...
Deseja receber mais vagas?
Assine e receba vagas semelhantes a Data Engineer - Quality Assurance. Seja o primeiro a se candidatar!
