Data Engineer - Quality Assurance
Jobtome
Key Responsibilities:
- Automate data quality and reconciliation checks across varied storage layers, including Snowflake, SQL, and RDF/SPARQL databases
- Test and verify data lineage, governance, and visualization components using Snowflake, data catalogs (ie. DataHub), Thoughtspot, and other visualization tools
- Integrate test suites into the core infrastructure orchestrated by Apache Airflow and utilizing Iceberg table formats, while monitoring data pipeline health, alerting, and observability metrics using Prometheus and Grafana Cloud
- Establish AI Evaluation Loops (Evals) and Guardrails: Build rigorous verification protocols— including structural tests, checks, and watchdog agents—to validate AI-generated artifacts, catch false positives, and ensure all automated outputs are secure, reliable, and free from hallucinations.
- Integrate automated testing workflows into CI/CD pipelines using GitHub Actions, ensuring continuous stability and quality gates across all deployment environments
- Validate ETL and dbt transformations across Data Lakehouses, rigorously testing data progression through a Medallion Architecture
- Test and automate complex API workflows, validating data payloads across OpenAPI integrations, 3rd party APIs, GraphQL, and AWS APIs (specifically S3)
Must Haves:
- Data engineering & data testing: dbt, data lakehouse concepts, Medallion architecture
- Databases & storage testing: SQL, Snowflake, AWS S3, Iceberg
- Integrating quality check into data pipelines: Apache Airflow
- API testing & automation: REST/OpenAPI, GraphQL
- Integrating test automation into CI/CD: GitHub Actions (or similar like ArgoCD/GoCD)
- Cloud / infrastructure and observability basics: Kubernetes (K8s), Prometheus, Grafana
Nice to Have:
- Graph databases: RDF / SPARQL
- Data governance & analytics tools: DataHub, Thoughtspot
- AI/ML testing & MLOps: AI evals, guardrails, RAG, vector databases, AI drift monitoring
- Advanced / emerging data tech: StarRocks, DuckDB
- Regulated environments: GxP, 21 CFR Part 11, HIPAA
- Clinical / domain-specific data standards: CDISC, ODM, FHIR
- AI-native tooling: Cursor, Claude Code, Copilot, QA Wolf
Vaga publicada há 5 dias atrás
Empregos semelhantes que podem ser interessantes para vocêCom base na vaga Data Engineer - Quality Assurance em Ribeirão Preto, SP
- A Genesis Consulting tem oportunidade imediata para profissional especialista em Qualidade de Softwares com verdadeira paixão por crescimento profissional e entrega de valor através da tecnologia. Nossos clientes são alguns dos principais líderes mundiais em diferentes ...
- Join our elite team of Senior Raters as a critical contributor to high-quality validation data that directly influences product development and quality assurance for leading search engines and AI technologies. This flexible, remote opportunity allows you to apply...
- ...organization, we are urgently looking for a Full Remote Senior Quality Assurance Analyst with strong understanding of the ServiceNow suite.... ...Azure DevOps projects; Creating and managing test cases, test data, and defects in Azure DevOps; Participating in Sprint...
- ...For our international customer in Valencia, we are looking for a ServiceNow Application Portfolio Management (APM) & Data Quality Engineer. The role focuses on ongoing APM data maintenance in ServiceNow (APM/CMDB-related records as applicable), identifying data gaps and...
- ...Preferred Qualifications: Bachelors degree or undergraduate in Engineering, Literature, Journalism, Communications, Arts, Statistics, or a related field. Proven experience of 2+ yrs in Quality Assurance, data annotation, or content review workflows Strong attention to...
- ...Descrição da vaga Buscamos um(a) profissional com experiência em plataformas analíticas modernas, especialmente Databricks e Azure Data Lake, para atuar na construção, governança e sustentação de ambientes de consumo analítico corporativo. A pessoa será responsável...
- ...Business Intelligence platform enabling customers to connect multiple data sources (e.G., Excel, SQL) into a unified environment, build... ..., and Infra. About Role and Team: As a Technical Support Engineer you will work with leading enterprise organizations and startups...
- ...Responsabilidades e atribuições Projetar, desenvolver e sustentar pipelines de dados escaláveis com foco em ingestão via CDC (Change Data Capture) utilizando Oracle GoldenGate; Configurar e administrar replicações de dados em tempo real e quase tempo real entre...
- ...collaborative environment. We are looking for Data Architect who wants to learn and... ...and performance Collaborate with data engineers, analysts, and platform teams to support... ...pipelines Additional Data Skills: Data quality frameworks (SODA, Great Expectations) Project...
- Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world,... ...combination of both digital data solutions and easy-to-use, high-quality platforms. Our global workforce includes over 5,000...
- Vaga: Staff Full Stack Software Engineer – Marketing Automation & Data Pipelines Estamos em busca de um(a) Staff Full Stack Software Engineer para atuar como liderança técnica em uma frente estratégica de Marketing Technology , com foco em Marketo, automação...
- ...YipitData: YipitData is the market-leading data and analytics firm. We analyze billions... ...a high bar for correctness and quality while validating AI-generated outputs.... ...Collaborate cross-functionally with Research, Engineering, and other teams — coordinating across...
- ...success in a collaborative environment. We are looking for a Data Scientist PhD or MSc . In this role you will: Design,... ...false positives Collaborate with cross-functional teams (engineering, product, manufacturing) Develop scalable and robust data science...
- ...environment We are looking for a Support Engineer. In this role, you will: Collaborate closely... ..., including system unavailability and data integrity problems, and propose resolutions... ...RIM Training module within the eLMS Quality Suite, enabling streamlined training compliance...
$ 3.000
Mobile Engineer (React + React Native) LATAM | Remote | EST-Aligned | International Independent... ...investors access and analyze real estate data. Their platform serves over one million... ...Android using React Native. Deliver high-quality features across web and mobile platforms...- ...Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know and... ..., and standardization activities to improve overall data quality. Governance & Compliance Ensure compliance with global governance...
- ...building technological solutions that make a difference. What are we looking for? Minimum of 5 years of experience as a Senior Data Engineer or similar role, with a strong backend focus; Deep expertise in Snowflake for data warehousing (+2y with the tool);...
- ...will follow. The Team At Anterior, engineers share a strong “sense of product” and... ...depth is in building integrations, APIs, and data pipelines that connect complex systems... ...and health plan systems Debugging data quality issues — conflicting sources of truth, deduplication...
- About Theta Data Theta Data is a pioneering data company specializing... ..., and serve at scale. We take engineering seriously. The Role We're hiring a Technical Support Engineer to be the front line of the... ...related to API behavior, data quality, authentication, request...
- ...Senior .Net Engineer Resume: English Version only. Resume should have detailed discussion... ..., builds, and maintains scalable, high-quality applications that drive efficiency and... ...Preferred Experience with regulated or data-sensitive software environments (e.G.,...
- Transmission Line Engineer - LATAM Our client is seeking a Transmission Line Engineer to join their growing engineering team. This role... ...and competing deadlines. Detail-oriented with a commitment to quality and accuracy. Customer-focused mindset with excellent...
- ...projects including skyscrapers, hospitals, data centers, stadiums, and schools. It streamlines the management of finances, quality, teams, and risks, making these processes... ...the federated API gateway Partner with Engineering, Product, and UX to design and build solutions...
- Sr. Workday Application Engineer – Workday Integrations (Corporate Services) Overview Join a leading retail organization as a Senior Application... ...to align on integration strategy, standards, and roadmap Own data flow and connectivity for employee (P&C) data across internal...
- ...Job Title: AI Engineer Location: Remote (Brazil) Mode: Full Time Job Summary 10+ years of IT experience, currently hands... ...with good understanding of various patterns and practices in AI, data engineering, and large data processions Hands-on in Prompt...
- ...responsabilidades Liderar projetos de dados de média e alta complexidade (data warehouse, data lake, ETL/ELT, BI, migração de dados, entre... .... Diferenciais Background técnico prévio (Data Analyst, Data Engineer ou BI Developer). Experiência com cloud (Azure, AWS ou GCP). Uso...
- ...global commerce through innovative payment technologies for retailers, brands, and consumers. Job Summary We are looking for a Data Management Coordinator to join our team. This role is fully remote in Brazil (CLT) and supports day-to-day operations related to...
R$ 75.000 a R$ 110.000 por año
About the Role Join our team as a Data Center Technician in Ribeirão Preto, Brazil . This is a full-time, on-site position... ...accurate documentation and asset tracking Collaborate with engineering and operations teams Participate in capacity planning and...- IT Project Manager – Data Migration | Banking & Treasury Join NFQ! We are a global consulting firm specialized in business, technology... ...Cognos reports, packages, and reporting structures Ensure data quality, lineage, and continuity throughout migration cycles Provide...
- ...About the Role This is a senior full‑stack engineering role focused on building and scaling the... ...What Success Looks Like A successful engineer in this role: Builds scalable, reliable... ...them into technical solutions. Ships high‑quality features quickly while maintaining...
- Site Reliability Engineer We are looking for a full-time, remote Site Reliability / DevOps Engineer with 3+ years of experience... ...equipment, and facilities to provide enterprise-wide visibility and data-driven insights that fuel asset optimization, improve...
Deseja receber mais vagas?
Assine e receba vagas semelhantes a Data Engineer - Quality Assurance. Seja o primeiro a se candidatar!
