Data Engineer - Quality Assurance
Transcenda
Key Responsibilities: Automate data quality and reconciliation checks across varied storage layers, including Snowflake, SQL, and RDF/SPARQL databases Test and verify data lineage, governance, and visualization components using Snowflake, data catalogs (ie. DataHub), Thoughtspot, and other visualization tools Integrate test suites into the core infrastructure orchestrated by Apache Airflow and utilizing Iceberg table formats, while monitoring data pipeline health, alerting, and observability metrics using Prometheus and Grafana Cloud Establish AI Evaluation Loops (Evals) and Guardrails: Build rigorous verification protocols— including structural tests, checks, and watchdog agents—to validate AI-generated artifacts, catch false positives, and ensure all automated outputs are secure, reliable, and free from hallucinations. Integrate automated testing workflows into CI/CD pipelines using GitHub Actions, ensuring continuous stability and quality gates across all deployment environments Validate ETL and dbt transformations across Data Lakehouses, rigorously testing data progression through a Medallion Architecture Test and automate complex API workflows, validating data payloads across OpenAPI integrations, 3rd party APIs, GraphQL, and AWS APIs (specifically S3) Must Haves: Data engineering & data testing: dbt, data lakehouse concepts, Medallion architecture Databases & storage testing: SQL, Snowflake, AWS S3, Iceberg Integrating quality check into data pipelines: Apache Airflow API testing & automation: REST/OpenAPI, GraphQL Integrating test automation into CI/CD: GitHub Actions (or similar like ArgoCD/GoCD) Cloud / infrastructure and observability basics: Kubernetes (K8s), Prometheus, Grafana Nice to Have: Graph databases: RDF / SPARQL Data governance & analytics tools: DataHub, Thoughtspot AI/ML testing & MLOps: AI evals, guardrails, RAG, vector databases, AI drift monitoring Advanced / emerging data tech: StarRocks, DuckDB Regulated environments: GxP, 21 CFR Part 11, HIPAA Clinical / domain-specific data standards: CDISC, ODM, FHIR AI-native tooling: Cursor, Claude Code, Copilot, QA Wolf
Vaga publicada há 18 dias atrás
Empregos semelhantes que podem ser interessantes para vocêCom base na vaga Data Engineer - Quality Assurance em Guaramirim, SC
- Join our elite team of Senior Raters as a critical contributor to high-quality validation data that directly influences product development and quality assurance for leading search engines and AI technologies. This flexible, remote opportunity allows you to apply...
- ...Run CLI-based workflows to upload metadata and processed data into databases Write SQL, shell, and Python scripts to... ...Coordinate with scientists, bioinformaticians, and data engineers to ensure metadata quality and usability Mandatory Skills: SQL (writing and debugging...
- ...contract, permanent or project management based resources. Title: Data Engineer Location : Remote from anywhere in Brazil as long as candidate... ...requirements and deliver actionable insights. Ensure data quality, integrity, and security across all systems. Optimize data...
- ...success in a collaborative environment. We are looking for a Senior Data Engineer. We are looking for an experienced Senior Data Engineer to... ...and Infrastructure as Code. Experience with MDM and Data Quality tools. REST API development (Java Spring Boot or Python). Exposure...
- ...environment. We are looking for Mid-Level Data Enginee r who wants to learn and... ..., prioritize tasks, and deliver high-quality solutions within defined timeline s;Mentor... ...provide technical guidance to junior data engineers, fostering their growth and ensuring adherence...
- Role Summary The Lead AWS Data Engineer provides technical leadership and hands‐on execution for enterprise data platforms hosted on Amazon... ...financial, mobility, and corporate datase ts.Ensure data quality, reconciliation, lineage, and auditability across all layers of...
- ...collaborative environment. We are looking for a Senior Data Engineer (API). We are looking for a highly skilled Senior Data Engineer... ...). Develop test automation frameworks to ensure data quality and reliability. Mentor junior engineers and promote...
- Data Engineer Brazil Data Analyst II Important Information Location: Brazil Job Mode: Full-time Work Mode: Work from home Job Summary As a... ...the engineering team understand underlying data patterns and quality issues. Responsibilities and Duties Digest requirements from the...
- ...Preferred Qualifications: Bachelors degree or undergraduate in Engineering, Literature, Journalism, Communications, Arts, Statistics, or a related field. Proven experience of 2+ yrs in Quality Assurance, data annotation, or content review workflows Strong attention to...
- ...success in a collaborative environment. We are looking for a Data Engineer Senior (Data Backbone) . In this role you will: Act as the go-... ...resolve critical data issues with a proactive approach Ensure data quality, integrity, and performance across systems Ownership &...
- ...Opportunity – Data Engineer (Senior) | Brazil | Remote Hi everyone, We are currently looking for a Senior Data Engineer to join a... ...warehouse solutions) ~ Strong knowledge of data modeling, data quality, and governance ~ Experience with Git / version control ~...
- ...companies in building technological solutions that make a difference. What are we looking for? At least 3 years of experience as a Data Engineer; Experience designing, developing, and maintaining data pipelines and data integration solutions. Strong knowledge of SQL and...
- Descrição da vaga Buscamos um(a) profissional com experiência em plataformas analíticas modernas, especialmente Databricks e Azure Data Lake, para atuar na construção, governança e sustentação de ambientes de consumo analítico corporativo. A pessoa será responsável por...
- Descrição da vaga Estamos em busca de um(a) Engenheiro(a) de Dados Sênior para atuar no desenvolvimento, evolução e sustentação de pipelines de dados em ambientes cloud modernos. Essa pessoa terá papel estratégico na construção de soluções escaláveis, confiáveis...
- ...Business Intelligence platform enabling customers to connect multiple data sources (e.g., Excel, SQL) into a unified environment, build... ..., Data, and Infra. About Role and Team: As a Technical Support Engineer you will work with leading enterprise organizations and startups...
- Lead / Architect Data Engineer (Azure Stack) Location: Remote Working Hours: Overlap until 8:00 PM CET (Standard 9:00 AM – 6:00 PM CST – No overtime required!) Experience: 8+ Years Overall (with 1+ year in a Lead/Architect role) Language: English (B2+ Upper-Intermediate...
$ 1.500
...MillionLogics empowers enterprises through data & AI, cloud solutions, IT consulting,... ...deliver results. Role Overview: As an AI quality analyst, you will evaluate a new... ...personalisation quality. Creative Prompt Engineering: Experience in designing creative, multi...- ...Responsabilidades e atribuições Projetar, desenvolver e sustentar pipelines de dados escaláveis com foco em ingestão via CDC (Change Data Capture) utilizando Oracle GoldenGate; Configurar e administrar replicações de dados em tempo real e quase tempo real entre...
- ...Team The Cint Technology team is looking for a Senior Software Engineer II to join our international Measurement team. This position is... ...mentor Nice to have: Spring framework, microservices Background in data analytics tools such as Spark, Hive, Databricks, or similar...
- ...collaborative environment. We are looking for Data Architect who wants to learn and... ...and performance Collaborate with data engineers, analysts, and platform teams to support... ...pipelines Additional Data Skills: Data quality frameworks (SODA, Great Expectations) Project...
- Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world,... ...combination of both digital data solutions and easy-to-use, high-quality platforms. Our global workforce includes over 5,000 employees...
- ...YipitData: YipitData is the market-leading data and analytics firm. We analyze billions... ...a high bar for correctness and quality while validating AI-generated outputs.... ...Collaborate cross-functionally with Research, Engineering, and other teams — coordinating across...
R$ 10.000
Position: Software Engineer (AI Integration) Location: Remote/Work From Home in Brazil... ...) and Spring Boot (REST APIs, Spring Data JPA, Spring Security) -Experience with... ...prompt testing frameworks or evals for LLM quality assurance About the Role We're looking for a Full...- .... Introduction: We are seeking a Senior Data Analyst to join our global advanced analytics... ..., ensuring methodological rigor, quality, and business relevance. Translate complex... ...validation, and reporting. Partner with engineering, product, and analytics teams to operationalize...
- ...our success in a collaborative environment. We are looking for a Data Scientist PhD or MSc . In this role you will: Design, train,... ...reduce false positives Collaborate with cross-functional teams (engineering, product, manufacturing) Develop scalable and robust data science...
- ...environment We are looking for a Support Engineer . In this role, you will:... ...issues, including system unavailability and data integrity problems, and propose resolutions... ...Veeva RIM Training module within the eLMS Quality Suite, enabling streamlined training compliance...
$ 3.000
Mobile Engineer (React + React Native) LATAM | Remote | EST-Aligned | International Independent... ...investors access and analyze real estate data. Their platform serves over one million... ...Android using React Native. Deliver high-quality features across web and mobile platforms...- ...Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know... ...enrichment, and standardization activities to improve overall data quality. Governance & Compliance Ensure compliance with global governance...
- ...Senior Backend Engineer (PHP/Laravel) Location: Brazil About Sphise Technologies... ...maintaining robust security measures and data protection protocols. Additional Responsibilities... ...to ensure timely delivery of high-quality software. Competencies/Requirements:...
- ...Foretellix is the gold standard for data-driven autonomy development... ...: Be part of the Application Engineering Team responsible for adapting... ...ability to deliver high quality, safe products. What will... ...Product Manager / Methodology Engineer. Knowledge & experience with...
Deseja receber mais vagas?
Assine e receba vagas semelhantes a Data Engineer - Quality Assurance. Seja o primeiro a se candidatar!
