Data Engineer ID89384
AgileEngine
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!
ABOUT THE ROLE
We are looking for a Data Engineer with strong Databricks and GCP experience to develop scalable ETL/ELT pipelines and productionize agentic workflows for data engineering automation.
WHAT YOU WILL DO
- Design, develop, and optimize scalable ETL/ELT data pipelines using Databricks, PySpark, and SQL.
- Build and operationalize agentic workflows to automate data engineering and operational processes such as data validation, issue identification, troubleshooting, and workflow execution.
- Integrate agentic capabilities with existing Databricks, GCP, BigQuery, and Delta Lake environments.
- Develop data pipelines and processing solutions to support new business requirements and datasets.
- Build reusable frameworks and components that can be leveraged across multiple data engineering and business use cases.
- Implement data quality checks, monitoring, validation, exception handling, and production controls.
- Optimize PySpark and SQL workloads for performance, reliability, and scalability.
- Support testing, deployment, productionization, and ongoing enhancement of data and agentic solutions.
- Troubleshoot complex data and production issues and implement sustainable solutions.
- Collaborate with business, data engineering, and platform teams to identify further automation opportunities.
MUST HAVES
- 5+ years of strong hands-on experience with Databricks and PySpark .
- Advanced SQL and data-processing skills .
- Hands-on experience with GCP, particularly BigQuery .
- Experience with Delta Lake and modern data lake/lakehouse architectures .
- Strong understanding of ETL/ELT, data pipeline design, performance optimization, and data quality.
- Experience building reliable, scalable, production-grade data solutions.
- Strong analytical and troubleshooting skills.
- Understanding of software engineering practices, including testing, version control, deployment, monitoring, and production support.
- Upper-intermediate English level.
NICE TO HAVES
- Experience developing or integrating AI/agentic workflows, AI agents, or workflow automation solutions.
- Experience applying AI to automate data engineering, validation, troubleshooting, or operational processes.
- Familiarity with orchestration and automation frameworks.
- Experience developing reusable data engineering frameworks and platform components.
- Exposure to productionizing AI-enabled solutions with appropriate validation, monitoring, and human oversight.
PERKS AND BENEFITS
- Professional growth : Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
- Competitive compensation : We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.
- A selection of exciting projects : Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.
- Flextime : Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.
- ...grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Data Platform Engineer to design, build, and support scalable data pipelines on the Databricks platform. WHAT YOU WILL DO - Architect, design...
- ...make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Senior Frontend Engineer to build and maintain features in a large, modern Angular application, with opportunities to contribute to backend work....
- ...risks and define actionable mitigation plans before they escalate. - Reduce friction between cross-functional stakeholders (Engineering, Product, Business) through structured, transparent collaboration. - Facilitate clear, effective communication within the delivery...
- ...place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Data Engineer to build data pipelines and tooling for cost attribution, optimization, and financial modeling. WHAT YOU WILL DO -...
- ...impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Senior Salesforce DevOps Engineer to build reliable CI/CD pipelines using Copado and related tooling. This person manages deployments across development, QA, UAT,...
- ...work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Senior Salesforce Developer with deep Data Cloud expertise to design scalable customer data solutions. This person builds data ingestion, identity resolution, and segmentation...
- ...grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a DevOps Engineer to maintain production and staging environments, execute application migrations, and improve the reliability and automation of cloud...
- ...make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Senior Data and Analytics Engineer to build data pipelines and analytical models that support business intelligence and strategic decision-making in the...
- ...team members. - UX and UI skill set , including wireframes, sitemaps, and information architecture. - Experience building data-backed designs. - Ability to articulate digital design and web terms and speak confidently to clients about web platforms, how designs...
- ...grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Full-Stack Engineer to develop backend services and APIs while modernizing application architecture. WHAT YOU WILL DO - Spend the majority...
- ...meet you! ABOUT THE ROLE We are looking for a GCP Cloud Engineer to architect and manage cloud infrastructure using GKE, Cloud... ...- Implement Google Cloud Storage, Cloud SQL, and Filestore for data storage and processing needs. - Manage and configure Cloud Load...
- ...will collaborate closely with the entire design and construction team, including architects, interior designers, structural and MEP engineers, the FF&E procurement team, and client representatives. This role will focus primarily on construction execution, contractor...
- ...We are looking for an Analyst/Senior Analyst to support data-driven decisions around subscriptions and promotional offers for... ...required. - College degree in Mathematics, Statistics, Industrial Engineering, Data Science, Economics, Operations Research, Computer Science...
- ...controls. - Assist with security audits, assessments, incident response, and business continuity planning. - Monitor and audit data access and sharing practices and maintain data inventory and processing records for compliance. - Support data security...
- ...Quote-to-Cash and Order-to-Cash processes, connecting financial data to real business decisions. This person turns operational... ...partnering closely with Technical Delivery Managers (TDMs) and engineering teams who architect the technical solutions. - Ensure complex...
- ...meet you! ABOUT THE ROLE We are looking for a Software Engineer with experience in Java and MuleSoft to own backend services... ...a Case object ecosystem. This person strengthens service logic, data processing, and platform reliability alongside Salesforce Service...
- ...love to meet you! ABOUT THE ROLE We are looking for a QA Engineer to build regression automation and drive quality practices... ...management systems and quality control processes. - Background in data-based testing and/or security-based testing. - A degree in...
- ...meet you! ABOUT THE ROLE We are looking for an Elixir Engineer to build, maintain, and improve a growing software platform as... ...services and APIs. - Work with PostgreSQL and the application’s data layer. - Write reliable, maintainable, well-tested...
- ...prioritize user stories and epics for Workstreams 1-5, ensuring engineering efforts directly reduce systemic risk. - Drive the adoption... ...product strategy from inception to adoption. - Excels at data-driven decision-making and cross-functional leadership without...
- ...make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Senior Platform Engineer to build and scale core infrastructure that supports rapid company growth. This person designs reliable platform services,...
- ...meet you! ABOUT THE ROLE We are looking for a Senior Data Scientist to drive rigorous statistical execution, multi-goal... ...flaws before deployment. - Collaborate daily with internal engineering cross-functions via Slack and Google Meet to rapidly resolve ambiguous...
- ...ABOUT THE ROLE We are looking for a Backend Software Engineer to build and maintain the PHP-based systems powering our distributed... ...authorization mechanisms (e.g., OAuth2, JWT, RBAC). - Utilize data structures, algorithms, and caching strategies to optimize...
- ...Python, and React with the ability to lead and mentor engineers through ambiguity. This role blends hands-on... ...Experience with at least one of the following: Dagster, Data Lakes, or Amazon Athena . - Senior-level engineer able to ramp up quickly and assume ownership...
- ...ABOUT THE ROLE We are looking for a Personalization & Analytics Engineer to implement A/B testing and personalization using Adobe Target. This person manages enterprise web tagging through Adobe Data Collection, builds data layers, and configures Customer Journey...
- ...teams through implementations, mentor developers, partner with sales on pre-sales calls, and help clients turn Shopify into a growth engine, all within a remote-first environment. WHAT YOU WILL DO - Architect and oversee Shopify stores, applications, and...
- ...ABOUT THE ROLE We are looking for a Full Stack Software Engineer to help design and scale a platform used by enterprise procurement... ...production features. You'll collaborate closely with product, data science, and design to solve complex, ambiguous problems as part...
- ...love to meet you! ABOUT THE ROLE We are looking for a Data Architect specialized in the Adobe Experience Platform to... ...regulations. - Provide technical leadership and mentorship to junior engineers and cross-functional teams regarding AEP best practices....
- ...ABOUT THE ROLE We are looking for a Senior Full Stack Engineer to build backend services and content experiences within a Unified... ...Integrate third-party APIs and services and troubleshoot end-to-end data flows. - Support personalization and A/B testing...
- ...make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Senior/Lead Data Engineer to build and maintain the pipelines and data models behind a centralized HR data warehouse. Working in Snowflake, DBT, Python,...
- ...platform issues. - Implement technical controls for access, data retention, and sensitive-data handling in partnership with... ...by business impact. - Hands-on experience administering or engineering enterprise SaaS, search, or AI platforms (e.g., Slack, Google...
Deseja receber mais vagas?
Assine e receba vagas semelhantes a Data Engineer ID89384. Seja o primeiro a se candidatar!
