Infrastructure Engineer (Kafka) ID82562
AgileEngine
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!
ABOUT THE ROLE
We are looking for an Infrastructure Engineer to own and operate the Kafka estate behind an event-driven integration platform.
The mandatory requirements are 4+ years of hands-on production Kafka experience, strong Linux and Python scripting, CI/CD, Docker or Podman, and strong English communication skills.
WHAT YOU WILL DO
- Own the Kafka estate — topic design and naming standards, partitioning and keying strategy, replication, retention and compaction policy, consumer group and offset management, quotas, and broker configuration and upgrades.
- Engineer the platform's delivery guarantees in practice: at-least-once and exactly-once semantics, idempotent producers, transactional writes where warranted, dead-letter topics, and self-service replay tooling for recovering from downstream failures.
- Build streaming observability: consumer lag, queue depth, throughput and rebalance monitoring; end-to-end correlation-ID tracing across topics; dashboards, service level objectives and alerting.
- Plan capacity, cost and retention for a durable log with regulatory audit retention requirements, and tune it as adoption scales across the firm.
- Evaluate and integrate vendor-native streaming and change-data-capture mechanisms as the platform's ingress and egress paths mature.
- Own and evolve the build and release pipeline — automated Jenkins pipelines producing packaged application installs for multiple enterprise Linux generations, signed container images, and generated documentation, promoted through internal artifact and image distribution services.
- Operate the runtime estate: containerised deployments, integration gateway hosts, and the ongoing operating-system modernisation of that estate.
- Engineer the infrastructure behind the platform's resilience and continuity — health detection, circuit breaking, and the reconciliation and monitoring that prove the platform recovers cleanly when the upstream vendor platform is degraded or unavailable.
- Automate environment provisioning and configuration, and keep the configuration and asset inventory a genuine single source of truth.
- Partner with the squad's Python developers on deployability, performance and cost; participate in change management and production support.
MUST HAVES
- Deep, hands-on production Kafka experience of at least 4 years — this is the central requirement. Topic and partition design, consumer group mechanics, retention and compaction, replication, performance tuning, and troubleshooting lag, rebalances and delivery failures under load.
- Practical understanding of event-driven delivery semantics: at-least-once versus exactly-once, idempotency, ordering guarantees, dead-letter handling and replay.
- Strong enterprise Linux engineering and automation — shell plus Python scripting.
- CI/CD pipeline ownership , ideally Jenkins declarative pipelines, with real artifact and release management experience.
- Containers — Docker or Podman, OCI images — and container orchestration platforms.
- Infrastructure-as-code and configuration management.
- Observability tooling: log aggregation, metrics, alerting and SLO definition.
- GenAI-assisted development — you actively use AI coding agents in your daily workflow, or are demonstrably keen to adopt them. We automate and build with these tools across the squad and expect everyone to be fluent in them.
- Networking, TLS, secrets management and enterprise authentication (OAuth2).
- A production operations mindset: incident response, capacity planning and change control.
- Strong written and verbal communication, working with a global team.
- Upper-intermediate English level
NICE TO HAVES
- Kafka ecosystem depth: Kafka Connect, Schema Registry, Kafka Streams, MirrorMaker, or managed Kafka services.
- Change-data-capture patterns and tooling.
- Infrastructure supporting large commercial SaaS platforms, including integration gateway or connector servers.
- Package and artifact distribution at enterprise scale.
- Experience in a regulated environment — audit retention, data classification, formal build and operate governance.
- Kubernetes; multi-region and high-availability design.
PERKS AND BENEFITS
- Professional growth : Mentorship, TechTalks, and personalized growth roadmaps.
- Competitive compensation : USD-based pay with education, fitness, and team activity budgets.
- Exciting projects : Modern solutions with Fortune 500 and top product companies.
- Flextime : Flexible schedule with remote and office options.
- ...Location: Sorocaba, SP (presential) Company: Prysmian Position Overview: We are seeking a motivated and detail-oriented Product Engineer Intern to join our team. This internship offers an excellent opportunity to learn about manufacturing and design of...
- ...routines, strengthening discipline, a culture of compliance, and recurrence prevention Provide technical support to Quality, Engineering, Production, Logistics, and other areas related to the Quality Management System Prepare management reports and executive presentations...
- ...teams through implementations, mentor developers, partner with sales on pre-sales calls, and help clients turn Shopify into a growth engine, all within a remote-first environment. The mandatory requirements are 5+ years of e-commerce experience, deep expertise in...
- ...impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Senior Contact Center Engineer to configure, support, and improve a cloud telephony platform and its CRM integrations in a healthcare environment. The mandatory...
- ...make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Mid-level SDET Engineer to build regression automation and run manual and automated testing for an AI-powered procurement platform. The mandatory...
- ...meet you! ABOUT THE ROLE We are looking for a Network Engineer to maintain and improve secure, reliable enterprise network... ...and software expertise, firewall, switching and wireless infrastructure, TCP/IP, routing, IPsec VPNs, network troubleshooting, segmentation...
- ...Extensibility, upsells, payment methods, friction reduction. - Help ship, monitor, and QA A/B tests on the storefront. - Work with engineers to build product, SKU, variant, and metafield structures that scale across markets and product lines rather than needing rework at...
- ...Team Overview We are looking for a SR Product Engineer – Energy Cables Based in Sorocaba, Brazil, reporting to the RD Brazil Manager, you will be responsible carry out the activities of analysis, planning, research, studies, preparation and development of products, from...
- ...key clients and allows us to move at lightning speed the moment these roles go live. We are looking for a Senior InRiver PIM Engineer to maintain system integrations and customize InRiver PIM platforms within a global engineering team. You will design technical...
- ...make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Senior IT Infrastructure Engineer to design, operate, and improve the systems and infrastructure behind corporate IT services and business applications....
- ...Adoption: Treat security tooling as a product; design scanning engines (ASPM ingestion, AI-SDLC scanning) and developer portals that... ...Experience designing internal developer portals (IDPs), SRE/infrastructure tooling, or Golden Paths inside large, regulated enterprise...
- ...grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Full-Stack Engineer to develop backend services and APIs while modernizing application architecture. The mandatory requirements are 4+ years of...
- ...make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Mid-level Data Engineer to build and maintain dbt pipelines and Snowflake data marts behind customer-facing reporting, spend analytics, and AI features....
- ...We are looking for a HV System Analyst to join our LATAM HV Systems Team Based in Sorocaba - Brazil, reporting to System Engineer Manager. Main responsibilities: Responsible for system design Responsible for installation design. Prepare technical proposals of...
- ...investigations and support corrective and preventive action planning Requirements Bachelor's degree in Pharmacy, Chemistry, or Engineering Intermediate English and advanced Microsoft Excel and PowerPoint proficiency Prior experience in DME, Quality Documentation...
- ...you! ABOUT THE ROLE We are looking for a Senior AI Engineer to design and build agentic workflows and AI-powered products... ...- Experience with TypeScript, Python, RESTful APIs, and infrastructure on AWS. - Experience with APIs, workflow engines, event-driven...
- ...MUST HAVES - 6+ years of professional experience in Cloud Engineering, Platform Engineering, DevOps or Site Reliability... ...supporting production data workloads. - Strong experience with Infrastructure as Code , preferably Terraform, and with source-controlled...
- ...grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Infrastructure Engineer & SRE to operate and improve a Kubernetes-based API platform across public and private cloud environments, including automation...
- ...you! ABOUT THE ROLE We are looking for a Senior Data Engineer to operate and improve a Snowflake-based enterprise data... ...solutions. - Experience with Terraform, CI/CD pipelines, and Infrastructure as Code practices supporting data platforms. - Experience...
- ...Author clean PRDs, roadmaps, and non-technical business requirements, partnering closely with Technical Delivery Managers (TDMs) and engineering teams who architect the technical solutions. - Ensure complex commercial and financial processes (quoting, deal structuring,...
- ...work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Senior Platform Engineer to build and scale core infrastructure that supports rapid company growth. This person designs reliable platform services, manages cloud resources on...
- ...and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Platform Engineer to build and scale core infrastructure that supports rapid company growth. This person designs reliable platform services, manages cloud resources on...
- ...impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a DevOps Engineer to build and run cloud infrastructure, CI/CD, and observability for Data and AI teams in a PCI-compliant environment. MUST HAVES - 4+ years...
- ...Center Technician for freelance/contract work in Sorocaba, Brazil . This is an on-site position supporting mission-critical infrastructure at premier data center facilities. Compensation R$45-65/hr (BRL hourly) Rates vary based on experience level and project...
R$ 75.000 a R$ 110.000 por año
...a full-time, on-site position where you'll support critical infrastructure at world-class data center facilities. Compensation & Benefits... ...documentation and asset tracking Collaborate with engineering and operations teams Participate in capacity planning and...
Deseja receber mais vagas?
Assine e receba vagas semelhantes a Infrastructure Engineer (Kafka) ID82562. Seja o primeiro a se candidatar!
