Job Description

Salary: $100,000 - 120,000 per year Requirements:

• Deep knowledge of Apache Kafkas architecture, components, and functionalities.
• Proficient in SQL for data validation and troubleshooting.
• Experience with ETL processes and concepts related to data warehousing.
• Skilled in developing and maintaining automated tests for data pipelines.
• Capable of analyzing data, identifying problems, and providing solutions.
• Excellent communication and collaboration abilities to work effectively with development teams.

• Design and execute test cases for ETL (Extract, Transform, Load) workflows, focusing on data validation for both batch and streaming data.
• Validate data ingestion, transformation, and loading processes in Kafka, ensuring quality, consistency, and completeness of data across systems.
• Utilize Apache Kafka for hands-on data streaming validation, involving work with producers, consumers, and comprehension of Kafkas architecture and concepts.
• Automate the testing of data pipelines using Python or other scripting languages and maintain test scripts efficiently.
• Collaborate with developers to identify, analyze, and resolve data-related issues, performing root cause analysis, and offering solutions.
• Assess the performance and scalability of Kafka-based systems to ensure they can accommodate expected data volumes and throughput.
• Participate in Agile/Scrum methodologies, engaging in testing activities throughout the development lifecycle.
• Possess familiarity with data warehousing concepts and cloud data platforms, which is often considered beneficial.

• Cloud
• ETL
• Kafka
• Python
• SQL
• Marketing

More:

We are based in Pittsburgh, PA, offering a competitive salary ranging from $100,000 to $120,000 annually. Our team thrives on innovation and collaboration, prioritizing an environment where each member contributes to our success. We value effective communication, problem-solving skills, and a solid grasp of technical knowledge, particularly in Apache Kafka and data analysis. Join us to be part of a dedicated team that strives to enhance data processes and solutions.

last updated 15 week of 2026

Job Tags

Similar Jobs