Job Description
Immediate opening for a Senior Data Engineer in Chicago! InnovateTech Solutions is seeking a highly skilled professional to join our dynamic team on a contract basis. This urgent role requires expertise in data pipeline architecture and cloud technologies. Work on high-impact projects with cutting-edge tools while enjoying competitive compensation and flexible arrangements. Join us in transforming data into actionable insights for Fortune 500 clients.
Responsibilities
- Design and implement scalable data pipelines using AWS Glue, Kafka, and Apache Spark
- Optimize ETL processes for large-volume datasets (>1TB/day)
- Collaborate with data scientists to build machine learning data infrastructure
- Ensure data quality through automated validation frameworks
- Document architecture and processes using Confluence and Lucidchart
- Mentor junior engineers on best practices
- Deploy solutions using CI/CD pipelines in AWS
Qualifications
- 5+ years of experience in data engineering or related field
- Expertise in Python, SQL, and distributed computing frameworks
- AWS/Azure/GCP certification (Solutions Architect preferred)
- Proven track record with real-time data streaming technologies
- Experience with containerization (Docker/Kubernetes)
- Strong problem-solving skills and attention to detail
- Ability to thrive in fast-paced, deadline-driven environments