Job Description
• Design, build, and optimize scalable data pipelines using AWS Glue, Apache Kafka, AWS Lambda, and Step Functions.
• Develop and maintain robust data lakes and data warehouses on Amazon S3.
• Write infrastructure as code using CloudFormation Templates (CFT).
• Collaborate with Data Scientists and ML Engineers to integrate AI/ML models into production-grade data workflows.
• Write efficient, reusable, and testable code in Python, SQL, and PySpark.
• Ensure data quality, governance, and security across all data platforms.
• Monitor and troubleshoot data pipeline performance and reliability.
• Participate in architectural discussions and contribute to cloud strategy and best practices.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
• 7-10+ years of experience in Data Engineering with a strong focus on AWS Cloud
• Proficiency in Python, SQL, and PySpark.
• Hands-on experience with the following
• AWS Glue
• Apache Kafka
• Amazon S3
• AWS Lambda
• AWS Step Functions
• CloudFormation Templates (CFT)/Terraform
• Basic understanding of AI concepts
• Experience with CI/CD tools and DevOps practices in cloud environments.
• Strong problem-solving skills and ability to work in a fast-paced, collaborative environment.
Nice to Have Skills & Experience
• AWS certifications (e.g., AWS Certified Data Analytics, Solutions Architect)
• Experience with other cloud platforms (Azure, GCP)
• Familiarity with containerization (Docker, ECS) and orchestration tools (Airflow, Step functions)
• Knowledge of data governance frameworks and compliance standards
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.