Job Description
We are seeking a highly skilled Data Platform Engineer to design, build, automate, and support enterprise-scale data platforms across hybrid cloud environments. This role will focus on platform engineering, infrastructure automation, observability, and the operational excellence of modern analytics ecosystems supporting large-scale data products.
The ideal candidate will have deep experience managing distributed data platforms, cloud infrastructure, and big data technologies, while leveraging automation and engineering best practices to enhance reliability, scalability, and performance.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
• 5+ years of professional experience with large-scale data platform, data product development, and platform operations
• 2+ years of experience developing and operating infrastructure, data platforms, and cloud services in hybrid environments (On-prem, AWS, or GCP)
• Hands-on experience with operations automation and observability on HDFS and Objectstores
• Experience with Jupyter Notebook environment automation and operations
• Proficient in one or more programming languages (Python, Java, or Scala) for automation, API integrations, and Spark job development
• Proficient with analytics stack including Apache Spark/Flink, Iceberg, Airflow, and Kubernetes
Nice to Have Skills & Experience
• Knowledge of CI/CD technologies including GitLab, Terraform, Docker/Kubernetes, and cloud monitoring tools (Splunk, Grafana, Datadog)
• Experience implementing security controls, governance processes, compliance validation, infrastructure cost analysis, and optimization
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.