Job Description
We are looking for an experienced Senior Batch Operations Lead with a strong background in Data Engineering, GCP, and Python, who has predominantly worked on large-scale batch data processing ecosystems.
Key Responsibilities
Lead and manage enterprise-scale batch data operations and production support.
Monitor, troubleshoot, and optimize critical batch workflows and pipelines.
Drive incident management, RCA, and operational excellence for data platforms.
Collaborate with engineering, platform, and business teams to ensure SLA adherence.
Automate operational workflows using Python and cloud-native tooling.
Improve reliability, scalability, and observability of batch processing systems.
Participate in release management, deployment coordination, and change governance.
Mentor junior engineers and establish operational best practices.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
Strong experience in Data Engineering / Data Platform Operations
Hands-on expertise in:
Google Cloud Platform (BigQuery, Cloud Composer, Pub/Sub, Cloud Function, Cloud Run, GCS, Dataflow, etc.)
Python scripting and automation
SQL and ETL orchestration
Extensive experience supporting and managing batch-oriented data pipelines
Experience with production support, monitoring, alerting, and incident handling
Familiarity with workflow orchestration tools like Airflow / Cloud Composer
Understanding of data reliability, scheduling, dependency management, and recovery handling
Infrastructure as Code (Terraform preferred)
Exposure to CI/CD and DevOps practices is preferred
Nice to Have Skills & Experience
Experience handling high-volume enterprise batch systems
Knowledge of observability and monitoring tools
Exposure to hybrid cloud or multi-environment deployments
Strong stakeholder communication and leadership skills
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.