Job Description
As an Operational Data Engineer you will design, build, and support reliable operational data platforms and pipelines across systems like eCommerce, OMS, WMS, and 3PL, ensuring high availability, resiliency, and real‑time data flow. The role includes architecting CDC, event‑driven, and batch pipelines; partnering with cross‑functional teams on data contracts and SLAs; monitoring and troubleshooting pipeline issues; implementing data quality and control frameworks; driving CI/CD automation; maintaining documentation; establishing best practices; mentoring junior engineers; and supporting production and seasonal readiness efforts.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
•Bachelor’s degree in Computer Science, Information Technology, or a related field; or equivalent practical experience
•5+ years of experience in data engineering, operational data platforms, integrations, or production data systems
•Strong hands on experience with Azure Databricks, Azure Data Factory, Azure Data Lake Storage (ADLS), Azure SQL / SQL Database, and Azure Key Vault
•Advanced proficiency in SQL and Python, including performance tuning and troubleshooting in production environments
•Strong experience with SQL Database platforms in cloud environments (Azure SQL, managed SQL services, performance optimization)
•Strong experience with incremental loading, CDC patterns, operational data modeling, and large scale data ingestion
•Solid understanding of cloud native data architectures and distributed systems
•Experience with DevOps and CI/CD practices, including source control, automated deployments, and environment management
•Hands on experience with job orchestration and scheduling tools (e.g., Airflow, VisualCron, or equivalent)
•Strong communication skills with the ability to collaborate across technical and business teams
•Proven ability to operate effectively in a high availability, operationally critical environment
Nice to Have Skills & Experience
•Experience building or supporting Power Automate workflows for operational automation and integrations
•Experience defining and maintaining data lineage across operational and analytical data platforms
•Familiarity with event driven architectures, messaging systems, or streaming platforms
•Experience with monitoring, logging, and alerting frameworks for data platforms
•Exposure to Power BI or other visualization tools for operational insights
•Experience using AI assisted development tools such as Microsoft Copilot, GitHub Copilot, Databricks Assistant, or ChatGPT
•Basic understanding of AI/ML concepts and how operational data supports ML workflows
•Retail specific experience
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.