Job Description
The Senior Data Engineer plays a senior role in the design, development, and maintenance of constructing and populating a data lakehouse. This position helps develop and improve processes and techniques that ensure efficient data processing and high data quality to power analytics. The role applies technical expertise to design data architecture and data models and to build pipelines that populate the various data zones (bronze, silver, and gold) within a data lakehouse architecture.
JOB RESPONSIBILITIES:
Lead end-to-end technical delivery of complex data and analytics solutions, ensuring scalability, reliability, and alignment to business outcomes
Design, build, and optimize data pipelines and analytical data models (batch and near real-time) to support enterprise reporting, BI, and advanced analytics use cases
Assess source systems and data quality, defining transformation logic, data standards, and controls to meet business definitions and governance requirements
Partner with business and technical stakeholders to translate requirements into technical designs, and contribute to estimation, planning, and delivery sequencing
Drive data architecture and engineering best practices, including modular design, reusability, performance optimization, and cost efficiency
Mentor and coach team members, elevating overall engineering capability through guidance, knowledge sharing, and hands-on support
Perform code and design reviews, ensuring adherence to standards, maintainability, and optimal performance of data solutions
Lead root cause analysis and issue resolution, implementing preventative measures and performance improvements across pipelines and platforms
Continuously improve delivery processes, identifying opportunities to increase speed, quality, automation, and reliability
Implement and enforce data governance practices, including lineage, documentation, data quality checks, and secure data handling
Collaborate with platform and infrastructure teams to ensure optimal use of cloud data platforms (e.g., Snowflake, Azure), including performance tuning and cost management
Support DevOps and CI/CD practices for data engineering, including automated testing, deployment pipelines, and environment management
Ensure operational excellence, including monitoring, alerting, and SLAs for critical data pipelines and data products
Contribute to platform strategy and tool selection, evaluating new technologies to enhance data engineering capabilities and self-service enablement
Reads and follows the Underwriters Laboratories Code of Conduct and all physical and digital security practices.
Performs other duties as directed. None of the foregoing information in any way states or implies that these are the only duties to be performed by an employee occupying this position. Employees will be required to follow other job-related instructions and perform other job-related duties as requested. Duties are not necessarily comprehensive and are subject to change at any time at the discretion of management. Consult the position qualifications for this job when using the position profile for hiring, transfer, or promotion decisions or when providing career guidance.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
• Bachelor’s degree in Computer Science, Engineering, Mathematics, Statistics or related field
• Deep Experience with data transformation, ETL/ELT and data management
• Deep Experience with writing and optimize complex SQL
• Experience with data modeling using dimensional modeling techniques (Star Schema)
• Experience in cloud infrastructure, computing, on Big Data platforms
• Understanding of structured, unstructured, semi-structured data
• Experience with data streaming, messaging, and event driven data architecture
• Knowledge in data governance and data quality frameworks
• Experience of working in an Agile environment
• Experience working with all NoSQL Databases e.g. Graph, Document, Column
• Knowledge of machine learning and artificial intelligence concepts
• Ability to articulate an idea with strong communication and presentation skills
• Work as part of a small team, sharing ideas and contributing to the strategic goals
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.