Job Description
We are in the design and implementation phase of our data platform and will soon transition into ongoing management, optimization, and maintenance. We’re looking for Azure Databricks Engineers who can help lay the right technical foundation while also contributing to a calm, collaborative, and solution focused team environment.
What This Role Will Do
• Participate in the design, build, and implementation of our Azure Databricks environment.
• Develop and maintain data pipelines, including ingesting, transforming, and flattening data for downstream use.
• Help create a workspace and data foundation that seamlessly supports Power BI and future analytics capabilities.
• Lead and contribute to the configuration, setup, and best practice standards for the Databricks environment.
• Provide input on the right solutions and architectural approaches, while learning from and participating in the broader design process.
The hourly rate for this position is $70-$75 based on several factors including experience, education, etc. Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
5+ years of databricks engineering experience
Experience with Data Lake storage, Data Factory, Key Vault, Event Hubm and Azure DevOps
Experience with Spark/PySpark
Experience with noSQL databases (Azure Cosmos preferred)
Experience with Notebook development & CI/CD
Experience with the design and implementation phase of Azure databricks
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.