Job Description
We are seeking a highly experienced Senior AI Developer with strong Databricks expertise to lead the design, architecture, and implementation of scalable AI and data solutions. This role goes beyond development and requires ownership of end-to-end solution architecture within the Databricks Lakehouse ecosystem, ensuring high performance, scalability, and enterprise readiness.
Key Responsibilities
Design and architect end-to-end AI/ML solutions on the Databricks Lakehouse Platform.
Develop and optimize scalable data pipelines using Apache Spark and Databricks.
Define and implement data architecture standards, including Delta Lake and Unity Catalog.
Build and manage end-to-end ML pipelines (data ingestion, training, deployment, monitoring).
Establish and implement MLOps frameworks using MLflow and CI/CD pipelines.
Collaborate with business stakeholders to translate requirements into scalable AI solutions.
Lead technical design discussions and provide architectural guidance across teams.
Ensure performance optimization, cost efficiency, and reliability of Databricks workloads.
Design batch and real-time processing systems (streaming, event-driven architectures).
Integrate advanced AI capabilities such as LLMs and Generative AI into enterprise solutions.
Enforce data governance, security, and compliance best practices.
Mentor junior developers and contribute to team capability building.
Pay Rate: 85-90hr
Location - Houston preferred, Austin, or remote
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
Required Technical Skills
• Strong data science fundamentals (statistics, ML, model development and evaluation)
• Hands-on Azure experience (Azure ML, Azure Functions, Azure AI services)
• Databricks experience, ideally including Unity Catalog and pipeline development
• Comfort with modern AI tooling and APIs (Anthropic, OpenAI, etc.)
• Solid software engineering practices (Git, code review, deployment workflows)
• Python proficiency
Mindset & Vision
• A clear personal vision for where AI is going and what that means for their work
• Sees themselves as a human interface to AI tools, not in competition with them
• Recognizes their own capacity is multiplied by AI and leans into it rather than tries to control it
• Thinks in pipelines, ecosystems, and integrations — not one-off models
• Understands most organizations are barely scratching the surface of what AI can do, and wants to change that here
• Walks in excited (and a little terrified) about what AI can do, and ready to build
Soft Skills
• Self-driven and comfortable defining their own scope
• Strong communicator across technical and business stakeholders
• Collaborative; works well in a small, fast-moving team
• Curious by default, always learning
Nice to Have Skills & Experience
Preferred Experience
• Prior work integrating AI into enterprise environments (M365, ServiceNow, Freshservice, or similar)
• Experience with MCP servers, agentic workflows, or tool-using AI systems
• Background in building internal tools or platforms that other teams adopt
• Exposure to Microsoft Graph API or similar enterprise data layers
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.