Our client is one of the largest financial institutions in the world. We are seeking a hands-on AI Engineer to work on a high visibility Gen AI project. This is a Chatbot implementation that will leverage open source technologies and language models to summarize documents and answer questions. The primary users of this application will be internal to the bank from the Treasury and Finance organizations.
This position is for a self-starter with strong technical skills as well as leadership qualities, and should be able to effectively communicate difficult technical concepts.
You will lead the design, development and implementation of complex data management, storage applications, often using new technologies. You will exercise judgment within broadly defined practices and policies in selecting methods, techniques, and evaluation criterion for obtaining results.
The environment and role involves technologies such as:
- LLM Models (Llama, Mixtral, Mistral)
- Various inferencing mechanisms -- transformer/pipeline, vllm
- Agentic framework: langgraph
- Evaluation frameworks: RAGAS, langsmith, phoenix-arize
- Embedding (all-MiniLM-L6-v2, all-mpnet-base-v2)
- LLM development framework : Langchain, LlamaIndex
- Rest API, FastAPI, Websockets
- Enterprise Redis Database, Qdrant, Cockroach
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to
[email protected].
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:
https://insightglobal.com/workforce-privacy-policy/ .
* 3-5+ years of professional experience as a data scientist, data engineer, AI engineer, or similar engineering role executing end-to-end Gen AI projects in an enterprise environment
* Strong experience delivering language models and open source models in an enterprise level environment
* Strong Python programming skills
* Superb communication skills for coaching business and IT stakeholders
* Experience working with Model Risk Governance to deliver a Gen AI project within governance guidelines including:
o Writing a model document
o Building model monitoring capabilities
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.