Hadoop Developer

Post Date

Mar 16, 2023


Saint Louis,

ZIP/Postal Code

Jul 20, 2024 Insight Global

Job Type



Programmer / Developer

Req #


Pay Rate

$52 - $78 (hourly estimate)

Job Description

Insight Global is looking for a Hadoop Developer for one of our largest financial clients to eventually work in a hybrid environment sit on-site in Charlotte, NC or Dallas, TX. They will be joining the development team that supports our clients main credit risk platform. Under CRP, this person will be dealing with 2 applications-- wholesale risk distribution and an Exadata and Hadoop based application. Key responsibilities of the role include ensuring that software is developed to meet functional, non-functional, and compliance requirements. This person must be able to self-manage work. It is crucial for this candidate to also have experience working in a DevOps environment. This is a production support environment and the ideal candidate must be able to take initiative to troubleshoot and figure out issues and resolutions independently, and identify opportunities for optimization and automation. This role codes solutions, unit tests, and ensures the solution can be integrated successfully into the overall application/system with clear, robust and well-tested interfaces. This person should be proficient with all things Hadoop including best practices around Big Data development, specifically Spark. We would like this individual to also be familiar with Python coding, to assist the current team.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [email protected].

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

Required Skills & Experience

* 5-7+ years of experience as an overall developer/software engineer

* Solid Unix skills

o Bash

o Scripting

o commands

* Strong SQL language skills--ability to write queries

* Strong Hadoop skills

o Hadoop production support experience in a Dev/Ops environment

o Spark development, optimization, and troubleshooting

o Hadoop troubleshooting from a production support perspective

* Strong data and code analysis skills (troubleshooting data quality/integrity root causes)

* Comfortable working with all levels of management

* Comfortable with bringing attention to risks before they become issues.

* Comfortable with leading small efforts

Nice to Have Skills & Experience

* Decent Java skills

* Decent Python skills

* Automated testing experience with Cucumber skills would be a huge bonus

Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.