Job Search Results for Big Data

Job Description: Lead complex technology initiatives including those that are companywide with broad impact. Act as a key participant in developing standards and companywide best practices for... More engineering complex and large scale technology solutions for technology engineering disciplines. Design, code, test, debug, and document for projects and programs. Review and analyze complex, large-scale technology solutions for tactical and strategic business objectives, enterprise technological environment, and technical challenges that require in-depth evaluation of multiple factors, including intangibles or unprecedented technical factors. Make decisions in developing standard and companywide best practices for engineering and technology solutions requiring understanding of industry best practices and new technologies, influencing and leading technology team to meet deliverables and drive new initiatives. Collaborate and consult with key technical experts, senior technology team, and external industry groups to resolve complex technical issues and achieve goals. Lead projects, teams, or serve as a peer mentor. We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

An employer is seeking a Senior Data Engineer to support the Data Strategy & Operations function. This role will focus on building and managing scalable data integration patterns into Data 360,... More onboarding third-party data providers, and ensuring reliable ingestion, transformation, and distribution of data across the organization.The ideal candidate will combine strong technical expertise in modern data engineering stacks with hands-on experience building and maintaining production-grade pipelines in a fast-paced environment.He or she will be responsible for:Design and deliver new data integrations from third-party data providers into Data 360Manage and enhance existing ingestion pipelines to support new datasets and evolving business needsDevelop and maintain data egress patterns to distribute data outputs to multiple downstream systems and platformsMonitor, maintain, and troubleshoot batch and real-time data pipelines to ensure reliability and performanceTrack and report key ingestion KPIs including data volume, number of streams, pipeline health, and throughput metricsCollaborate closely with Product, Data Science, and Analytics teams to support data-driven initiativesEnsure data quality, integrity, and availability across all pipelines and integrationsThis role is fully remote with the preference being located with PST or CST time zone preference.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are looking for a highly skilled Senior Data Engineer to help support a variety of projects that will range in scale and complexity within the Big Data Team. The ideal candidate will possess... More extensive experience in cloud-based data platforms, SQL, Python programming, dbt, orchestration/scheduling tools, and monitoring/observability tools. You will play a critical role in designing, developing, and supporting our data ingestion pipelines, ensuring seamless integration of data from the company's various sources to support robust analytics and business intelligence.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Sr. Consultant ? Enterprise Data & Records to join a leading financial services client in Toronto on a 3-month contract with potential to convert. This role sits within... More the data governance and risk function and focuses on improving how data is managed, governed, and leveraged across the organization.The ideal candidate will have a strong background in process improvement, data/analytics, and risk or compliance environments, with the ability to bridge business and technology teams. You will be responsible for driving end-to-end process transformation, enhancing data governance practices, and delivering insights through reporting and dashboards to support executive decision-making.This is a highly cross-functional role, requiring someone who can translate complex data and risk concepts into clear, actionable insights, influence stakeholders, and lead initiatives that improve efficiency, compliance, and overall data quality across the enterprise.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

The Data Engineer is responsible for architecting, developing, and maintaining enterprise-scale data platforms that support analytics, operational reporting, and machine learning initiatives. This... More role requires deep technical expertise in distributed systems, cloud platforms, and data modeling, combined with strong communication and leadership capabilities.Design and implement large-scale ETL/ELT pipelines using Python, Spark, and distributed processing frameworksDevelop and maintain big data infrastructure leveraging Hadoop, Spark, Kafka, and Kafka StreamsArchitect cloud-native data solutions on AWS or Azure, including serverless componentsBuild and optimize Snowflake data warehouses using dimensional modeling best practicesConduct data discovery and source analysis to support new integrations and transformationsModel complex datasets using normalized, denormalized, star, and snowflake schemasIntegrate external systems through RESTful APIs and automated ingestion frameworksImplement DevOps practices including CI/CD, containerization, and orchestrationDevelop real-time streaming applications using Kafka, Storm, Kinesis, or Pub/SubOperationalize machine learning models in collaboration with data science teamsOptimize performance across queries, pipelines, and distributed workloadsTroubleshoot and resolve complex data issues across upstream and downstream systemsMaintain comprehensive documentation for data pipelines, models, and integrationsWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

The Senior Data Scientist will play a pivotal role in driving data-driven decision-making processes and developing advanced analytical models. This may involve leading or participating in cross... More functional/operating units? collaborations to define and develop applications of Artificial Intelligence and Machine Learning towards solving insurance problems. Building, refining, and improving existing models as well as developing new techniques and applications to different areas of insurance. The role requires a blend of strong technical expertise, statistical analysis, software engineering and a deep understanding of the insurance industry.? Collaborate with cross functional teams, including Actuaries, Underwriters, Product Managers to identify and define data science initiatives aligned with BRSS business goals and strategy.? Develop predictive models to assess risks and loss probabilities, enabling effective underwriting decisions and pricing strategies.? Utilize Machine Learning algorithms and statistical methods to analyze insurance trends, customer behaviors and market dynamics.? Design and implement experiments to test hypotheses and provide intuitive solutions to what happened, when, where and why, using data to enhance customer retention and profitable growth.? Create visualizations, dashboards, and slide decks to effectively communicate complex findings to non-technical stakeholders.? Conduct exploratory data analysis to identify patterns, anomalies, and opportunities for process improvements.? Collaborate with data engineers to develop data pipelines and integrate data sources ensuring data quality and integrity.? Build platforms and applications to accelerate data science operations including Model Monitoring and improve process efficiencies of business workflows.? Stay abreast of industry trends, emerging technologies and best practices in data science and insurance analytics.Pay rate ranges $55/hr - $65/hrWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

?Design and implement scalable, secure, and high-performance data engineering frameworks?Build and maintain ETL/ELT pipelines to support data ingestion, transformation, and integration?Leverage... More Snowflake features (Snowpipe, Streams & Tasks, Native Apps) and DBT for building scalable, enterprise-grade data solutions across ingestion, transformation, and orchestration?Optimize Synapse SQL Dedicated Pools to enhance BI performance?Build data pipelines that seamlessly connect to reporting platforms such as Tableau and Power BI, enabling interactive and timely business insights?Ensure data accuracy and integrity through validation checks, lineage tracking, and quality monitoring?Tune workflows for performance and cost-efficiency at scalePay Rate: $10.00-$14.00 an hour depending on skills and experienceWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking to hire a Hadoop Developer for one of our large financial clients in the Charlotte, NC area. We are looking fro a Mid-level to Senior software developer to design, develop,... More maintain and test software for the ECR RCF team, collaborating with the development team and business partners to ensure successful delivery and implementation of application solutions in a dynamic Agile environment. Candidate?s ability to achieve subject matter expertise quickly on new applications is needed. This role requires proven track record in strong data base skills working on Oracle/SQL Server/Exadata, performance tuning, ETL processes, Windows and Linux environments. Experience in multiple database platforms is preferred: SQL Server, Oracle, Exadata, Big data. Programming experience on Java, Hadoop / Big Data, Hadoop and Java scripting, Angular 5, React, NodeJS, a plus.Responsibilities include:o Develop, support Enterprise Credit Risk ETL platformo Develop unit / integration / regression / performance test scripts/ test suites for the frameworko Follow Agile development process - work refinement, estimation, retrospectives, etc. ritualso Interface with users and other team members, understand requirements and engineer and analyze solution optionso Communicate solution effectively to team / teams and play a mentor role for junior resourceso Engage Architecture team as needed during development and supporto Participate in POCs - evaluate tools and technologies as neededWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

The Data Engineer is responsible for architecting, developing, and maintaining enterprise-scale data platforms that support analytics, operational reporting, and machine learning initiatives. This... More role requires deep technical expertise in distributed systems, cloud platforms, and data modeling, combined with strong communication and leadership capabilities.Design and implement large-scale ETL/ELT pipelines using Python, Spark, and distributed processing frameworksDevelop and maintain big data infrastructure leveraging Hadoop, Spark, Kafka, and Kafka StreamsArchitect cloud-native data solutions on AWS or Azure, including serverless componentsBuild and optimize Snowflake data warehouses using dimensional modeling best practicesConduct data discovery and source analysis to support new integrations and transformationsModel complex datasets using normalized, denormalized, star, and snowflake schemasIntegrate external systems through RESTful APIs and automated ingestion frameworksImplement DevOps practices including CI/CD, containerization, and orchestrationDevelop real-time streaming applications using Kafka, Storm, Kinesis, or Pub/SubOperationalize machine learning models in collaboration with data science teamsOptimize performance across queries, pipelines, and distributed workloadsTroubleshoot and resolve complex data issues across upstream and downstream systemsMaintain comprehensive documentation for data pipelines, models, and integrationsWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

A healthcare client of ours is looking for multiple Data Engineers to join their growing team. This team is currently working on a project to modernize on prem SQL warehouses to snowflake. The data... More warehouse is built, so you will be supporting the build out of data marts on top of their Snowflake enterprise warehouse. This includes lifting and shifting existing data marts, building net new data marts, and further integrations. Additionally, the data engineering team designs, tests, deploys and maintains data pipelines and establishes a strong data reporting environment. This company operates within an AWS environment which is supported by their DevOps team; however, any cloud integration experience could be helpful. This position is currently slated as a 6-month contract, with high likelihood to extend for an additional 6+ months. Furthermore, this org has a large pipeline of project work for the next three years, so continuous extensions are likely. Insight Global offers full benefits while on contract. If you're interested, apply today!We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less