Job Search Results for big data

Our leading entertainment client is expanding their data team and seeking a Data Engineer with deep expertise in GCP, Big Data, Python, SQL, DBT, and ERD architecture. This cross-functional team... More operates across three core areas: AI/ML, Data Engineering, and Data Analytics.? Collaborate with stakeholders across subscription, viewership, marketing, paid media, CRM, and more. ? Support data visualization initiatives and ensure data is accessible and actionable.? Work in a highly collaborative environment that values fast learners and team players. Spend approximately 80% of your time in hands-on development using Python and SQL.Team Dynamic:Data Analytics Engineering (Approx. 80% of time) - Primary Focus: Analyze and maintain data pipelines, conduct root-cause analysis to resolve data-related issues, and create data models leveraging DBT and Medallion architecture.Tools & Skills: ? Proficient in Python and SQL for pipeline development. ? Initially focused on learning and maintaining existing pipelines, with a gradual transition to building new ones. Mindset: Business-oriented with a strong analytical approach. AI/ML Initiatives (Approx. 5% of time) Objective: Support AI and machine learning efforts using modern platforms such as Vertex AI. Scope: Limited involvement, primarily assisting with existing initiatives and tools. Data Engineering (Approx. 15% of time) Responsibilities: Design and implement scalable data models, pipelines, and architecture.Technical Stack: Heavy use of Python and SQL to ensure robust and efficient data infrastructure.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

An employer is seeking a Senior Data Engineer to support the Data Strategy & Operations function. This role will focus on building and managing scalable data integration patterns into Data 360,... More onboarding third-party data providers, and ensuring reliable ingestion, transformation, and distribution of data across the organization.The ideal candidate will combine strong technical expertise in modern data engineering stacks with hands-on experience building and maintaining production-grade pipelines in a fast-paced environment.He or she will be responsible for:Design and deliver new data integrations from third-party data providers into Data 360Manage and enhance existing ingestion pipelines to support new datasets and evolving business needsDevelop and maintain data egress patterns to distribute data outputs to multiple downstream systems and platformsMonitor, maintain, and troubleshoot batch and real-time data pipelines to ensure reliability and performanceTrack and report key ingestion KPIs including data volume, number of streams, pipeline health, and throughput metricsCollaborate closely with Product, Data Science, and Analytics teams to support data-driven initiativesEnsure data quality, integrity, and availability across all pipelines and integrationsThis role is fully remote with the preference being located with PST or CST time zone preference.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are looking for a highly skilled Senior Data Engineer to help support a variety of projects that will range in scale and complexity within the Big Data Team. The ideal candidate will possess... More extensive experience in cloud-based data platforms, SQL, Python programming, dbt, orchestration/scheduling tools, and monitoring/observability tools. You will play a critical role in designing, developing, and supporting our data ingestion pipelines, ensuring seamless integration of data from the company's various sources to support robust analytics and business intelligence.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

The Senior Data Scientist will play a pivotal role in driving data-driven decision-making processes and developing advanced analytical models. This may involve leading or participating in cross... More functional/operating units? collaborations to define and develop applications of Artificial Intelligence and Machine Learning towards solving insurance problems. Building, refining, and improving existing models as well as developing new techniques and applications to different areas of insurance. The role requires a blend of strong technical expertise, statistical analysis, software engineering and a deep understanding of the insurance industry.? Collaborate with cross functional teams, including Actuaries, Underwriters, Product Managers to identify and define data science initiatives aligned with BRSS business goals and strategy.? Develop predictive models to assess risks and loss probabilities, enabling effective underwriting decisions and pricing strategies.? Utilize Machine Learning algorithms and statistical methods to analyze insurance trends, customer behaviors and market dynamics.? Design and implement experiments to test hypotheses and provide intuitive solutions to what happened, when, where and why, using data to enhance customer retention and profitable growth.? Create visualizations, dashboards, and slide decks to effectively communicate complex findings to non-technical stakeholders.? Conduct exploratory data analysis to identify patterns, anomalies, and opportunities for process improvements.? Collaborate with data engineers to develop data pipelines and integrate data sources ensuring data quality and integrity.? Build platforms and applications to accelerate data science operations including Model Monitoring and improve process efficiencies of business workflows.? Stay abreast of industry trends, emerging technologies and best practices in data science and insurance analytics.Pay rate ranges $55/hr - $65/hrWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

?Design and implement scalable, secure, and high-performance data engineering frameworks?Build and maintain ETL/ELT pipelines to support data ingestion, transformation, and integration?Leverage... More Snowflake features (Snowpipe, Streams & Tasks, Native Apps) and DBT for building scalable, enterprise-grade data solutions across ingestion, transformation, and orchestration?Optimize Synapse SQL Dedicated Pools to enhance BI performance?Build data pipelines that seamlessly connect to reporting platforms such as Tableau and Power BI, enabling interactive and timely business insights?Ensure data accuracy and integrity through validation checks, lineage tracking, and quality monitoring?Tune workflows for performance and cost-efficiency at scalePay Rate: $10.00-$14.00 an hour depending on skills and experienceWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

The Data Engineer is responsible for architecting, developing, and maintaining enterprise-scale data platforms that support analytics, operational reporting, and machine learning initiatives. This... More role requires deep technical expertise in distributed systems, cloud platforms, and data modeling, combined with strong communication and leadership capabilities.Design and implement large-scale ETL/ELT pipelines using Python, Spark, and distributed processing frameworksDevelop and maintain big data infrastructure leveraging Hadoop, Spark, Kafka, and Kafka StreamsArchitect cloud-native data solutions on AWS or Azure, including serverless componentsBuild and optimize Snowflake data warehouses using dimensional modeling best practicesConduct data discovery and source analysis to support new integrations and transformationsModel complex datasets using normalized, denormalized, star, and snowflake schemasIntegrate external systems through RESTful APIs and automated ingestion frameworksImplement DevOps practices including CI/CD, containerization, and orchestrationDevelop real-time streaming applications using Kafka, Storm, Kinesis, or Pub/SubOperationalize machine learning models in collaboration with data science teamsOptimize performance across queries, pipelines, and distributed workloadsTroubleshoot and resolve complex data issues across upstream and downstream systemsMaintain comprehensive documentation for data pipelines, models, and integrationsWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Sr. Consultant ? Enterprise Data & Records to join a leading financial services client in Toronto on a 3-month contract with potential to convert. This role sits within... More the data governance and risk function and focuses on improving how data is managed, governed, and leveraged across the organization.The ideal candidate will have a strong background in process improvement, data/analytics, and risk or compliance environments, with the ability to bridge business and technology teams. You will be responsible for driving end-to-end process transformation, enhancing data governance practices, and delivering insights through reporting and dashboards to support executive decision-making.This is a highly cross-functional role, requiring someone who can translate complex data and risk concepts into clear, actionable insights, influence stakeholders, and lead initiatives that improve efficiency, compliance, and overall data quality across the enterprise.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking to hire a Hadoop Developer for one of our large financial clients in the Charlotte, NC area. We are looking fro a Mid-level to Senior software developer to design, develop,... More maintain and test software for the ECR RCF team, collaborating with the development team and business partners to ensure successful delivery and implementation of application solutions in a dynamic Agile environment. Candidate?s ability to achieve subject matter expertise quickly on new applications is needed. This role requires proven track record in strong data base skills working on Oracle/SQL Server/Exadata, performance tuning, ETL processes, Windows and Linux environments. Experience in multiple database platforms is preferred: SQL Server, Oracle, Exadata, Big data. Programming experience on Java, Hadoop / Big Data, Hadoop and Java scripting, Angular 5, React, NodeJS, a plus.Responsibilities include:o Develop, support Enterprise Credit Risk ETL platformo Develop unit / integration / regression / performance test scripts/ test suites for the frameworko Follow Agile development process - work refinement, estimation, retrospectives, etc. ritualso Interface with users and other team members, understand requirements and engineer and analyze solution optionso Communicate solution effectively to team / teams and play a mentor role for junior resourceso Engage Architecture team as needed during development and supporto Participate in POCs - evaluate tools and technologies as neededWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

The Data Engineer is responsible for architecting, developing, and maintaining enterprise-scale data platforms that support analytics, operational reporting, and machine learning initiatives. This... More role requires deep technical expertise in distributed systems, cloud platforms, and data modeling, combined with strong communication and leadership capabilities.Design and implement large-scale ETL/ELT pipelines using Python, Spark, and distributed processing frameworksDevelop and maintain big data infrastructure leveraging Hadoop, Spark, Kafka, and Kafka StreamsArchitect cloud-native data solutions on AWS or Azure, including serverless componentsBuild and optimize Snowflake data warehouses using dimensional modeling best practicesConduct data discovery and source analysis to support new integrations and transformationsModel complex datasets using normalized, denormalized, star, and snowflake schemasIntegrate external systems through RESTful APIs and automated ingestion frameworksImplement DevOps practices including CI/CD, containerization, and orchestrationDevelop real-time streaming applications using Kafka, Storm, Kinesis, or Pub/SubOperationalize machine learning models in collaboration with data science teamsOptimize performance across queries, pipelines, and distributed workloadsTroubleshoot and resolve complex data issues across upstream and downstream systemsMaintain comprehensive documentation for data pipelines, models, and integrationsWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

The Senior Data Engineer plays a senior role in the design, development, and maintenance of constructing and populating a data lakehouse. This position helps develop and improve processes and... More techniques that ensure efficient data processing and high data quality to power analytics. The role applies technical expertise to design data architecture and data models and to build pipelines that populate the various data zones (bronze, silver, and gold) within a data lakehouse architecture. JOB RESPONSIBILITIES: ?Lead end-to-end technical delivery of complex data and analytics solutions, ensuring scalability, reliability, and alignment to business outcomes ? Design, build, and optimize data pipelines and analytical data models (batch and near real-time) to support enterprise reporting, BI, and advanced analytics use cases ?Assess source systems and data quality, defining transformation logic, data standards, and controls to meet business definitions and governance requirements ?Partner with business and technical stakeholders to translate requirements into technical designs, and contribute to estimation, planning, and delivery sequencing ?Drive data architecture and engineering best practices, including modular design, reusability, performance optimization, and cost efficiency ?Mentor and coach team members, elevating overall engineering capability through guidance, knowledge sharing, and hands-on support ?Perform code and design reviews, ensuring adherence to standards, maintainability, and optimal performance of data solutions ?Lead root cause analysis and issue resolution, implementing preventative measures and performance improvements across pipelines and platforms ?Continuously improve delivery processes, identifying opportunities to increase speed, quality, automation, and reliability ?Implement and enforce data governance practices, including lineage, documentation, data quality checks, and secure data handling ?Collaborate with platform and infrastructure teams to ensure optimal use of cloud data platforms (e.g., Snowflake, Azure), including performance tuning and cost management ?Support DevOps and CI/CD practices for data engineering, including automated testing, deployment pipelines, and environment management ?Ensure operational excellence, including monitoring, alerting, and SLAs for critical data pipelines and data products ?Contribute to platform strategy and tool selection, evaluating new technologies to enhance data engineering capabilities and self-service enablement ?Reads and follows the Underwriters Laboratories Code of Conduct and all physical and digital security practices. ?Performs other duties as directed. None of the foregoing information in any way states or implies that these are the only duties to be performed by an employee occupying this position. Employees will be required to follow other job-related instructions and perform other job-related duties as requested. Duties are not necessarily comprehensive and are subject to change at any time at the discretion of management. Consult the position qualifications for this job when using the position profile for hiring, transfer, or promotion decisions or when providing career guidance.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less