Job Search Results for Big Data

Insight Global's top Telecommunication client's Labs division is seeking a Sr. Data Engineer to join their 5G Network Automation group. This is an R&D team within their Labs division responsible for... More building new tools/capabilities to automate their Network. The Sr. Data Engineer will join an established team to support two specific programs tied to Wireline Decommissioning and Cash Flow. Deep experience with PySpark and SQL programming is required, and the tech stack includes Databricks and Snowflake environments. Hands on experience with Palantir Foundry is a big plus. On a daily basis the Sr. Engineer will produce data models based on the network, code data pipelines, and use self service analytics tools to visualize insights.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking for a Lead Data Engineer to come join their team. This candidate will be helping design and deliver modern data solutions using cloud-based platforms and AI-driven... More innovations. You will partner with business, technology, and governance teams to enable scalable, secure and compliant data platforms that power advanced analytics and AI. You will act as the enterprise expert for designing, developing, and optimizing data processing systems and pipelines used to populate data into transactional databases, data warehouses, data marts, or other data repositories. You will also coordinate with other IT teams to configure and implement security, monitoring, tooling, and related capabilities as they apply to their assigned systems. The Day-to-Day:?Use Agile practices to elicit and refine requirements through an iterative process of planning, defining acceptance criteria, prioritizing, developing and delivering enterprise data asset solutions in collaboration with business intelligence teams or other IT teams?Develop, configure, customize and manage integration tools, databases, warehouses and analytical systems?Design, build, and deploy data extraction, transformation, and loading processes and pipelines from various sources including databases, APIs, and data files?Develop and deploy structured, semi-structured, and unstructured data storage models such as data vault or dimensional modeling on a various platforms to meet business requirements?Coordinate security, application monitoring, development tooling, and related capabilities with responsible teams?Provide operational support and incident management for data pipelines and data flows, including proactively updating internal clients and relevant parties on status changes and issues encountered?Author and maintain accurate and up-to-date documentation for processes, procedures, and technical designs?Coach junior data and business intelligence personnel across the company, including developing material and guiding junior personnel on their technical skill growthWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We?re seeking a highly skilled Data Engineer to design, build, and maintain production-grade data pipelines that process and transform terabytes of data. In this role, you?ll collaborate closely with... More data scientists and other SWEs to ensure that our data infrastructure is scalable, reliable, and cost-effective.Salary Range - $150,000 - $220,000We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

?Design, build, and maintain highly scalable and reliable data pipelines to move and transform data across large-scale, distributed systems at exabyte scale.?Architect, implement, and deploy new data... More models and data processing workflows in production, ensuring data quality, integrity, and compliance with data privacy regulations.?Collaborate with cross-functional teams ? including software engineers, data scientists, and product managers ? to understand data requirements and deliver effective, high-impact solutions.?Develop and optimize data-driven systems and solutions to enhance operational scale, efficiency, and generate actionable business insights aligned with evolving product and business needs.?Work closely with engineering teams to plan and execute on half-yearly roadmaps that align with business priorities and available engineering capacity.?Perform data quality monitoring, root cause analysis, and proactive resolution of data pipeline issues to ensure high reliability and trust in data assets.?Develop comprehensive documentation for all data pipelines, models, and related processes, and cross-train team members on new and evolving data systems.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking for a Sr. Data Engineer to come join their team. This candidate will be helping design and deliver modern data solutions using cloud-based platforms and AI-driven... More innovations. You will partner with business, technology, and governance teams to enable scalable, secure and compliant data platforms that power advanced analytics and AI. You will act as the enterprise expert for designing, developing, and optimizing data processing systems and pipelines used to populate data into transactional databases, data warehouses, data marts, or other data repositories. You will also coordinate with other IT teams to configure and implement security, monitoring, tooling, and related capabilities as they apply to their assigned systems. The Day-to-Day:?Use Agile practices to elicit and refine requirements through an iterative process of planning, defining acceptance criteria, prioritizing, developing and delivering enterprise data asset solutions in collaboration with business intelligence teams or other IT teams?Develop, configure, customize and manage integration tools, databases, warehouses and analytical systems?Design, build, and deploy data extraction, transformation, and loading processes and pipelines from various sources including databases, APIs, and data files?Develop and deploy structured, semi-structured, and unstructured data storage models such as data vault or dimensional modeling on a various platforms to meet business requirements?Coordinate security, application monitoring, development tooling, and related capabilities with responsible teams?Provide operational support and incident management for data pipelines and data flows, including proactively updating internal clients and relevant parties on status changes and issues encountered?Author and maintain accurate and up-to-date documentation for processes, procedures, and technical designs?Coach junior data and business intelligence personnel across the company, including developing material and guiding junior personnel on their technical skill growthWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

A client is seeking a Senior Data Engineer to join their growing Data Engineering team! This person will will play a key role in shaping bothcustomer-facing and business-facing data products that... More align with their mission. Yourtechnical expertise and analytical acumen will contribute to designing and buildingextensive data sets that impact thousands of internal users and millions of members.Join a world-class data engineering team dedicated to advancing your skills and careerin data engineering and beyond.Essential Functions: -Collaborate with engineers, product managers, and data scientists tounderstand data needs and develop end-to-end data pipelines, solutions, andfoundational data sets-Design and own the data architecture for large-scale projects, making informeddecisions about design and operational trade-offs-Build, launch, and optimize sophisticated data pipelines, data models, andvisualizations that support diverse use cases across multiple products ordomains-Define and manage Service Level Agreements (SLAs) for all data sets withinareas of ownership-Implement data security models based on privacy requirements, ensurecompliance with safeguards, address data quality issues, and evolve datagovernance processes-Solve complex data integration challenges using optimal ETL/ELT patterns,frameworks, and query techniques for both structured and unstructured datasources-Maintain and enhance existing production processes by optimizing complexcode using advanced algorithmic concepts-Optimize pipelines, dashboards, frameworks, and systems to streamline dataartifact development-Mentor team members, providing and receiving actionable feedback to fosterskill growth and collaborationWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking for a Lead Data Engineer to come join their team. This candidate will be helping design and deliver modern data solutions using cloud-based platforms and AI-driven... More innovations. You will partner with business, technology, and governance teams to enable scalable, secure and compliant data platforms that power advanced analytics and AI. You will act as the enterprise expert for designing, developing, and optimizing data processing systems and pipelines used to populate data into transactional databases, data warehouses, data marts, or other data repositories. You will also coordinate with other IT teams to configure and implement security, monitoring, tooling, and related capabilities as they apply to their assigned systems. The Day-to-Day:?Use Agile practices to elicit and refine requirements through an iterative process of planning, defining acceptance criteria, prioritizing, developing and delivering enterprise data asset solutions in collaboration with business intelligence teams or other IT teams?Develop, configure, customize and manage integration tools, databases, warehouses and analytical systems?Design, build, and deploy data extraction, transformation, and loading processes and pipelines from various sources including databases, APIs, and data files?Develop and deploy structured, semi-structured, and unstructured data storage models such as data vault or dimensional modeling on a various platforms to meet business requirements?Coordinate security, application monitoring, development tooling, and related capabilities with responsible teams?Provide operational support and incident management for data pipelines and data flows, including proactively updating internal clients and relevant parties on status changes and issues encountered?Author and maintain accurate and up-to-date documentation for processes, procedures, and technical designs?Coach junior data and business intelligence personnel across the company, including developing material and guiding junior personnel on their technical skill growthWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking for a Data Architect to join one of our large automotive manufactures in a hybrid role in Southfield, MI. This person is responsible for the design, governance, and... More evolution of enterprise-scale data platforms and architectures. This role provides senior-level technical leadership in defining data standards, security, and governance while partnering with business and technology stakeholders to translate enterprise data needs into scalable, secure, and cost-effective data solutions. The role operates as an individual contributor and recognized subject matter expert, with accountability for architectural decisions that impact enterprise data platforms. Other responsbilites include: - Leads the end-to-end architecture and design of scalable enterprise data solutions, including data platforms, data pipelines, and data integration frameworks.- Establishes and enforces data architecture standards, principles, and best practices to ensure consistency, scalability, and maintainability across the organization.- Partners with business leaders, data scientists, analysts, and IT teams to assess current and future data architecture needs and translate requirements into technical roadmaps.- Provides technical leadership and guidance on data governance, security, access controls, and compliance, ensuring alignment with enterprise and regulatory standards.- Defines and maintains data models, data repositories, data dictionaries, and metadata standards to support enterprise analytics and reporting needs.- Designs strategies for data performance optimization, capacity planning, monitoring, and future scalability of enterprise data platforms.- Advises management on data architecture concepts, platform capabilities, risks, and trade-offs, supporting informed decision-making.- Reviews and approves architectural designs and data solutions to ensure alignment with enterprise standards and long-term strategy.- Participates in cross-functional forums, boards, and committees to provide architectural input and guide future data platform direction.- Acts as a technical advisor and mentor to less experienced professionals, sharing expertise and promoting best practices.- Takes ownership and accountability for architectural decisions impacting data quality, security, performance, and cost.- Performs other duties as assigned.$60/hr to $80/hr : Exact compensation may vary based on several factors, including skills, experience, and education. Benefit packages while on contract for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

The Databricks R&D Operations Organization is seeking a highly motivated and technically skilled Technical Program Manager (TPM) to lead and oversee data annotation programs that power our... More cutting-edge AI research initiatives. This role sits at the intersection of program management, data operations, and AI/ML, and will play a pivotal part in ensuring that our data annotation efforts are scalable, high-quality, and aligned with the needs of our research and product teams.You will collaborate closely with researchers, data scientists, ML engineers, and vendor operations to drive the end-to-end lifecycle of large-scale data labeling and curation efforts ? from strategy and planning to execution, delivery, and quality evaluation.Responsibilities include: ? Program Ownership: Drive large-scale data annotation programs end-to-end, from scoping requirements to delivery and post-mortem analysis.? Cross-Functional Collaboration: Partner with AI Research leadership, AI researchers, data scientists, ML engineers, and product managers to define data needs, success metrics, and annotation guidelines.? Vendor & Workforce Management: Manage external annotation vendors and internal labeling teams, including contract negotiation, SLAs, quality standards, and throughput planning.? Quality & Process: Design and implement robust quality control pipelines, annotation tools, and feedback loops to ensure data quality at scale.? Tooling & Automation: Collaborate with engineering to improve annotation infrastructure, workflows, and data pipelines for efficiency and scalability.? Data Strategy & Governance: Contribute to data governance best practices, including privacy, security, ethics, and compliance in annotation workflows.? Reporting & Metrics: Define and track key program metrics (cost, quality, speed, volume), and regularly communicate progress to stakeholders and leadership.? Internal Adoption: Coordinate internal adoption of agentic AI products by building onboarding processes, workflows, and change management strategies.? Data Quality Leadership: Establish and standardize processes for measuring, monitoring, and improving data quality across datasets and annotation teams.? Customer Engagement: Collaborate with external customers and research partners on evaluation workshops, pilots, and feedback sessions to drive continuous improvement.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

An employer in San Francisco, CA is seeking a Remote Data Process Optimization Consultant to join their Land Acquisition team. This person will evaluate current data system process and document... More system enhancements for more streamlined connections and opportunities for automation. This is a critical role for an expert who can transition a manual, spreadsheet-heavy environment into a streamlined, automated ecosystem.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less