Job Search Results for big data

Insight Global is seeking a hands-on Principal Data Architect to sit hybrid at a cybersecurity client in Newport Beach, San Jose, or Frisco Texas. You bring a strong background in big data... More engineering, modern lakehouse architectures, and decentralized data governance. This is a unique opportunity to define the strategic vision for their next-generation data platform, transition our ecosystem to a Data Mesh paradigm, and implement robust security standards across a petabyte-scale environment.(This role can pay 220,000-245,000 based on years of experience).We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking for a Lead Data Engineer to come join their team. This candidate will be helping design and deliver modern data solutions using cloud-based platforms and AI-driven... More innovations. You will partner with business, technology, and governance teams to enable scalable, secure and compliant data platforms that power advanced analytics and AI. You will act as the enterprise expert for designing, developing, and optimizing data processing systems and pipelines used to populate data into transactional databases, data warehouses, data marts, or other data repositories. You will also coordinate with other IT teams to configure and implement security, monitoring, tooling, and related capabilities as they apply to their assigned systems. The Day-to-Day:?Use Agile practices to elicit and refine requirements through an iterative process of planning, defining acceptance criteria, prioritizing, developing and delivering enterprise data asset solutions in collaboration with business intelligence teams or other IT teams?Develop, configure, customize and manage integration tools, databases, warehouses and analytical systems?Design, build, and deploy data extraction, transformation, and loading processes and pipelines from various sources including databases, APIs, and data files?Develop and deploy structured, semi-structured, and unstructured data storage models such as data vault or dimensional modeling on a various platforms to meet business requirements?Coordinate security, application monitoring, development tooling, and related capabilities with responsible teams?Provide operational support and incident management for data pipelines and data flows, including proactively updating internal clients and relevant parties on status changes and issues encountered?Author and maintain accurate and up-to-date documentation for processes, procedures, and technical designs?Coach junior data and business intelligence personnel across the company, including developing material and guiding junior personnel on their technical skill growthWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We?re seeking a highly skilled Data Engineer to design, build, and maintain production-grade data pipelines that process and transform terabytes of data. In this role, you?ll collaborate closely with... More data scientists and other SWEs to ensure that our data infrastructure is scalable, reliable, and cost-effective.Salary Range - $150,000 - $220,000We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

One of our clients within the Financial Services space is looking for a full-time Data Engineer to support their organization. This position is part of the Enterprise Data & Analytics Capability... More team under Global Technology Organization. In this role, you will lead the design, development, and optimization of large-scale data solutions on the Databricks platform. Day to day responsibilities include the following:?Design, build, and maintain scalable data pipelines on Databricks (using Spark, Delta Lake, etc.)?Write clean, efficient and maintainable PySpark or SQL code for data transformation?Design robust data models for analytics and reporting?Ensure data quality, consistency, and governance?Handle batch and streaming data workflows?Provide architectural guidance and support in platform usage?Drive best practices in data engineering across the team?Monitor and optimize performance of Spark jobs and cluster usage?Ensure compliance with security and data privacy standardsWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

?Design, build, and maintain highly scalable and reliable data pipelines to move and transform data across large-scale, distributed systems at exabyte scale.?Architect, implement, and deploy new data... More models and data processing workflows in production, ensuring data quality, integrity, and compliance with data privacy regulations.?Collaborate with cross-functional teams ? including software engineers, data scientists, and product managers ? to understand data requirements and deliver effective, high-impact solutions.?Develop and optimize data-driven systems and solutions to enhance operational scale, efficiency, and generate actionable business insights aligned with evolving product and business needs.?Work closely with engineering teams to plan and execute on half-yearly roadmaps that align with business priorities and available engineering capacity.?Perform data quality monitoring, root cause analysis, and proactive resolution of data pipeline issues to ensure high reliability and trust in data assets.?Develop comprehensive documentation for all data pipelines, models, and related processes, and cross-train team members on new and evolving data systems.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a qualified Data Architect in support of one of our federal clients in Hampton, VA. They will be supporting the data side of military operations. The day-to-day will... More include:Serve as the data architecture SME, working closely with customers, data scientists, and data governance teams to shape data strategy and solutions.Gather and translate business and mission requirements into scalable data architectures, explaining technical concepts clearly to non-technical stakeholders.Design data models, data flows, and integration patterns, supporting data migration, ETL pipelines, and streaming workflows across structured and unstructured data.Integrate and fuse ISR datasets (sensor, signal, imagery) into secure, resilient pipelines that support real-time and operational analytics.Perform exploratory data analysis and automate data processes, using tools like Python to improve efficiency and enable higher-value analyst work.Stay current on AI/ML and data architecture trends, continuously assessing how emerging technologies can enhance mission-aligned data solutions.Compensation: $62/hr. to $67/hr. Exact compensation may vary based on several factors, including skills, experience, and education. Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

A client is seeking a Senior Data Engineer to join their growing Data Engineering team! This person will will play a key role in shaping bothcustomer-facing and business-facing data products that... More align with their mission. Yourtechnical expertise and analytical acumen will contribute to designing and buildingextensive data sets that impact thousands of internal users and millions of members.Join a world-class data engineering team dedicated to advancing your skills and careerin data engineering and beyond.Essential Functions: -Collaborate with engineers, product managers, and data scientists tounderstand data needs and develop end-to-end data pipelines, solutions, andfoundational data sets-Design and own the data architecture for large-scale projects, making informeddecisions about design and operational trade-offs-Build, launch, and optimize sophisticated data pipelines, data models, andvisualizations that support diverse use cases across multiple products ordomains-Define and manage Service Level Agreements (SLAs) for all data sets withinareas of ownership-Implement data security models based on privacy requirements, ensurecompliance with safeguards, address data quality issues, and evolve datagovernance processes-Solve complex data integration challenges using optimal ETL/ELT patterns,frameworks, and query techniques for both structured and unstructured datasources-Maintain and enhance existing production processes by optimizing complexcode using advanced algorithmic concepts-Optimize pipelines, dashboards, frameworks, and systems to streamline dataartifact development-Mentor team members, providing and receiving actionable feedback to fosterskill growth and collaborationWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking for a Data Architect to join one of our large automotive manufactures in a hybrid role in Southfield, MI. This person is responsible for the design, governance, and... More evolution of enterprise-scale data platforms and architectures. This role provides senior-level technical leadership in defining data standards, security, and governance while partnering with business and technology stakeholders to translate enterprise data needs into scalable, secure, and cost-effective data solutions. The role operates as an individual contributor and recognized subject matter expert, with accountability for architectural decisions that impact enterprise data platforms. Other responsbilites include: - Leads the end-to-end architecture and design of scalable enterprise data solutions, including data platforms, data pipelines, and data integration frameworks.- Establishes and enforces data architecture standards, principles, and best practices to ensure consistency, scalability, and maintainability across the organization.- Partners with business leaders, data scientists, analysts, and IT teams to assess current and future data architecture needs and translate requirements into technical roadmaps.- Provides technical leadership and guidance on data governance, security, access controls, and compliance, ensuring alignment with enterprise and regulatory standards.- Defines and maintains data models, data repositories, data dictionaries, and metadata standards to support enterprise analytics and reporting needs.- Designs strategies for data performance optimization, capacity planning, monitoring, and future scalability of enterprise data platforms.- Advises management on data architecture concepts, platform capabilities, risks, and trade-offs, supporting informed decision-making.- Reviews and approves architectural designs and data solutions to ensure alignment with enterprise standards and long-term strategy.- Participates in cross-functional forums, boards, and committees to provide architectural input and guide future data platform direction.- Acts as a technical advisor and mentor to less experienced professionals, sharing expertise and promoting best practices.- Takes ownership and accountability for architectural decisions impacting data quality, security, performance, and cost.- Performs other duties as assigned.$60/hr to $80/hr : Exact compensation may vary based on several factors, including skills, experience, and education. Benefit packages while on contract for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking for a sharp team of Data Center Operations Leads to join an AI cloud platform company sitting in New York state. This is a full-time, permanent role with excellent... More compensation and benefits. This role will be located in upstate New York.This company is dedicated to accelerating their go-to-market time in a big way, so it is imperative for this person to be willing to work hard, take ownership from inception to delivery, and approach every problem with a strategic, open mind.As a Team Lead, you will be responsible for overseeing all datacenter operations during your assigned shift, managing a team of technicians, and ensuring the highest levels of reliability and performance for our GPU supercomputing infrastructure. This is a hands-on leadership role that requires both technical expertise and strong people management skills.Day-to-day responsibilities:- Lead and manage all datacenter operations during your assigned shift, ensuring 24/7 reliability of our GPU supercomputing infrastructure- Train and mentor junior technicians to enhance their skills and build a high-performing team- Oversee incident response and troubleshooting, providing technical guidance and escalation support- Develop and implement operational procedures and best practices to improve efficiency and reduce downtime- Coordinate with other shift leads to ensure seamless handovers and consistent operations across all shiftsWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking for an individual to join a top retail client within their eCommerce & Marketing department. The Senior Manager, Business Artificial Intelligence (BAI) and Data Management... More will support the implementation of AI strategy and advanced analytics operations. This role will focus on integrating AI into online (web and marketing) products, merchandising (pricing, forecasting, etc.), and Pro (loyalty, prospecting, etc.), while defining data requirements to enable analytics and AI, conducting research, and collaborating closely with data science partners.As part of a fast-paced and innovative environment, this leader will partner with the business to identify data-driven opportunities, translate business problems into AI solutions, develop an enterprise-aligned roadmap, and guide teams in best practices while evangelizing the strategic use of data across marketing, e-commerce, merchandising, and Pro.The Interconnected Analytics & Data Science team is driving a project called ?Data for All?, which focuses on consolidating all data sources across the organization to a single source. This leader will lead the project, and help drive adoption of AI and machine learning platforms throughout the business. Key ResponsibilitiesBusiness AI Insights?Identify opportunities to apply AI to key business processes (e.g., churn prediction, search optimization, recommendation engines).?Drive AI integrations into new and existing digital features to enhance user experience and competitiveness.?Lead data science teams through the full AI product lifecycle, from ideation to launch, ensuring delivery and ROI.?Streamline the transition of AI and analytics initiatives from development to production.Generative AI Adoption?Champion research and experimentation to advance generative AI use cases, in partnership with the U.S. data science teams.?Foster a culture of continuous learning and innovation around Generative AI across marketing, merchandising, and Pro.Data Management?Oversee digital marketing tagging strategy and Adobe Analytics implementation for web and campaign analytics.?Lead data engineering teams responsible for data quality, governance, and consistency.?Partner closely with IT to ensure appropriate stewardship, security, scalability, and governance of data assets.?Ensure AI solutions meet ethical and regulatory standards and continuously evaluate system performance.Leadership & Team Management?Serve as a subject matter expert in supervised and unsupervised ML techniques and applied AI.?Establish strong big data foundations to support machine learning initiatives.?Influence without direct authority and drive alignment across adjacent analytics and data teams.?Mentor and develop data scientists and junior AI talent.?Stay current on AI and industry trends and propose roadmaps aligned with marketing and e-commerce strategy.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less