Job Search Results for data engineer

This role is hybrid. Required 2 days/wk onsite. Responsible for building and supporting a GCP based ecosystem designed for enterprise-wide analysis of structured, semi-structured, and unstructured... More data. Support regular requests to move data from one cluster to another.Manage production support teams to make sure service levels are maintained and any interruption is resolved in a timely fashion.Analyze requirements, design AI/ML based solutions, and integrate those solutions for customer environments.Closely collaborates with team members to successfully execute development initiatives using Agile practices and principles. Leads efforts to design, development, deploy, and support software systems.Collaborates with business analysts, project lead, management and customers on requirements.Participates in the deployment, change, configuration, management, administration and maintenance of deployment process and systems.Gather requirements, designs, constructs and delivers solutions with minimal team interaction.Bring new data sources into GCP/HDFS, transform and load to databases.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a hands-on Data Engineer to support Bloomberg market data platforms and Trade Operations initiatives for our asset management client located in New York City. The role... More requires 3 days per week onsite in their office. This role will focus on Bloomberg data ingestion, historical data management, and backend database development within a financial services environment. The engineer will work closely with Operations and Technology stakeholders to streamline Bloomberg data usage, eliminate duplication, optimize workflows, and support downstream consumers. This person should understand the "SELECT *" feature of SQL and feel confident using it. Strong ownership, communication skills, and the ability to operate independently are critical.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are seeking an experienced Data Engineer to support the design, implementation, and governance of a large-scale Enterprise Data Management (EDM) platform for a Market Data organization within a... More leading financial services institution. This individual will be responsible for designing and building the data architecture, ingestion pipelines, governance framework, and integration processes that will feed a third-party EDM platform. The role will partner closely with business stakeholders, a third-party vendor, and internal technology teams to ensure high-quality, governed market data is delivered across the enterprise.Key ResponsibilitiesDesign and implement scalable data pipelines to ingest, transform, validate, and distribute market data from multiple internal and external sources.Partner with the EDM platform vendor to define integration requirements and ensure seamless delivery of data into the new platform.Develop logical and physical data models supporting market data, reference data, security master data, and metadata management.Establish and enforce data governance standards, including data lineage, metadata management, data quality controls, and stewardship processes.Work directly with business stakeholders to understand data requirements and translate them into technical solutions.Collaborate with architecture, engineering, and infrastructure teams to define enterprise data standards and integration patterns.Design and implement data quality monitoring, reconciliation, validation, and exception management processes.Create and maintain data catalogs, business glossaries, and documentation supporting regulatory and operational requirements.Support platform testing, data migration activities, and production rollout efforts.Identify and remediate data quality issues, integration gaps, and performance bottlenecks.Provide ongoing support and enhancement recommendations for the enterprise market data ecosystem.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

CDS Visual is looking for a Date engineer with experience in data transformations. This is a collaborative position; Working closely with Product and Engineering Teams to develop and design new... More functionality for our various SaaS web and server-side applications. This person should possess problem solving skills and bring their own ideas to the table.To be successful in this role, the candidate needs to be highly analytical. Needs to be an Expert with Excel; Needs Experience with Backend-Programming, SQL, and a good understanding of various mechanical engineering concepts used in manufacturing entities.Ideally, looking for a Mechanical Engineer, who has experience with backend Software Development.Responsibilities:? Working with Architect and BA, analyze Product Data specifications provided in Spreadsheets and transform those into DB tables for consumption in various CDS platforms.? Work within an Agile team to design, test, and implement technical solutions across various development tools and technologies.? Solve problems by crafting software solutions using maintainable, scalable, and modular code.? Be an advocate for consistent, quality, and decoupled code by writing unit tests and performing code reviews.? Work across multiple codebases and services.? Breakdown complex functionality into manageable deliverables.? Participate in technical documentation for new and existing features.? Motivate, collaborate, and challenge team members to grow individually and as a team.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are looking for a Data Analyst/Engineer to play a central role in a multi-year, firm-wide platform migration initiative. This position is dedicated to building and maintaining the data... More infrastructure required to support the transition of one of our client's core software platforms. The Data Engineer works closely with internal technology, operations, and advisory teams to ensure data integrity, accessibility, and continuity throughout the migration lifecycle.Responsibilities? Design, build, and maintain scalable data pipelines to support the firm-wide platform migration project? Perform data extraction, transformation, and loading (ETL/ELT) across source and destination systems? Conduct data cleaning and validation to ensure accuracy and consistency of migrated data? Develop and manage data orchestration workflows to automate and monitor pipeline execution? Collaborate with cross-functional stakeholders to understand data requirements and translate them into technical solutions? Support data analysis efforts to identify gaps, anomalies, and migration readiness across datasets? Maintain and optimize data storage and processing architecture within the Azure cloud platform? Document data flows, pipeline logic, and transformation rules to ensure knowledge transfer and long-term maintainability? Participate in testing and quality assurance activities as migration milestones are reachedWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

This person will be joining the Data?Engineering team?and?will be supporting different projects. This person should have experience with using best practices in designing,... More building,?and?managing?data?pipelines, using ETL processes, performing root cause analysis on internal?and?external?data?and?processes. This person should also have experience collaborating with technical peers, designing,?and?implementing internal process improvements: automating manual processes, optimizing?data?deliveryWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

a pharmaceutical company based in San Diego is seeking a Principal level Data Engineer to join their team in support of their Research Data Solutions. The Principal Data Engineer is a senior... More technical leader responsible for designing, building, and optimizing scalable data solutions that support research and scientific data initiatives. This role requires deep expertise in modern data engineering practices, with a strong emphasis on Databricks, Spark, Delta Lake, lakehouse architecture, data quality, version control, performance optimization, and engineering best practices.The Principal Data Engineer partners primarily with business analysts, platform engineers, and other data engineers to translate research data needs into reliable, governed, and reusable data assets. This individual serves as a hands-on technical expert, architectural advisor, and mentor, helping establish standards and patterns for research-focused data engineering across the organization.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

The Data Engineer builds and optimizes scalable data pipelines using AWS, Databricks, and Snowflake. This role focuses on transforming complex data into trusted, analytics-ready datasets while... More ensuring performance, reliability, and cost efficiency. This role will collaborate with business teams to deliver actionable insights; strong written and verbal communication is required.Job Responsibilities:? Design, develop, and maintain data pipelines using AWS Redshift, Databricks, and Snowflake? Ingest, transform, and curate data from multiple sources? Optimize solutions for performance, reliability, scalability, and cost? Implement data quality checks, monitoring, and observability for production pipelines? Perform root cause analysis on data incidents and pipeline failures, and implement preventive fixes to avoid recurrence? Data wrangling of heterogeneous data, exploration and discovery in pursuit of new business insights? Collaborate with analytics and business teams to deliver trusted datasets? Mentor other team members in their efforts to build data engineering skillsets? Assist team management in defining projects, including helping estimate, plan and scope work? Prepare and contribute to presentations required by managementWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

An Oil & Gas customer of Insight Global is looking for a Master Data Engineer to join their team full-time to sit in The Woodlands, TX, on a hybrid schedule 3 days a week and as needed with travel up... More to 5% within the Texas area. The IT division's primary goal over the next few years is focused on their Data Transformation efforts that will support all of the company's domains for midstream assets. This person will be designing, developing, and deploying innovative data and analytical solutions to enhance current operations and shape the future of the organization. The salary range for this role is dependent on level of experience with a flexible range of $120,000-$200,000 annually.Responsibilities:Collaborate with data stewards to design, develop and prioritize capabilities to accurately capture high quality data.Maintain and improve existing master data management systems while evaluating and implementing future improvements and solutions.Review integration complexities of current and future systems and understand the effects of combining data from different systems.Design, build, and manage data pipelines to ingest, transform, and distribute master data between enterprise systems and Azure destinations.Write complex system queries into operational systems to extract datasets that meet master data source ingestion requirements.Employ programming languages like Java and Python in relation to enhancing master data applications.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Serve as the hands-on engineering lead driving technical discovery, migration execution, and modernization of the client?s legacy Oracle data platform into a scalable, AI-ready Postgres... More ecosystem.This role focuses on building robust data pipelines, migration frameworks, and validation mechanisms to enable analytics, predictive CX, and future AI/ML workloads.Technical Discovery & Assessment?Perform deep analysis of: oOracle schemas, stored procedures, and data modelsoExisting ETL/ELT pipelines, batch jobs, and performance bottlenecks?Identify migration complexity, technical debt, and optimization opportunitiesData Mapping & Migration Design?Define source-to-target mappings from Oracle ? Postgres?Document: oData transformationsoBusiness rulesoLineage and dependencies?Establish migration approaches including: oSchema conversionoData replication and validation strategiesBuild scalable pipelines for: ?Ingestion?Transformation?Replication and synchronizationEnable transition from batch-driven systems ? real-time/event-driven architectureSchema Modernization & AI Readiness?Redesign schemas to support: oAI/ML workloadsoReal-time analyticsoHigh-frequency ingestion?Enable AI-extensible and vector-ready data structures (e.g., embeddings support, pgvector or similar patterns) ?Support separation of operational vs analytical workloadsPipeline Development & Validation?Build and validate: oData ingestion and transformation pipelinesoData quality and reconciliation frameworks?Develop proof-of-concepts for: oNear real-time processingoScalable pipeline patterns?Ensure data accuracy, completeness, and consistency post-migrationPerformance Optimization?Recommend and implement: oPartitioning and clustering strategiesoIndexing and query optimization?Tune Postgres workloads for: oHigh concurrencyoLarge-scale analytical queriesoMixed OLTP + analytical use casesObservability, Data Quality & Governance?Design and implement: oMonitoring, logging, and alerting frameworksoData quality checks and SLA monitoring?Integrate observability into pipelines to ensure reliability and traceability?Align with: oData governance policiesoSecurity and compliance standardsDelivery & Collaboration?Collaborate with: oData architects on target-state designoBusiness analysts on requirements and validation?Support modernization sequencing by identifying: oRisksoDependenciesoImplementation constraints?Produce: oImplementation-ready designsoTechnical documentationoMigration playbooksWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less