Job Search Results for data engineer

We are seeking a Senior Data Integration & API Engineer to design, develop, and maintain scalable data pipelines that extract data from APIs, ingest that data into Huntington?s enterprise data lake,... More and transform it into structured, consumable datasets for analytics and reporting. This role sits at the intersection of integration architecture, data engineering, and analytics enablement, partnering closely with Data Engineering, Architecture, and business analytics teams to deliver high-quality, governed data assets. Key Responsibilities API Data Integration & Ingestion - Design and develop solutions to extract data from APIs (REST/JSON, OAuth-secured APIs). - Build scalable ingestion pipelines to land data into the Enterprise Data Lake (landing ? raw ? curated layers). - Ensure integrations follow enterprise integration patterns (API Gateway, Event Hub, EIP). - Optimize ingestion patterns (batch vs near real-time). Data Processing & Transformation - Transform raw API data into curated datasets. - Build ETL/ELT pipelines supporting data quality and schema compliance. - Implement partitioning and performance tuning. Data Modeling & Analytics Enablement - Structure data for Snowflake and downstream analytics tools. - Support Tableau dashboards and reporting needs. - Align to enterprise data models. Integration Architecture & Governance - Partner with enterprise architecture teams for API onboarding. - Ensure compliance with data and API standards. Automation & Reliability - Develop automated pipelines and monitoring processes. - Troubleshoot ingestion failures. Success Measures - Reliable ingestion of API data into the data lake - High-quality datasets for analytics - Compliance with enterprise standards - Reduced onboarding time for new data sourcesWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

- Bachelor?s degree in Computer Science, Software Engineering, MIS, or related field- 5+ years of experience building and supporting enterprise-scale data platforms on AWS- Strong hands-on... More programming skills in Python and SQL, with working knowledge of Shell scripting- Experience designing and implementing cloud-based data architectures, including data lakes and warehouses- Proficiency with core AWS services- S3, Glue, Redshift, Lambda. - Experience developing and orchestrating data pipelines using ETL/ELT frameworks- Familiarity with serverless architectures and modern data processing approaches (e.g., Spark/EMR)Understanding of data modeling, big data concepts, and cloud-native design patternsWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are seeking a highly skilled Data Platform Engineer to design, build, automate, and support enterprise-scale data platforms across hybrid cloud environments. This role will focus on platform... More engineering, infrastructure automation, observability, and the operational excellence of modern analytics ecosystems supporting large-scale data products.The ideal candidate will have deep experience managing distributed data platforms, cloud infrastructure, and big data technologies, while leveraging automation and engineering best practices to enhance reliability, scalability, and performance.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

The Senior Data Engineer / Streaming Data Engineer will design, build, and support enterprise-scale streaming and big data pipelines across AWS, Spark, Hadoop, Kafka, and cloud-native ingestion... More platforms. This role is hands-on and production-focused, with responsibility for reliable real-time data movement, ingestion modernization, distributed systems engineering, and scalable data processing in a large enterprise environment.?Hands-on streaming and real-time data engineering using Kafka, Spark, AWS Kinesis, and cloud-native data services.?Modernization opportunity focused on moving legacy ingestion patterns to scalable AWS-native services.?Production engineering role requiring strong troubleshooting, operational ownership, and distributed systems depth.?Enterprise-scale environment with complex data warehousing, big data, and cross-platform integration needs.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

An Oil & Gas customer of Insight Global is looking for a Data Engineering Advisor to join their team full-time to sit in The Woodlands, TX, on a hybrid schedule 3 days a week and as needed with... More travel up to 5% within the Texas area. The IT division's primary goal over the next few years is focused on their Data Transformation efforts that will support all of the company's domains for midstream assets. This person will be designing, developing, and deploying innovative data and analytical solutions to enhance current operations and shape the future of the organization. The salary range for this role is dependent on level of experience with a flexible range of $120,000-$200,000 annually. Responsibilities:Design and create data architecture and strategies to facilitate efficient storage and retrieval of structured and unstructured data.Design, build, and manage data pipelines to ingest, transform, and distribute data between on-premises and Azure-based destinations.Implement measures to ensure the quality and integrity of data, including data cleaning, validation, and error handling within data pipelines.Utilize technologies from Qlik, OpenText, SAP Datasphere, and Azure cloud services, including Copilot, Dataverse, Fabric, Data Factory, Logic Apps, Power Automate, Azure Synapse Analytics, Fabric to enable custom applications and BI efforts.Employ programming languages like Java or Python for automation and API integration tasks.Work closely with data scientists and developers to provide data necessary for custom applications, visualizations, and analytic models.Assess, recommend, and integrate new data management technologies, data modeling, relational data structures, and change data capture.Identify bottlenecks, optimize queries, and fine-tune database or data processing configurations.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Position Summary: Commissioning Data Engineer As a Commissioning Data Engineer, you will serve as the critical link between raw data and actionable business intelligence. You'll harness SQL and... More Python to extract insights from APIs, build and maintain ETL pipelines, and create comprehensive dashboards that drive decision-making. Your role involves ensuring data integrity, optimizing systems in Azure, and developing automation solutions that enhance operational efficiency across the organization. Responsibilities: 1. Database o Proficient in leveraging Python and APIs to extract data from backend systems and various data sources, performing data cleaning, transformation, and processing to ensure data quality and integrity. o Write complex SQL queries to create, optimize, and maintain database tables, performing advanced data transformations, joins, and aggregations to meet evolving business requirements. o Design, implement, and maintain robust ETL pipelines that facilitate efficient data processing and analysis. o Audit and investigate root causes of data anomalies, implementing corrective measures and data validation rules to prevent recurrence. o Maintain and optimize the ticketing system within the Azure environment, ensuring system reliability and performance. o Utilize and transform data from the completions management system, CXAlloy. 2. Reporting o Develop and maintain interactive Power BI dashboards from multiple data sources, creating dynamic visualizations to track project progress, and support data-driven decision-making across stakeholders. o Clean and merge complex datasets to create comprehensive analytical views that address specific business needs. o Translate data into clear, actionable insights through intuitive dashboards and detailed reports. o Document data processes, pipelines, and automation solutions for knowledge sharing and continuity. o Monitor data quality and track anomalies or deviations on an ongoing basis, creating visualizations and reports to communicate data issues to stakeholders. 3. Automation and Improvements o Design and implement automated workflows using Power Automate to streamline cross-platform data integration, execute conditional logic based on business rules, and generate real-time alerts for data anomalies. o Identify opportunities for process improvement and implement automation solutions using Python o Create custom programs to anticipate organizational needs and streamline data workflows o Maintain existing automated processes, performing regular updates and enhancements to ensure continued functionality 4. Other Duties as AssignedWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are looking for a Sr Data Engineer focused on Foundry, governance, release engineering, and geospatial data products. This person will be developing, engineering and improving an existing platform... More and pipeline ecosystem.We are seeking a Data Engineer to support the transition of data pipelines from an internal IT team to our internal team.This role will focus on both enhancing existing pipelines and improving the underlying code and data infrastructure to ensure long-term maintainability, scalability, and clarity.Key Responsibilities?Refactor and enhance data pipelines to be modular, maintainable, and well-documented?Establish and promote best practices for code architecture, version control, and code management?Collaborate closely with a core team of data scientists, machine learning engineers, and data engineers and a broader team of cross-functional partners?Communicate technical data to non-technical stakeholders to build trust and understanding in the methodology.?Support the development of machine learning models currently being developed in-houseWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Data Management Analyst to join a large mooring solution's company here in Houston, Texas Information Management team, supporting data governance and document control... More across offshore floating production systems and mooring solutions. In this role, the Data Management Analyst will act as a data steward, partnering closely with engineering teams who serve as the data owners to ensure all equipment and system data is accurate, complete, consistent, and compliant with established standards. This individual will receive large volumes of engineering data, validate it against tag registers, and ensure proper structure and integrity before it is ingested into the company's systems. The data supports equipment and digital twin models, often consisting of up to 10,000+ tags per asset, capturing critical details such as manufacturer information and operational parameters (e.g., pressure, capacity). Once loaded, the system will generate validation reports identifying data gaps or errors, and this person will coordinate with engineers to drive timely resolution. This role is essential to the company's broader initiative to increase automation and reduce offshore personnel by ensuring high-quality, reliable data for installed equipment. Additionally, this position supports the integrity of data tied to the company mooring systems, which are critical for the safe anchoring and stability of FPSOs through advanced offshore engineering and infrastructure design.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking an ambitious and highly technical Associate Data & AI Engineer to join our Analytics and Business Intelligence team.This role is ideal for a recent graduate or early-career... More technology professional with a degree in Computer Science, Artificial Intelligence, Software Engineering, Data Science, Computer Engineering, or a related technical discipline. We are looking for someone who is passionate about solving complex problems through technology, automation, data engineering, and emerging AI solutions.The ideal candidate will have strong coding abilities, a solid understanding of software development principles, and internship or early-career experience in technical environments. While reporting and dashboard development will be part of the role, the primary focus is on developing the technical foundation needed to build modern data solutions, support AI initiatives, and become an expert in healthcare data platforms.This individual will receive extensive training in Epic Clarity, Caboodle, healthcare data architecture, and enterprise analytics technologies while helping transition existing Tableau reporting solutions into Microsoft Power BI.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are seeking a hands-on Senior Data & AI Full Stack Engineer with marketing technology experience to deliver an outcome-based program across lead scoring and CRM prioritization, Marketo and... More GenStudio integration, Google PLA enablement, affiliate attribution signal pipelines, facets development, UAT readiness, and final documentation. This role will own end-to-end delivery from business requirements and solution design through build, integration, testing, deployment, stakeholder adoption, and operational handoff. What You will do: Own lead scoring and CRM prioritization delivery. Define scoring attributes, develop scoring logic, operationalize the model, and integrate outputs into CRM workflows to support automated prioritization, routing, pilot validation, and stakeholder adoption. Enable AI-assisted campaign workflows. Configure and validate the Marketo and GenStudio integration, including API credentials, LaunchPoint services, REST and identity URLs, Adobe Exchange deployment, campaign data integration, marketer workflow readiness, UAT planning, defect triage, and stakeholder sign-off. Deliver Google PLA enablement. Design and implement Google PLA campaign capability, establish measurement baselines, define performance KPIs, support feed and campaign readiness concepts, and prepare the capability for operational scaling. Build affiliate attribution signal pipelines. Develop pipelines for membership and organizational gross GMV signals, validate existing attribution logic, reconcile business data, support production deployment, and complete post-production validation. Complete facets development and documentation. Implement required metadata structures for analytics and attribution reporting, create technical documentation, configuration guides, and operational runbooks, and ensure a clean handoff for maintainability and future enhancements.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less