Job Search Results for data engineer

An Oil & Gas customer of Insight Global is looking for a Data Engineering Advisor to join their team full-time to sit in The Woodlands, TX, on a hybrid schedule 3 days a week and as needed with... More travel up to 5% within the Texas area. The IT division's primary goal over the next few years is focused on their Data Transformation efforts that will support all of the company's domains for midstream assets. This person will be designing, developing, and deploying innovative data and analytical solutions to enhance current operations and shape the future of the organization. The salary range for this role is dependent on level of experience with a flexible range of $120,000-$200,000 annually. Responsibilities:Design and create data architecture and strategies to facilitate efficient storage and retrieval of structured and unstructured data.Design, build, and manage data pipelines to ingest, transform, and distribute data between on-premises and Azure-based destinations.Implement measures to ensure the quality and integrity of data, including data cleaning, validation, and error handling within data pipelines.Utilize technologies from Qlik, OpenText, SAP Datasphere, and Azure cloud services, including Copilot, Dataverse, Fabric, Data Factory, Logic Apps, Power Automate, Azure Synapse Analytics, Fabric to enable custom applications and BI efforts.Employ programming languages like Java or Python for automation and API integration tasks.Work closely with data scientists and developers to provide data necessary for custom applications, visualizations, and analytic models.Assess, recommend, and integrate new data management technologies, data modeling, relational data structures, and change data capture.Identify bottlenecks, optimize queries, and fine-tune database or data processing configurations.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

We are seeking a Senior / Staff Data Engineer with deep Python and Google Cloud Platform (GCP) experience to design, build, and support scalable, cloud-native data pipelines. This role is highly... More hands-on while also providing technical leadership across data engineering initiatives.You will work closely with data engineers, analytics, BI, and business stakeholders to deliver high-quality, reliable data products that power analytics, reporting, and near real-time insights. This role plays a key part in shaping data engineering standards, mentoring others, and enabling self-service analytics across the organization.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

The primary role of the Data Engineer-Developer is to function as a critical member of a data team by designing data integration solutions that deliver business value in line with the company?s... More objectives. They are responsible for the design and development of data/batch processing, data manipulation, data mining, and data extraction/transformation/loading into large data domains using Python/Pyspark and AWS tools. Responsibilities:?Provide scoping, estimating, planning, design, development, and support services to a project.?Identify and develop the Technical detail design document.?Work with developers and business areas to design, configure, deploy and maintain custom ETL Infrastructure to support project initiatives.?Design and develop data/batch processing, data manipulation, data mining, and data extraction/transformation/loading (ETL Pipelines) into large data domains.?Document and present solution alternatives to clients, which support business processes and business objectives.?Work with business analysts to understand and prioritize user requirements?Design, development, test, and implement application code?Follow proper software development lifecycle processes and standards?Quality Analysis of the products, responsible for the Defect tracking and Classification?Track progress and intervene as needed to eliminate barriers and ensure delivery.?Resolve or escalate problems and manage risk for both development and production support.?Maintain deep knowledge and awareness of technical & industry best practices and trends, especially in technology & methodologies.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Data Engineer for one of our largest financial clients in Chandler, AZ. This individual is responsible for designing, building, and maintaining scalable data pipelines and... More integration platforms that support enterprise configuration management, service management, and automation use cases. This role requires strong expertise in data engineering fundamentals, CMDB data models, and ServiceNow platform integrations, with a focus on data quality, lineage, and operational reliability.The Data Engineer will collaborate closely with CMDB owners, ServiceNow developers, infrastructure teams, and business stakeholders to ensure accurate, timely, and governed data flows that enable reliable IT operations, dependency mapping, reporting, and automation across the enterprise.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

An employer in The Woodlands, TX area is seeking a Sr. Data Engineer to join their team. Currently, this team is responsible for integration and enhancement of the enterprise organization's... More applications and systems. This role will own the integration and enterprise data architecture supporting the Dynamics 365 ecosystem and related business platforms, ensuring reliable and scalable data flows across the organization. The individual designs and delivers Microsoft Fabric data solutions that enable operational reporting, analytics, and data-driven decision-making across the company?s diverse portfolio. They will lead Power BI and semantic model strategy, supporting trusted reporting and dashboards used by business leaders and executive stakeholders. This position will play a key role in modernizing ERP reporting, supporting the transition from legacy systems to Dynamics 365 while maintaining financial accuracy and business continuity. Additionally, by partnering closely with technology, cybersecurity, and business teams, this role will ensure data solutions align with governance, compliance, and security standards. This is a permanent opportunity paying $140,000 - 150,000 annuallyWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Responsibilities? Work closely with Subject Matter Experts (SMEs) to design and develop the ontology (data model) and data pipelines.? Design, implement, and maintain robust data pipelines and ETL... More processes.? Develop and optimize cloud-based data storage and processing solutions.? Collaborate with data analysts and data scientists to understand data requirements and deliver high-quality data solutions.? Ensure data integrity and security across all data workflows and storage solutions.? Monitor and troubleshoot data pipelines, addressing any issues promptly to ensure the smooth flow of data.? End to End data pipeline development ? responsible for using Python and Pyspark to perform ETL and derive new datasets necessary for business applications.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking to hire a Sr. Data Engineer for a retail client based in Vancouver. This role is a hybrid position and requires 3 days onsite per week in Downtown Vancouver. You will be... More joining a team that works heavily with customer data?owning the customer data pipelines that gather data coming from multiple sources and consolidating that data for different use cases. Some use cases include segmentation, data and analytics, advanced analytics for ML models to generate product recommendations, etc.You will have a strong knowledge of the Azure infrastructure and can build Azure pipelines. You will make general recommendations to the client on how to improve the current infrastructure. This role is not tied to a certain body of work; rather, you will support multiple workstreams and work with the Product teams to prioritize. Other duties and responsibilities include:Data pipeline creation and maintenanceStack: GCP, Azure Cloud, Azure Databricks, SnowflakeIncludes engineering documentation, knowledge transfer to other engineers, future enhancements, and maintenanceCreate secure data views and publish them to the Enterprise Data Exchange via Snowflake for other teams to consumeData pipeline modernization and migration via Databricks Delta Live Tables (DLT) and Unity CatalogLeverage existing CI/CD processes for pipeline deploymentAdhere to PII encryption and masking standardsOrchestration tools: ADF, Airflow, FivetranLanguages: SQL, PythonData Modeling: Star and Snowflake schemasStreaming: Kafka, Event Hubs, Spark, Snowflake StreamingDevOps Support: Support improvements for current CI/CD processesProduction monitoring and failure supportWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are looking for a Junior Data Engineer with 1?3 years of experience who is eager to learn and grow in cloudbased data engineering. The candidate should have basic exposure to GCP services, data... More workflows, or Airflow-based orchestration. A strong willingness to take responsibility, learn new tools, and adapt quickly is essential. Key Responsibilities ? Support in building and maintaining data pipelines and workflow processes. ? Work with data related GCP services such as Cloud Run, Cloud Functions, and Composer. ? Take responsibility for assigned tasks and ensure timely completion. ? Learn and adopt best practices for performance, reliability, and code quality.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

An employer is looking for a highly-skilled Field Engineer to join one of our largest national general contractor clients for a long term contract (18-months) supporting a large-scale data center... More buildout. In order to be successful on this team you must live within a commutable distance to Pampa, TX as you'll be required to go on site daily to work cross functionally with stakeholders and senior level leadership.Responsibilities:Jobsite:? Responsible for the implementation and management of jobsite-wide IT work providing input and deliverables in all phases.? Analyzes, prioritizes, troubleshoots, and resolves technical issues with the network connections in the primary and all trailers and buildings where Mortenson internet exists.? Interacts in person, via telephone, email, IM, and web interface to assist the jobsite team and HQ IT teams with network configuration.? Installs and maintains software/hardware/networks at jobsites and offices.? Determines, recommends, procures, and executes which products or services best fit the needs of the project teams, while maintaining Mortenson IT standards and best practices.? Works with service providers and trade partners to install and implement jobsite technologies.? Implements and follows jobsite standardization practices.? Responsible for scheduling and organizing visits to jobsites and offices.? Primary support includes but is not limited to diagnosing & troubleshooting network connections, configurations and hardware.? Coordinates and tracks IT project deadlines and tasks.Standards:? Responsible for maintaining company security through established tools.? Provides IT training during onboarding and provisions assets following established best practices.? Provides relevant input for technical and process improvements to contribute and the overall effectiveness of Mortenson?s IT and Network organization.? Takes initiative to work with other cross-functional IT team members to improve the quality of service.? Responsible for mobilization and demobilization of IT equipment at jobsites.Support:? Secondary support, as needed, includes liaising with jobsite teams and assisting with troubleshooting and resolving any technology questions or software solution. Questions that cannot be resolved right away will have tickets submitted in ServiceNow.? Ensures quality customer service by maintaining ownership of escalated issues until resolved, including communication and root cause analysis.? Responsible for creating, tracking, and resolving incidents and tasks in ServiceNow.? Follows ITIL processes for incident and problem management.? Records, tracks, and audits equipment using the established asset management system (ServiceNow) and processes, including asset recovery at jobsites.? Documents best practices and known fixes in ServiceNow knowledge base.? Creates a positive support experience and builds strong relationships through deep problem understanding, ensuring timely resolution or escalation, communicating promptly on progress, and handling customers with a consummately professional attitude.Position Requirements:? Primary: Technically skilled in networking Cisco/Meraki (MX, Router, Switch, VPN), Networking Protocols (TCP/IP, DHCP).? Secondary: Able to support video conferencing and scheduling hardware/software. Skilled in Microsoft Office 365 and supporting diverse applications.? Ability to learn on the fly.? Ability to react quickly and efficiently to high pressure situations.? Excellent organizational and interpersonal skills.? Perform quality work within deadlines with or without direct supervision.? Interact professionally with other employees, customers, and suppliers.? Work effectively as a team contributor on all assignments.? Work independently while understanding the necessity for communicating and coordinating work efforts with other employees and organizations.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Design, build, and optimize BigQuery datasets and SQL modelsDevelop and maintain batch and streaming pipelines using Dataflow/BeamOrchestrate workflows in Airflow/Cloud ComposerImplement scalable... More ETL/ELT pipelines with incremental and CDC patternsTune performance and manage query/storage costsEnsure data quality, schema evolution, and lineage trackingCollaborate with analytics, engineering, and business teamsSecure sensitive data using best practices for complianceMonitor pipelines, troubleshoot failures, and improve reliabilityContribute to code reviews, documentation, and platform standardsWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less