Job Search Results for data engineer

Insight Global is seeking a Senior Data Engineer to support one of our financial services clients in Nashville, TN. This individual will join a growing data team focused on building and optimizing... More data pipelines, transforming data for analytics, and ensuring high-quality, reliable data supports business intelligence efforts. This is a hands-on role ideal for someone who enjoys working with modern data tools and collaborating across both technical and business teams.The team is looking for someone who can work onsite Monday through Thursday, with remote flexibility on Fridays.Responsibilities:? Design, build, and maintain scalable data pipelines to ingest data from multiple sources? Develop and optimize data transformation models using dbt? Ensure data quality, accuracy, and reliability through testing and monitoring? Implement best practices for data modeling and warehouse performance? Partner with analysts, engineers, and business stakeholders to understand data needs ? Contribute to internal processes, documentation, and overall data engineering best practicesWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Owning engineering patterns and working with google engineers - troubleshoot, maintain and replicate what google builds - need someone with experience or desire to manage other people theyre starting... More their data readiness journey to lead into their AI projects and have partnered with Google so need someone to work with the google engineers and troubleshoot, maintain and replicate what they buildWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Responsibilities? Work closely with Subject Matter Experts (SMEs) to design and develop the ontology (data model) and data pipelines.? Design, implement, and maintain robust data pipelines and ETL... More processes.? Develop and optimize cloud-based data storage and processing solutions.? Collaborate with data analysts and data scientists to understand data requirements and deliver high-quality data solutions.? Ensure data integrity and security across all data workflows and storage solutions.? Monitor and troubleshoot data pipelines, addressing any issues promptly to ensure the smooth flow of data.? End to End data pipeline development ? responsible for using Python and Pyspark to perform ETL and derive new datasets necessary for business applications.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking to hire a Sr. Data Engineer for a retail client based in Vancouver. This role is a hybrid position and requires 3 days onsite per week in Downtown Vancouver. You will be... More joining a team that works heavily with customer data?owning the customer data pipelines that gather data coming from multiple sources and consolidating that data for different use cases. Some use cases include segmentation, data and analytics, advanced analytics for ML models to generate product recommendations, etc.You will have a strong knowledge of the Azure infrastructure and can build Azure pipelines. You will make general recommendations to the client on how to improve the current infrastructure. This role is not tied to a certain body of work; rather, you will support multiple workstreams and work with the Product teams to prioritize. Other duties and responsibilities include:Data pipeline creation and maintenanceStack: GCP, Azure Cloud, Azure Databricks, SnowflakeIncludes engineering documentation, knowledge transfer to other engineers, future enhancements, and maintenanceCreate secure data views and publish them to the Enterprise Data Exchange via Snowflake for other teams to consumeData pipeline modernization and migration via Databricks Delta Live Tables (DLT) and Unity CatalogLeverage existing CI/CD processes for pipeline deploymentAdhere to PII encryption and masking standardsOrchestration tools: ADF, Airflow, FivetranLanguages: SQL, PythonData Modeling: Star and Snowflake schemasStreaming: Kafka, Event Hubs, Spark, Snowflake StreamingDevOps Support: Support improvements for current CI/CD processesProduction monitoring and failure supportWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Data Engineer for one of our largest financial clients in Chandler, AZ. This individual is responsible for designing, building, and maintaining scalable data pipelines and... More integration platforms that support enterprise configuration management, service management, and automation use cases. This role requires strong expertise in data engineering fundamentals, CMDB data models, and ServiceNow platform integrations, with a focus on data quality, lineage, and operational reliability.The Data Engineer will collaborate closely with CMDB owners, ServiceNow developers, infrastructure teams, and business stakeholders to ensure accurate, timely, and governed data flows that enable reliable IT operations, dependency mapping, reporting, and automation across the enterprise.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking for a Sr. Data Engineer to come join their team. This candidate will be helping design and deliver modern data solutions using cloud-based platforms and AI-driven... More innovations. You will partner with business, technology, and governance teams to enable scalable, secure and compliant data platforms that power advanced analytics and AI. You will act as the enterprise expert for designing, developing, and optimizing data processing systems and pipelines used to populate data into transactional databases, data warehouses, data marts, or other data repositories. You will also coordinate with other IT teams to configure and implement security, monitoring, tooling, and related capabilities as they apply to their assigned systems. The Day-to-Day:?Use Agile practices to elicit and refine requirements through an iterative process of planning, defining acceptance criteria, prioritizing, developing and delivering enterprise data asset solutions in collaboration with business intelligence teams or other IT teams?Develop, configure, customize and manage integration tools, databases, warehouses and analytical systems?Design, build, and deploy data extraction, transformation, and loading processes and pipelines from various sources including databases, APIs, and data files?Develop and deploy structured, semi-structured, and unstructured data storage models such as data vault or dimensional modeling on a various platforms to meet business requirements?Coordinate security, application monitoring, development tooling, and related capabilities with responsible teams?Provide operational support and incident management for data pipelines and data flows, including proactively updating internal clients and relevant parties on status changes and issues encountered?Author and maintain accurate and up-to-date documentation for processes, procedures, and technical designs?Coach junior data and business intelligence personnel across the company, including developing material and guiding junior personnel on their technical skill growthWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking for an AWS Data Engineer to join one of our financial clients and help with an ongoing project. We are looking for a skilled Data Engineer with a strong AWS and Python... More background to help design, build, and maintain scalable data pipelines and APIs. This role is ideal for someone who enjoys working across data ingestion, transformation, and delivery, and who can clearly explain their work through real project experience. Key Responsibilities ? Design, build, and maintain ETL pipelines using AWS services such as S3, Lambda, and Glue ? Develop and optimize data processing workflows using Python and PySpark ? Build and support APIs (preferably using FastAPI) to expose data to downstream systems ? Work with data warehouse architectures, ensuring data quality, reliability, and performance ? Collaborate with cross-functional teams to understand data requirements and translate them into scalable solutions ? Participate in code reviews and contribute to best practices in data engineeringWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

? Design and maintain the overall data platform architecture integrating Snowflake, AtScale, and dbt components? Establish data quality frameworks and monitoring systems? Define platform scalability... More and performance optimization strategies? Design and implement Snowflake warehouse configurations and resource management policies? Manage user access controls, roles, and security policies within Snowflake? Optimize query performance through warehouse sizing, clustering, and partitioning strategies? Implement data sharing and collaboration features across business units? Monitor and control Snowflake costs through usage optimization and resource scheduling? Design and maintain data pipeline architectures for ingestion and transformation? Establish connection protocols between AtScale and various BI tools (Tableau, Power BI, etc.)? Optimize query performance through aggregate tables and caching strategies? Manage AtScale cluster configurations and scaling policies? Implement security models that align with organizational data access requirements dbt Development & Operations? Design and maintain dbt project structures and development workflows? Create and enforce dbt coding standards and documentation requirements? Implement dbt testing frameworks for data quality validation? Manage dbt deployment pipelines and environment promotion processes? Design modular dbt models that support reusability and maintainability? Establish version control and collaboration practices for dbt development teams Integration & Data Flow Management? Design end-to-end data pipelines connecting source systems to Snowflake via dbt transformations? Implement data lineage tracking across all three platforms? Create monitoring and alerting systems for data pipeline health and performance? Establish disaster recovery and backup procedures for the integrated platform? Design API integrations and data exchange protocols between platforms Team Leadership & Collaboration? Mentor and train data engineers and analysts on platform best practices? Collaborate with data science teams to support ML/AI workload requirements? Coordinate with DevOps teams on infrastructure automation and deployment practices? Lead architectural review sessions and technical decision-making processes Performance & Cost Optimization? Monitor and optimize compute resource utilization across all platforms? Implement cost allocation and chargeback models for different business units? Analyze query patterns and usage metrics to identify optimization opportunities? Design and implement automated scaling policies based on workload demands? Establish SLA monitoring and reporting for platform availability and performance Security & Compliance? Implement data encryption, masking, and anonymization policies? Ensure compliance with regulatory requirements (GDPR, HIPAA, SOX, etc.)? Design and maintain audit trails and data access logging? Coordinate security assessments and vulnerability management? Establish data classification and handling procedures across all platformsPay Rate: $16.00-$22.00 depending on skills and experienceWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking for an AWS Data Engineer to join one of our financial clients and help with an ongoing project. This resource will be responsible to helping unify store data in order to... More unify legacy systems across various lines of businesses. This resource should have an ETL background with a strong focus on data engineering, specifically with AWS. Candidates will be responsible for working independently creating code, testing AWS pipelines, running through and managing requirements, data analysis and helping to enhance existing models.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

As a Data Engineer, you?ll play a crucial role in ensuring seamless data flow within Foundry. You?ll work closely with cross-functional teams to design, implement, and maintain robust data... More pipelines.Your expertise will contribute to the success of our organization?s data-driven initiatives. As a Data Engineer you will be involved in Business requirements, problem statements and developing end-to-end solutions using Palantir. Incumbent will play a paramount role in transforming the Organization on Palantir. This role is not limited to only Data Engineer as it also demands exciting responsibilities of Business analyst.Secure, scalable, and resilient integration of diverse data sources.Leverage 200 data connectors using an extensible plugin-based paradigm.Configure flexible ingress topology (agent-based, REST, JDBC, etc.).API Integration: Integrating Palantir with other systems and applications using APIs for seamless data flow.Handle multi-modal data (structured, unstructured, streaming, IoT, geospatial).Treat data like code (versioning, branching, full change management).2. Data Transformation:Implement low-code/no-code transformations using tools like Preparation and Contour.Should have knowledge of Typescript, AIP Natural Language.Ensure full provenance through the Job Spec paradigm.Machine Learning and AI: Familiarity with integrating machine learning and AI capabilities within the Palantir environment for advanced analytics.3. Pipeline Orchestration:Design and manage data pipelines using Pipeline Builder and code repositories.Generate applications using Workshop or Slate.4. Ontology Management:Create and manage ontology objects.Analyze data using tools like Code Workbook, Contour, and Quiver.Debugging & Trouble shootingWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less