Job Search Results for data engineer

Our leading entertainment client is expanding their data team and seeking a Data Engineer with deep expertise in GCP, Big Data, Python, SQL, DBT, and ERD architecture. This cross-functional team... More operates across three core areas: AI/ML, Data Engineering, and Data Analytics.? Collaborate with stakeholders across subscription, viewership, marketing, paid media, CRM, and more. ? Support data visualization initiatives and ensure data is accessible and actionable.? Work in a highly collaborative environment that values fast learners and team players. Spend approximately 80% of your time in hands-on development using Python and SQL.Team Dynamic:Data Analytics Engineering (Approx. 80% of time) - Primary Focus: Analyze and maintain data pipelines, conduct root-cause analysis to resolve data-related issues, and create data models leveraging DBT and Medallion architecture.Tools & Skills: ? Proficient in Python and SQL for pipeline development. ? Initially focused on learning and maintaining existing pipelines, with a gradual transition to building new ones. Mindset: Business-oriented with a strong analytical approach. AI/ML Initiatives (Approx. 5% of time) Objective: Support AI and machine learning efforts using modern platforms such as Vertex AI. Scope: Limited involvement, primarily assisting with existing initiatives and tools. Data Engineering (Approx. 15% of time) Responsibilities: Design and implement scalable data models, pipelines, and architecture.Technical Stack: Heavy use of Python and SQL to ensure robust and efficient data infrastructure.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking an experienced Senior Analytics Data Engineer to design, build, and maintain the trusted data models and pipelines that power marketing analytics and business... More decision-making.This role sits at the intersection of data engineering, analytics engineering, and marketing analytics. The ideal candidate has deep, hands-on expertise with dbt and Snowflake, extensive experience designing dimensional data models, and a strong understanding of marketing data and measurement.You will partner closely with Marketing stakeholders and peers on Data Engineering team to transform complex source data into reliable, scalable, and well-documented analytical data products.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Senior Data Engineer to support one of our financial services clients in Nashville, TN. This individual will join a growing data team focused on building and optimizing... More data pipelines, transforming data for analytics, and ensuring high-quality, reliable data supports business intelligence efforts. This is a hands-on role ideal for someone who enjoys working with modern data tools and collaborating across both technical and business teams.The team is looking for someone who can work onsite Monday through Thursday, with remote flexibility on Fridays.Responsibilities:? Design, build, and maintain scalable data pipelines to ingest data from multiple sources? Develop and optimize data transformation models using dbt? Ensure data quality, accuracy, and reliability through testing and monitoring? Implement best practices for data modeling and warehouse performance? Partner with analysts, engineers, and business stakeholders to understand data needs ? Contribute to internal processes, documentation, and overall data engineering best practicesWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Lead Data Engineer to join a large retail client based in Vancouver, BC. The data engineering team builds and maintains the data infrastructure that powers analytics,... More reporting, and data-driven decision making across the company?s digital platforms, retail operations, and business units. We work with cross-functional agile squads to develop reliable data pipelines, improve data quality, build self-serve analytics tools for our business stakeholders, and ensure timely access to accurate data for our analysts and data scientists. This Lead Engineer will be responsible for supporting several upcoming initiatives, including modernizing the organization?s data platform through the migration of data pipelines from Azure Data Factory to Databricks and the transition of legacy Hive tables to Unity Catalog. The ideal candidate will bring strong Databricks experience, including a solid understanding of Medallion Architecture and best practices for defining and managing Bronze, Silver, and Gold data layers to support scalable, governed data solutions.Day to Day Activities: ?Architecting and implementing scalable data platforms using Azure, Databricks, and NoSQL databases?Overseeing Unity Catalog adoption for centralized data governance and metadata management?Designing integrations with ML infrastructure and collaborating with data science teams on model deployment?Leading and mentoring a team of data engineers, balancing hands-on coding with strategic oversight?Establishing coding standards, DevOps/SDLC workflows, and performance optimization practices?Driving backlog prioritization, technical planning, and cross-functional alignment?Implementing enterprise-grade data governance frameworks, including security (SecOps) and cost management (FinOps)?Championing data quality initiatives and advanced monitoring solutions?Evaluating emerging technologies (e.g., real-time processing, GenAI pipelines) for business impact?Partnering with business leaders to translate requirements into technical roadmaps?Leading hiring processes, performance evaluations, and team development?Exemplifying the company?s leadership code (Lead Self, Lead Others, Lead Business) through innovation, accountability, and mentorship Here are some of the things you could be working on in the future:?Leading the technical implementation of data mesh architecture and domain-oriented data products?Designing and implementing real-time data streaming solutions for critical business processes?Establishing advanced MLOps practices to operationalize machine learning workflows at scale?Developing comprehensive data observability solutions across the entire data ecosystem?Creating specialized data acceleration frameworks to improve platform performanceWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is hiring for our client's Information Security team that is seeking a seasoned professional to advance their Data Loss Prevention (DLP) program. As a Data Security Engineer, you will... More design, implement, and maintain technical data protection solutions?primarily within Microsoft Purview?to safeguard sensitive information across a large-scale hybrid environment. This role involves close collaboration with IT teams, business stakeholders, and vendors to identify risks, enforce data handling policies, and ensure regulatory alignment.Key Responsibilities?Develop, configure, and maintain DLP policies and labeling solutions across endpoints, email, cloud, and network environments using Microsoft Purview.?Build out new and continuously improve current DLP policies based on customer feedback, business needs, and regulatory requirements.?Manage configuration, deployment, and ongoing maintenance of DLP and data classification policies.?Integrate DLP solutions with SIEM, CASB, endpoint protection, and other security platforms.?Monitor and optimize technical components of the Data Protection program, tuning DLP rules to reduce false positives and manage exceptions.?Drive change management for DLP and data protection initiatives, ensuring smooth adoption and compliance.?Collaborate with security, IT, and business teams to understand data flows, integrate Purview capabilities, and align controls with business needs.?Partner with vendors to ensure alignment with industry best practices for data protection.?Analyze data protection risks in both persistent and transit layers; design sustainable mitigation strategies.?Document complex process flows and communicate technical details to both technical and non-technical audiences.?Stay current with emerging threats, technologies, and regulatory changes; recommend updates to DLP strategy.?Develop and execute test plans for DLP solutions across multiple environments (development, staging, production) to ensure robust deployment and minimize risk.Pay varies $55/hr - $65/hr based upon experience and fit for the role.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Data Engineer to support the collection, storage, processing, and analysis of large-scale data sets. This individual will play a key role in designing and maintaining... More scalable data solutions that enable efficient, reliable, and accurate data-driven decision-making across the organization.Key Responsibilities:Partner with business and technology stakeholders to understand current and future data requirements and translate them into scalable solutions.Design, build, and maintain robust data infrastructure to support data ingestion, storage, transformation, and analytics.Develop and optimize scalable data pipelines, data models, and workflows that ensure reliable and efficient movement of data across systems.Design, implement, and support enterprise data platforms, including data warehouses, data lakes, and lakehouse architectures, for both structured and unstructured data.Create and maintain data engineering tools, scripts, and automation solutions to streamline processes and improve operational efficiency.Monitor and optimize the performance, scalability, and reliability of data systems, proactively identifying opportunities for improvement.Ensure data quality, integrity, security, and governance standards are maintained across all data environments.Collaborate with cross-functional teams to support reporting, analytics, machine learning, and other data-driven initiatives.This role requires a strong understanding of modern data architecture, ETL/ELT processes, cloud-based data platforms, and best practices in data engineering.$65/hr to $78/hr Exact compensation may vary based on several factors, including skills, experience, and education. Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401K retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Senior Data Platform Architect / Data Infrastructure Engineer to support the design and development of a large-scale mission data environment. This role is focused on... More building and scaling data ecosystems, not analytics or reporting.You will play a key role in defining how data is ingested, stored, processed, and secured across a high-volume, complex environment supporting mission-critical operations.Key Responsibilities:?Design and architect large-scale data environments (multi-terabyte to petabyte scale)?Define and implement data platform architecture, including ingestion pipelines, storage solutions, and processing frameworks?Build and optimize distributed data systems (e.g., data lakes, parallel processing frameworks)?Support end-to-end data lifecycle: ingestion ? transformation ? storage ? access?Evaluate and recommend technologies for scalability, performance, and security?Collaborate with stakeholders on requirements development, system design, and technical roadmapping?Support hybrid environments (on-premises and/or cloud)?Ensure solutions align with security and compliance requirements, particularly in classified or regulated environmentsWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

The Data Engineering team at UJA-Federation of New York is seeking an experienced Data Engineer to join our team. The ideal candidate will bring strong expertise in Python development for... More data-intensive applications, including hands-on proficiency with SQL and PySpark.This role involves building scalable data pipelines, improving data quality and reliability, and collaborating with cross-functional teams to support analytics, reporting, and machine learning initiatives.?Design, build, and maintain robust ETL/ELT pipelines and data workflows using Python.?Implement best practices for data architecture, modeling, and processing at scale.?Collaborate with team members to leverage Azure DevOps for CI/CD, release management, and automated testing.?Ensure compliance with data governance, quality, and security standards.?Mentor junior engineers and contribute to the growth of engineering best practices.?Partner with stakeholders (data scientists, analysts, business teams) to deliver reliable data solutions.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

? Design and maintain the overall data platform architecture integrating Snowflake, AtScale, and dbt components? Establish data quality frameworks and monitoring systems? Define platform scalability... More and performance optimization strategies? Design and implement Snowflake warehouse configurations and resource management policies? Manage user access controls, roles, and security policies within Snowflake? Optimize query performance through warehouse sizing, clustering, and partitioning strategies? Implement data sharing and collaboration features across business units? Monitor and control Snowflake costs through usage optimization and resource scheduling? Design and maintain data pipeline architectures for ingestion and transformation? Establish connection protocols between AtScale and various BI tools (Tableau, Power BI, etc.)? Optimize query performance through aggregate tables and caching strategies? Manage AtScale cluster configurations and scaling policies? Implement security models that align with organizational data access requirements dbt Development & Operations? Design and maintain dbt project structures and development workflows? Create and enforce dbt coding standards and documentation requirements? Implement dbt testing frameworks for data quality validation? Manage dbt deployment pipelines and environment promotion processes? Design modular dbt models that support reusability and maintainability? Establish version control and collaboration practices for dbt development teams Integration & Data Flow Management? Design end-to-end data pipelines connecting source systems to Snowflake via dbt transformations? Implement data lineage tracking across all three platforms? Create monitoring and alerting systems for data pipeline health and performance? Establish disaster recovery and backup procedures for the integrated platform? Design API integrations and data exchange protocols between platforms Team Leadership & Collaboration? Mentor and train data engineers and analysts on platform best practices? Collaborate with data science teams to support ML/AI workload requirements? Coordinate with DevOps teams on infrastructure automation and deployment practices? Lead architectural review sessions and technical decision-making processes Performance & Cost Optimization? Monitor and optimize compute resource utilization across all platforms? Implement cost allocation and chargeback models for different business units? Analyze query patterns and usage metrics to identify optimization opportunities? Design and implement automated scaling policies based on workload demands? Establish SLA monitoring and reporting for platform availability and performance Security & Compliance? Implement data encryption, masking, and anonymization policies? Ensure compliance with regulatory requirements (GDPR, HIPAA, SOX, etc.)? Design and maintain audit trails and data access logging? Coordinate security assessments and vulnerability management? Establish data classification and handling procedures across all platformsPay Rate: $16.00-$22.00 depending on skills and experienceWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are seeking a Senior Data Engineer with AI/GenAI expertise to join the Data Platform (Foundry) team. This role will focus on building and optimizing enterprise-scale data pipelines while also... More enabling metadata-driven, AI-driven use cases, including copilots, LLM integrations, and intelligent data workflows using Databricks, Azure, ADF, Azure SQL, Astronomer/Airflow or Control M.Key ResponsibilitiesDesign, build, and maintain data pipelines using Databricks, Spark, ADF, Advanced SQL/Python, and Azure servicesDevelop and optimize bronze ? silver ? gold transformationsSchedule and orchestrate via ADF, Airflow, Control M. Airflow experience would be a huge plusEnable AI/GenAI use cases across the platform, including:Copilot integrationsLLM-based workflowsIntelligent data enrichment pipelinesWork with Databricks GenAI capabilities .Integrate external AI platforms (e.g., Anthropic, Azure OpenAI) into enterprise data workflowsEnsure data reliability, performance, and operational stabilityTroubleshoot and resolve production issues with strong SLAsSupport ingestion using tools such as:Fivetran / ADF / Auto LoaderImplement data quality, monitoring, and reconciliation frameworksAbility to read/write code in SQL, Python, otherCollaborate across:Data Engineering teamsData Platform engineeringBusiness stakeholdersContribute to platform modernization and AI adoption strategyFollow governance best practices:Code qualityDeployment controlsAudit and complianceWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less