Job Search Results for data engineer

An Insight Global client is looking to hire a Sr. Data Engineer to join their team of 16 in Arlington, VA. This is a very dynamic team that juggles multiple projects at one time. We are looking for... More someone to be an architect, developer and mentor to junior level team members. You can expect 75% of your day to be dedicated to coding while the remaining 25% will split between mentorship and meetings. This role will consist of primarily internal projects, with about 10% being client facing. We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

We are seeking a highly skilled Software Engineer with expertise in Python, AWS, and coding best practices. The ideal candidate will have a strong background in software development, cloud computing.... More You will be responsible for developing and maintaining scalable software solutions that power our products and services.Key Responsibilities:?Design, develop, and maintain high-quality software solutions using Python.?Utilize AWS services to build, deploy, and manage applications in the cloud.?Has strong knowledge of cloud data engineering principles and manages Python based data pipelines.?Write clean, maintainable, and efficient code.?Collaborate with cross-functional teams to define, design, and ship new features.?Troubleshoot and resolve complex technical issues and bugs.?Perform code reviews and provide constructive feedback to peers.?Stay up-to-date with the latest industry trends and technologies to ensure our solutions remain current and competitive.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Data Pipeline Development?Develop and maintain ETL/ELT pipelines in Databricks using Python (PySpark) and SQL?Build data pipelines aligned to medallion architecture (Bronze, Silver, Gold... More layers)?Implement transformations, aggregations, and data enrichment logic to support downstream analytics?Ensure all pipelines are scalable, efficient, and production-readyWorkflow Migration (Alteryx ? Databricks)?Convert Alteryx workflows into Databricks-native pipelines?Translate legacy business logic into optimized Spark-based transformations?Support migration of both: oSimple workflows (standard transformations)oComplex workflows (multi-step logic, flat-file dependencies)?Validate output to ensure high parity with legacy systemsData Ingestion & Processing?Build and maintain ingestion pipelines for: oStructured data sourcesoFlat files and semi-structured datasets?Implement robust ingestion frameworks to handle schema changes and automate data loads?Optimize ingestion processes for performance, cost, and reliabilityTesting, Quality & Optimization?Execute unit testing, SIT, and regression testing for pipelines?Support data validation by comparing legacy vs. new system outputs?Identify and resolve defects, data discrepancies, and performance issues?Optimize pipeline performance (runtime, cost, scalability)Documentation & Best Practices?Write clear technical documentation (code comments, runbooks, README files)?Follow established coding standards, version control, and CI/CD processes?Contribute to continuous improvement of development standards and reusable frameworksCollaboration & Agile Delivery?Work within an Agile Scrum environment (2-week sprints)?Partner with Data Architects, Product teams, and SMEs to understand requirements?Participate in sprint ceremonies (standups, planning, retrospectives)?Support backlog refinement and provide technical input on implementation approachesWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Seeking an experienced Security Engineer to define and implement the security posture for humanoid robotic deployments. In this role, you will own the unified security strategy for hybrid operations,... More ensuring that robot data and control systems remain secure across both cloud environments and on-premise customer sites. You will be responsible for safeguarding the infrastructure that collects sensitive training data and manages real-time robotic systems, focusing on data encryption, secure remote access, and robust identity management.Unified Security Strategy: Develop and maintain a comprehensive security framework that spans hybrid cloud and on-premise industrial environments.Data Encryption: Investigate and implement end-to-end encryption for data at rest and in transit, specifically protecting robotic telemetry and video training data.Access Control: Design and manage Role-Based Access Control (RBAC) and modern authentication protocols (e.g., OIDC, SAML) across the fleet and developer platforms.Secure Remote Access: Establish secure, auditable remote access solutions for engineers to troubleshoot robots at customer sites without compromising facility network integrity.Network Security: Troubleshoot and harden networking configurations, addressing performance and security challenges in complex industrial environments.Infrastructure as Code (IaC): Audit and secure infrastructure deployments using tools like Terraform, Helm, and Ansible.Incident Response: Participate in on-call rotations and respond to security-related outages or vulnerabilities.Compliance & Auditing: Work closely with customer IT teams to ensure solutions meet stringent enterprise security and safety requirementsWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking for a Data Center Project Architect to support its Fortune 50 Tech customer. This is a hands-on role where someone will design and build end-to-end data and application... More systems?everything from AWS-based data lakes to analytics dashboards and AI-driven workflows. They?re looking for a strong full-stack engineer with deep AWS experience and a background in data pipelines, ideally in manufacturing or IoT environments. It?s a 12-month onsite role in Sunnyvale with a strong bill rate, and the work directly supports next-gen device and optics innovation. This is a great fit for someone who wants to own architecture, work with cutting-edge AI tools, and have real impact on how data is collected and used at scale.?Build internal web apps for metrology configuration management?Develop and manage S3-based data lake + pipelines?Build serverless backend services for data ingestion & processing?Create analytics dashboards (yield, SPC, GRR, etc.)?Implement AI-driven analysis workflows?Collaborate with engineers + vendors to translate requirements into architectureWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

? Develop scalable time series forecasting systems leveraging global models like Temporal Fusion Transformers, N-BEATS, and PATCHTST, enabling robust forecasting across thousands of retail and... More e-commerce time series. ? Foundational Knowledge on advanced regression. ? Apply generative AI to synthesize time series data, enhance model training pipelines, and build intelligent NLP-based assistants for analytics enablement. ? Design and train large-scale neural networks for time series, anomaly detection, and causal inference, with deployment via automated batch pipelines ? Build and maintain production-ready applications on cloud platforms, integrated with internal systems to deliver insights at scale. Collaborate with cross-functional teams to define objectives, formulate hypotheses, and deploy models that directly influence decision-making.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are seeking 5 Data Engineers to support a large-scale application integration initiative focused on physician and provider-facing systems. This team will be responsible for designing and building... More data infrastructure, developing integrations, and ensuring seamless data flow across multiple applications and platforms. The engineers will work closely with business and technical stakeholders to streamline data processes, improve data quality, and support system consolidation efforts. Responsibilities include data pipeline development, ETL processes, data modeling, and optimizing data movement between systems.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Senior Data Applications Engineer to support the development of a new internal remediation platform for a large financial services client. This individual will help design... More and build a custom application that enables users to manage remediation efforts, triage issues, and streamline workflows that are currently managed through Excel and manual processes.This is a highly visible initiative with aggressive delivery timelines and executive-level visibility. The ideal candidate will have experience building internal business applications from the ground up, integrating front-end interfaces with APIs and backend databases, and working directly with stakeholders to translate business requirements into technical solutions.This is a highly hands-on development role focused on application delivery rather than traditional data engineering or ETL pipeline development.Responsibilities- Design and develop a new internal remediation application used across multiple business entities- Build front-end user interfaces, dashboards, and workflow-driven experiences for business users- Develop and integrate APIs to connect application functionality with backend systems and databases- Design application workflows and user experiences that improve operational efficiency and reduce manual effort- Retrieve, manage, and display reference data from enterprise data sources- Partner with business stakeholders to gather requirements and translate them into scalable technical solutions- Assist in defining application architecture, interfaces, and data interactions while adhering to enterprise standards- Support reporting and dashboard functionality to provide visibility into remediation activities- Participate in technical reviews and collaborate with cross-functional teams in a fast-paced development environment- Deliver high-quality solutions within aggressive project deadlines and weekly executive review cyclesPay ranges from 60-70/hr based on qualifications and years of experience.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

This role is a highly technical Data Quality Engineer supporting enterprise data pipelines in Azure/Databricks. Reporting into a senior lead, this individual will act as a junior counterpart and key... More liaison between data lake and data insights teams. The ideal candidate is a strong hands-on data engineer with deep experience in Azure, PySpark, and pipeline validation. Other key responsibilities include:? Validating and monitoring enterprise data pipelines across Azure (ADF, Databricks, ADLS)? Own end-to-end data validation, testing, and automation across ingestion, transformation, and consumption layers? Build and maintain data quality frameworks, SLAs, and monitoring dashboards? Partner across data lake & insights teams to ensure data accuracy, reliability, and pipeline health? Drive automation initiatives (Python/PySpark) to scale validation and reduce manual effortDevelop Power BI dashboards for operational data health trackingWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Data Engineer to join a top global consulting firm. This firm delivers solutions through innovative management consulting, technology, and corporate & digital ventures.... More The engineer will play a key role in validating and reconciling workplace data across global offices while helping build scalable automation solutions to improve data accuracy and operational efficiency.Responsibilities:?Compare and reconcile space data across multiple sources (GRE/JLL survey files, Appspace platform, and Microsoft Exchange mailbox data) ?Identify discrepancies at the Room, Desk, and Floor level across 130+ global office locations ?Generate structured, auditable validation reports for business stakeholders and local office teams ?Extract and analyze Exchange Online resource/mailbox data via PowerShell ?Translate manual validation workflows into automated Python-based processes ?Contribute to development of a scalable validation model to standardize outputs across offices ?Collaborate closely with global stakeholders, including product, real estate, and local office teams ?Support ongoing enhancements to validation logic and data quality processesThis position is a 12-month contract. Individuals must be located in India, local to Delhi to go into the local office on a weekly basis. Exact compensation may vary based on several factors, including geographic location, skills, experience, and education.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less