Job Search Results for big data

Insight Global is seeking a skilled and motivated Big Data Engineer to join our clients GenAI applications team based out of India. This role is part of a strategic initiative to migrate their data... More infrastructure from on-premise to Google Cloud Platform (GCP). You will work closely with a high-performing team of engineers and leaders to build scalable data solutions and support cloud-native application development. Key Responsibilities:Design, develop, and maintain scalable big data pipelines and applications.Collaborate with cross-functional teams to support the migration from on-prem to GCP.Contribute to the development of GenAI-powered applications and services.Participate in whiteboarding sessions and technical discussions to solve complex problems.Ensure high performance, reliability, and scalability of data systems.Work closely with senior engineers and leadership to align with project goals.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Insight Global is looking for a Backend Java Developer to join one of the world's leading online payment platform companies based in San Jose, CA. This is a compliance platform team, who is... More responsible for overseeing and coordinating responses to global regulatory changes that impact the company. This team tracks evolving regulations across jurisdictions, assess business and technology impacts and drive timely implementation to ensure compliance.This team enables he company to stay ahead of regulatory developments and maintain operation readiness in a rapidly changing global environment.Youll be part of a dynamic and evolving landscape, where you can apply your expertise and make meaningful contributions to our platform, leveraging AI/ML solutions to drive greater efficiency. Primary Job Responsibilities Develop and maintain a robust and scalable big data insights platform to drive AI-assisted process automation and deliver actionable insights. Develop solutions that combine state-of-the-art Generative AI techniques with rich data to deliver best-in-class automation and user experience. Design and implement batch and near real-time data pipelines using Spark, Flink, and BigQuery. Design and implement efficient data models in relational and NoSQL databases like Oracle and BigQuery. Leverage cloud-native technologies to build world-class backend platforms. Work closely with cross-functional teams and other stakeholders to deliver features. Lead feature or component design reviews and is fully recognized as the go-to developer for that component. Participate in architecture discussions and propose and discuss solutions to platform and product changes. Stay current with emerging technologies and promote a culture of excellencePay rate: $10 USD/hrWe are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Insight Global is seeking a Data Analyst to join one of their top management consulting clients based in New York, NY. This client supports large scale financial services companies on a variety of... More data centric initiatives, ranging from technical to functional in nature. This person will join the internal team that supports a variety of clients at once with various projects and deliverables. This individual will focus on heavy data analysis to support data centric projects and product integration efforts. 60% or so will focus on analytics, with 40% of the day focused on client facing meetings and stakeholder engagement. We are seeking someone with strong SQL, exposure to ETL and pipeline developments, and Python for adhoc scripting. Visualization tools will also be a plus.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Day to Day Insight Global is seeking a Data Engineer to join one of a Retail Client in Vancouver BC. This Data Engineer will sit within the People Enablement Technology team which is committed to... More enabling seamless experiences for their global workforce. The Data & Analytics Pillar is a newly formed team, focused on automating our core health & wealth offerings as well as work across the department to enable efforts driven by the People Systems, Digital Workplace & Learning, and Workforce Agility pillars. The project the successful candidate will join is bringing the learning data from various platforms such as LI learning into an existing data lake. This will allow for analytics insights to be generated from this people data for various teams such as the ESG team. The data engineer will support using data bricks for this ingestion, and use unity catalog for its categorization and potential encryption if required.A successful candidate will be a problem solver and an expert in ETL programming/scripting, data modelling, data integration, SQL and have exemplary communication skills. The candidate will need to be comfortable with ambiguity in a fast-paced and ever-changing environment, and able to think big while paying careful attention to detail. The candidate will know, and love working with new technologies, can model multidimensional datasets, and can partner with cross functional business teams to answer key business questions. Apart from building data pipelines, you will be an advocate for automation, performance tuning and cost optimization. Be ready to question the status quo and bring forth intelligent solutions and proof of concepts.Principal Duties and Responsibilities: Support the design and implementation of complex data integration, modeling, and orchestration workflows using tools such as Databricks, Azure Data Factory, and SnowflakeCollaborate with architects, engineers, analysts, and business stakeholders to deliver secure, reliable, and high-performing data solutionsApply DevSecOps principles to ensure secure development, deployment, and monitoring of data pipelines and infrastructureImplement and maintain data encryption, access controls, and governance using Databricks Unity Catalog to protect sensitive informationParticipate in operational support, including troubleshooting, performance tuning, and continuous improvement of data workflowsCreate and maintain technical documentation and contribute to knowledge-sharing across the teamWe are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

An employer is looking for a Sr. Data Engineer in the Seattle, WA area. This entertainment company is looking for a Sr. Data Engineer to join their consumer business division. They are dealing with... More large amounts of television and digital data around their customers. This person will be responsible for their Data Warehouse as they evolve into a more cloud based environment. Someone with AWS and Snowflake experience would be a standout candidate. However, if you have an expertise in Python for developing ETL pipelines, data warehousing, and some cloud experience, this could be a fit for you. This group is looking for a team player who's interested in learning new technologies in an evolving organization. If this sounds like you, please apply today!We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Insight Global is looking for a Data Engineer to join the team with one of our financial clients located in NYC. This person will work in a team of data engineers and data architects to acquire data... More from internal and external sources, ingest into their repositories, and optimize it for data consumptions by end-users. You will implement methods to improve data reliability and quality, combine raw information from different sources to create consistent formats, and develop and test architectures for data extraction and transformation. You will also build and maintain optimal data pipeline architectures, assemble large and complex data sets, as well as Big Data technologies, and ensure that data is readily available to data scientists, analysts, and other users. You should have a background in software development and know how to build scripts.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Day to Day:In this role, the data engineer will work closely with cross-functional teams in an Agile environment to design, build, and maintain scalable data pipelines and cloud-based analytics... More solutions. A typical day involves collaborating with fellow engineers, product owners, and data stakeholders to understand business needs and translate them into technical solutions. The engineer will develop and optimize data workflows using GCP services such as BigQuery, Dataflow, Pub/Sub, and Dataproc, while also ensuring data quality through robust ETL processes. Responsibilities include automating data ingestion, transformation, and validation, as well as contributing to the design of CI/CD pipelines for continuous integration and deployment. The role also involves participating in code reviews, technical discussions, and knowledge sharing sessions to promote best practices and drive innovation across the team.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Insight Global is seeking a skilled Data Strategist for one of our clients. This person will be supporting a data management division that is part of an enterprise data resiliency initiative across... More multiple platforms. They will be responsible for building data strategy, leveraging DaaS for semantic layering and data federation across big data platforms. The Analyst will work with various teams and stakeholders to establish a new data fabric that will help create a common view of data and provide a centralized mechanism for its aggregation, cleansing, transformation, augmentation, validation, and syndication. This person will need to have knowledge of big data platforms to understand and map out long term strategy for the division to ensure current and future technologies align to support business needs.Pay is 70.24/hour.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Job Description: Lead complex technology initiatives including those that are companywide with broad impact. Act as a key participant in developing standards and companywide best practices for... More engineering complex and large scale technology solutions for technology engineering disciplines. Design, code, test, debug, and document for projects and programs. Review and analyze complex, large-scale technology solutions for tactical and strategic business objectives, enterprise technological environment, and technical challenges that require in-depth evaluation of multiple factors, including intangibles or unprecedented technical factors. Make decisions in developing standard and companywide best practices for engineering and technology solutions requiring understanding of industry best practices and new technologies, influencing and leading technology team to meet deliverables and drive new initiatives. Collaborate and consult with key technical experts, senior technology team, and external industry groups to resolve complex technical issues and achieve goals. Lead projects, teams, or serve as a peer mentor. We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Insight Global is looking for a Principal Data Engineer for a long term contract opportunity. The data engineer designs and builds platforms, tools, and solutions that help the bank manage, secure,... More and generate value from its data. The person in this role creates scalable and reusable solutions for gathering, collecting, storing, processing, and serving data on both small and very large (i.e. Big Data) scales. These solutions can include on-premise and cloud-based data platforms, and solutions in any of the following domains ETL, business intelligence, analytics, search, messaging, data warehousing, stream processing, and machine learning. Responsible and accountable for risk by openly exchanging ideas and opinions, elevating concerns, and personally following policies and procedures as defined. Accountable for always doing the right thing for customers and colleagues, and ensures that actions and behaviors drive a positive customer experience. While operating within the Bank's risk appetite, achieves results by consistently identifying, assessing, managing, monitoring, and reporting risks of all types.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less