Hadoop

Hadoop Data Jobs

44 jobs found

Today

Data Scientist

Booz Allen Hamilton Monterey, CA

Monterey, CA

Today

$78k - $176k/yr Full time Analytics Artificial Intelligence Big Data

Apply Now

Job Description

Data Scientist role at Booz Allen Hamilton, onsite in Monterey, California. The position centers on analyzing data, developing predictive models, and translating data into actionable insights for clients across private and public sectors. Candidates should bring Python, ML, AI, and NLP experience and hold a Secret clearance.

Responsibilities

Apply analytical skills and data science expertise to deliver real-world impact.
Collaborate closely with clients to understand their questions and needs.
Investigate data-rich environments to identify relevant information pieces.
Develop algorithms and systems, selecting the appropriate tools and frameworks to convert disparate data points into objective answers that support informed decision-making.
Provide a deep understanding of the data, its meaning, and potential applications for clients.

Requirements

2+ years of experience in data exploration, cleaning, analysis, visualization, or mining
2+ years of experience using Python for data analysis
Experience analyzing structured and unstructured data sources
Experience developing predictive data models, quantitative analyses, and visualization of targeted data sources
Experience with Machine Learning, Artificial Intelligence, or Natural Language Processing
Knowledge of simulation techniques such as discrete event simulation, Monte Carlo simulation, and agent-based modeling
Secret clearance
Bachelor’s degree

Technologies

Python
R
SAS
SQL
NoSQL
Hadoop
Hive
EMR
Kafka
Spark
MySQL
Grafana
Contour
Vertex
Workshop

Benefits

Health benefits
Life insurance
Disability benefits
Financial benefits
Retirement benefits
Paid leave
Professional development
Tuition assistance
Work-life programs
Dependent care

Identity verification

As part of the hiring process, the company conducts identity verification using advanced biometrics and AI to ensure authenticity and protect against fraud. Interviews and assessments may require on-camera participation, and a photograph may be taken to verify identity and prevent fraud.

Candidate AI Usage Policy

AI is integrated into daily work at Booz Allen, with a commitment to responsible and ethical use of AI tools. However, the candidate process remains fair and based on your own skills and knowledge. Use of AI or other tools to assist with interview responses is prohibited unless explicit permission is granted.

Work model

This position is onsite in Monterey, CA, with work primarily performed at Booz Allen offices or a customer facility. Occasional in-person work may be required in alignment with role needs and leadership expectations.

Commitment to non-discrimination

All qualified applicants will be considered for employment without regard to disability, protected veteran status, or any other status protected by applicable law.

Clearance

Secret clearance is required for this role.

Compensation

The projected salary range for this position is USD 77,600 to 176,000 annually. Booz Allen determines compensation based on location, education, abilities, and experience, among other factors, and this range reflects typical pay for the role. This posting will close within 90 days of its publication date.

View full job page →

Today

Senior Data Engineer

Brooksource New York, NY 🇺🇸 Remote

New York, NY

Today

$65 - $85/hr Full time Senior Analytics API

Apply Now

Job Description

The Senior Data Engineer will design, develop, and maintain scalable data pipelines and architectures that support advanced analytics and business intelligence, leveraging big data ecosystems, cloud platforms, and robust data modeling.

Responsibilities

Design, build, and optimize large-scale ETL pipelines using Informatica, Talend, Apache Spark, and Apache Hive.
Create and sustain data architectures on cloud environments including AWS, Azure Data Lake, and other public clouds.
Partner with cross-functional teams to capture requirements and translate them into scalable data solutions.
Develop and implement data models employing dimensional modeling techniques for data warehousing and analytics.
Oversee data integration from linked data, RESTful APIs, and additional external sources.
Ensure data quality, security, and compliance throughout the data lifecycle.
Support machine learning model deployment through efficient data pipeline integration.
Apply SQL, Python, Java, Bash, and shell scripting to automate processes and improve efficiency.
Contribute to Agile practices by participating in sprint planning, reviews, and continuous improvement efforts.
Document data workflows and architecture diagrams to promote transparency and knowledge sharing.

Requirements

Proven experience as a Data Engineer or similar role focusing on big data systems and cloud-based architectures.
Extensive knowledge of AWS services (S3, Redshift, Glue), Azure Data Lake, Hadoop components, and other public cloud offerings.
Strong proficiency with SQL databases including Microsoft SQL Server, Oracle, and cloud-based options.
Hands-on ETL/ELT development experience using Informatica or Talend.
Demonstrated expertise in data modeling techniques, including dimensional modeling for enterprise data warehouses.
Proficiency in programming languages such as Python and Java, with automation scripting in VBA, Bash, and shell scripting.
Familiarity with business intelligence tools like Looker or similar platforms for reporting and analysis.
Understanding of RESTful API integration for linked data access.
Knowledge of analytics approaches related to database design, query management, model training, and analytics methodologies.
Experience delivering value in fast-paced environments using Agile methodologies.

Technologies

Informatica
Talend
Apache Spark
Apache Hive
AWS
Azure Data Lake
Hadoop
S3
Redshift
Glue
Microsoft SQL Server
Oracle
SQL
Python
Java
VBA
Bash scripting
Shell Scripting
Looker
RESTful API

Pay

$65.00 - $85.00 per hour

Location

New York, NY (remote)

View full job page →

2d ago

Data Scientist II, Anti Money Laundering Transaction Monitoring

BMO Financial Group Chicago, IL

Chicago, IL

2d ago

$69k - $128k/yr Full time Ai Ml AML Aml Ctr

Apply Now

Job Description

BMO Financial Group is seeking a Data Scientist II to advance its AML transaction monitoring program from the Chicago area. The role centers on the design, development, and deployment of machine learning and analytical models for detecting money laundering activity and supporting the model lifecycle, with collaboration across AML Compliance, investigations, governance, and technology teams.

Responsibilities

Design, build, test, and deploy machine learning and analytical models used for AML transaction monitoring and suspicious activity detection
Analyze large volumes of customer, transactional, payment, and alert data to identify emerging money laundering risks, typologies, and anomalous behavior patterns
Develop and evaluate supervised and unsupervised machine learning approaches to improve detection effectiveness and investigator outcomes
Conduct feature engineering and exploratory data analysis to identify behavioral indicators associated with financial crime risk
Perform quantitative assessments of model performance, including detection effectiveness, productivity, false positive reduction, and risk coverage
Support model tuning, optimization, and revalidation activities to ensure models continue to perform as intended
Assess data quality and data lineage and partner with data management teams to resolve issues affecting model performance and reliability
Prepare clear and comprehensive model development, testing, and governance documentation to support model validation, audit, and regulatory reviews
Translate analytical findings into actionable recommendations for AML Compliance, FIU, and senior management
Collaborate with business stakeholders, investigators, model governance, and technology partners to prioritize enhancements and implement solutions
Research emerging financial crime typologies, machine learning techniques, and industry best practices to continuously improve monitoring capabilities
Contribute to strategic initiatives involving AI, machine learning, graph analytics, network analysis, and other advanced analytical approaches applicable to financial crime detection
Ensure all analysis and model development activities comply with regulatory requirements, internal policies, and model risk management standards
Take measured risks while protecting the bank by applying the Risk Management Framework and exercising sound risk-based judgment

Requirements

Typically between 4 - 6 years of relevant experience and a post-secondary degree in a related field or an equivalent combination of education and experience
Experience with Python and SQL for large-scale data analysis, feature engineering, and model development
Strong understanding of statistical analysis, machine learning algorithms, and model performance measurement
Experience working with large structured and semi-structured datasets
Experience using version control tools and code repositories (e.g., Git, GitHub, Azure DevOps) to support collaborative development and reproducible analytical workflows
Familiarity with generative AI tools and AI-assisted development practices (e.g., Microsoft 365 Copilot, GitHub Copilot, LLM-based coding assistants) to improve productivity, documentation, and analytical workflows
Ability to communicate technical concepts effectively to both technical and non-technical audiences

Technologies

Python
SQL
Git
GitHub
Azure DevOps
Dataiku
Databricks
SAS
Spark
Hadoop
Microsoft 365 Copilot
GitHub Copilot
LLM-based coding assistants
Cloud-based analytics platforms

Benefits

Performance-based incentives
Discretionary bonuses
Health insurance
Tuition reimbursement
Accident and life insurance
Retirement savings plans

Application deadline

08/04/2026

Location

Chicago, IL (onsite)

Address

320 S Canal Street

Salary

USD 69,000 - 127,800 per year — Salaried

Job Family Group

Data Analytics & Reporting

View full job page →

4d ago

Senior Lead Data Engineer

Information Technology Senior Management Forum Chicago, IL

Chicago, IL

4d ago

$209k - $239k/yr Full time Senior Big Data Cloud Platform

Apply Now

Job Description

Join Information Technology Senior Management Forum as a Senior Lead Data Engineer, guiding data engineering initiatives, architecting cloud-based data platforms, and mentoring a team of engineers. This role emphasizes collaboration across Agile teams and cross-functional partners to solve complex business problems with scalable data solutions.

Location

Chicago, IL (onsite)

Salary

USD 209,000 - 238,500 per yearly

Responsibilities

Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions across full-stack development tools and technologies
Lead a team of developers with deep experience in machine learning, distributed microservices, and full-stack systems
Use programming languages such as Java, Scala, and Python, along with Open Source RDBMS and NoSQL databases and cloud-based data warehousing services like Redshift and Snowflake
Share a passion for staying current with tech trends, experimenting with new technologies, participating in internal and external technology communities, and mentoring other engineers
Collaborate with digital product managers to deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
Perform unit tests and conduct code reviews to ensure solutions are rigorously designed, well-coded, and optimized for performance

Requirements

Bachelor’s Degree
Minimum 1 year of overall experience
At least 6 years of experience in application development (Internship experience does not apply)
At least 2 years of experience in big data technologies
At least 1 year of experience with cloud computing (AWS, Microsoft Azure, Google Cloud)

Technologies

Java
Scala
Python
Open Source RDBMS
NoSQL databases
Redshift
Snowflake
AWS
Microsoft Azure
Google Cloud
MapReduce
Hadoop
Hive
EMR
Kafka
Spark
Gurobi
MySQL
Mongo
Cassandra
UNIX/Linux
shell scripting
interactive AI tooling

Type

Full-time

View full job page →

5d ago

Data Engineer - Senior Associate

PRICE WATERHOUSE COOPERS Detroit, MI

Detroit, MI

5d ago

$77k - $202k/yr Full time Senior Apache Airflow Azure Data Factory

Apply Now

Job Description

Senior Associate Data Engineer at PwC responsible for designing and building data infrastructure, pipelines, integration, and transformation solutions to enable efficient data processing and actionable insights for clients, leveraging AWS, Azure, and Databricks.

Responsibilities

Design and implement data infrastructure and systems to facilitate efficient data processing and analysis
Develop and maintain data pipelines, integration, and transformation solutions to support client needs
Utilize Amazon Web Services (AWS) and Azure Data Factory to enhance data engineering capabilities
Apply data architecture development and database management skills to optimize data solutions
Leverage Apache Airflow and Apache Hadoop for scalable data processing and workflow management
Build and manage data lakes and data warehouses to support large-scale data storage and retrieval
Confirm data quality and validation through rigorous testing and performance tuning
Collaborate with clients to understand their data requirements and deliver actionable insights
Utilize Databricks Unified Data Analytics Platform for advanced data analytics and visualization
Implement data security best practices to protect sensitive information and maintain compliance
Apply dimensional modeling and directed acyclic graphs (DAGs) for efficient data organization and processing
Support the development of data strategies to drive business growth and informed decision-making

Requirements

Bachelor's degree
Minimum 2 years of experience

Technologies

Amazon Web Services (AWS)
Azure Data Factory
Microsoft Azure
Apache Airflow
Apache Hadoop
Databricks Unified Data Analytics Platform

Benefits

Annual discretionary bonus
Medical, dental, and vision benefits
401k
Holiday pay
Vacation
Personal and family sick leave

View full job page →

6d ago

Data Scientist

Booz Allen Hamilton Stafford, VA

Stafford, VA

6d ago

$62k - $141k/yr Full time Analytics Big Data Bigdata

Apply Now

Job Description

Data Scientist role at Booz Allen Hamilton, onsite in Stafford, VA, focused on turning data into actionable insights through machine learning, artificial intelligence, and natural language processing.

Responsibilities

Apply analytical methods to drive real world impact with data driven solutions.
Collaborate closely with clients to clarify questions and needs, then explore data rich environments to assemble the information puzzle.
Partner with teammates to design algorithms and systems, selecting the right tools and frameworks to turn disparate data points into objective answers for informed decisions.
Provide thorough understanding of the data, its meanings, and potential uses.
Contribute to data science initiatives with a focus on beneficial outcomes.

Requirements

Experience in data exploration, cleaning, analysis, visualization, or mining.
Proficiency with statistical and general purpose programming languages used for data analysis.
Familiarity with both structured and unstructured data sources.
Knowledge of Machine Learning, Artificial Intelligence, or Natural Language Processing.
Ability to develop predictive models, perform quantitative analyses, and visualize targeted data.
Capability to deploy NLP, text mining, or machine learning techniques.
Secret clearance.
Bachelor's degree.

Technologies

R
Python
SQL
NoSQL
MapReduce
Hadoop
Hive
EMR
Kafka
Spark
Gurobi
MySQL
Plotly
Seaborn
ggplot2
Palantir Foundry
War Data Platform (WDP)
Advana
Databricks

Benefits

Health benefits
Life insurance
Disability benefits
Financial benefits
Retirement benefits
Paid leave
Professional development
Tuition assistance
Work life programs
Dependent care

Work Model

Remote: May require occasional in person work at a Booz Allen or customer facility.
Hybrid: Regular presence at a Booz Allen facility, with potential visits to customer facilities, aligned with leadership expectations and role needs.
Onsite: Primary work from a Booz Allen office or customer site, collaborating directly with colleagues and clients as required.

Location

Stafford, VA (onsite)

Salary

USD 62,000 - 141,000 per year

Education

Bachelor's degree

View full job page →

6d ago

Data Scientist, Senior

Booz Allen Hamilton Washington, DC

Washington, DC

6d ago

$99k - $225k/yr Full time Senior Analytics Big Data

Apply Now

Job Description

Senior Data Scientist role onsite in Washington, DC with Booz Allen Hamilton.

Responsibilities

Leverage leadership and data science expertise to drive real world impact.
Partner with clients to understand questions and needs, then explore data-rich environments to uncover relevant information.
Guide teammates and steer the development of algorithms and systems.
Apply the right mix of tools and frameworks to transform disparate data points into objective answers that inform client decisions.
Provide deep data insights, explain what the data means, and advise on how it can be used.

Requirements

At least 5 years of experience in data science, machine learning, or AI development
At least 5 years of experience using Python for data analysis and model development
At least 5 years of experience analyzing big data, feature engineering, and statistical modeling
Experience with predictive modeling, classification, and anomaly detection techniques
Experience with geospatial analysis, signal processing, or time-series forecasting
Experience with cloud computing
Secret clearance
Master's degree in Data Science, Machine Learning, or Computer Science

Technologies

Python
MapReduce
Hadoop
Hive
EMR
Kafka
Spark
Gurobi
MySQL
Streamlit
Plotly
Seaborn
ggplot2
Cloud computing

Benefits

Health benefits
Life benefits
Disability benefits
Financial benefits
Retirement benefits
Paid leave
Professional development
Tuition assistance
Work-life programs
Dependent care

The Opportunity

The role centers on turning complex data into useful information using IoT, ML, and AI to address global challenges across private and public sectors, including fraud detection.

Nice If You Have

5+ years of experience in the defense sector
Experience with distributed data or computing tools such as MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL
Experience with visualization packages such as Streamlit, Plotly, Seaborn, or ggplot2
TS/SCI clearance

Clearance

Applicants selected will undergo a security investigation and may need to meet eligibility requirements for access to classified information; Secret clearance is required.

Compensation

Salary is determined by location, education, experience, and other factors. The projected annual range is 99,000 to 225,000 USD, with the understanding that this is one component of Booz Allen's total compensation.

Identity Statement

As part of the hiring process, you will complete an identity verification using advanced biometrics and AI to ensure authenticity and prevent fraud.
Interviews and assessments may require you to be on camera, and Booz Allen may take your picture for identity verification.

Candidate AI Usage Policy

AI tools are part of the work environment, but use of AI or other tools to assist with interview responses is prohibited unless explicitly permitted.

Work Model

Remote: Occasional in-person work at Booz Allen or a customer facility may be required.
Hybrid: Regular work from a Booz Allen facility with possible visits to customer facilities.
Onsite: Primarily work at a Booz Allen office or customer facility, collaborating with colleagues and clients.

Commitment to Non-Discrimination

All qualified applicants will receive consideration for employment without regard to disability, protected veteran status, or other statuses protected by law.