Data Engineer II
Aws Data Engineer
Azure Data Engineer
Big Data
Bigdata
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Infrastructure
Cloud Platform
Cloud Platforms
Cloud Technology
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Integration Tools
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
Databricks
DevOps
DevSecOps
ETL
Gcp Data Engineer
Health Data
Informatica
Information Technology (IT)
Infrastructure As Code
Integration
Lakehouse
Security Devops
Spark
SQL
Job Description
Lantern is hiring a Data Engineer II to build scalable, high-performance data pipelines for enterprise ingestion, transformation, and data exports.
Responsibilities
- Design and implement robust, scalable, high-performance data pipelines using AI tools and development practices
- Build data ingestion and transformation workflows, including data quality capabilities for Application Engineering, Analytics, and business verticals
- Partner with the Data Engineering Manager and Product to create and refine data models that improve reliability and interpretability
- Design, develop, and maintain data export solutions to move data efficiently to external systems and platforms
- Contribute to design documents, evaluate technologies, and run Proof of Concepts (PoCs)
- Support production jobs and help mitigate issues in a timely manner
- Develop unit, integration, and functional tests for new pipeline features
- Contribute to the technology roadmap, participate in PR reviews, and help define standards and best practices
- Demonstrate a positive attitude that supports continuous learning and innovation
Requirements
- 3+ years of experience as a Data Engineer (or related role), building and supporting production data pipelines
- 1+ years cloud and infrastructure experience with Azure (preferred), or AWS / GCP
- Hands-on experience with Spark, Python, and SQL to build, test, and maintain data pipelines, including writing clear, maintainable code and queries
- Experience with Microsoft SQL Server (preferred) or other relational databases, including query optimization and performance tuning
- Experience with big data technologies such as Spark (preferred), Databricks, or similar frameworks
- Experience using Infrastructure as Code tools such as Terraform (or similar) to provision and manage cloud resources
- Proven experience delivering scalable, reliable pipelines with focus on data quality, testing, and operational support
- Experience contributing to data lake or lakehouse solutions for analytics and downstream consumption
- Strong communication skills to explain complex technical concepts to non-technical stakeholders
- Healthcare standards experience helpful: HL7, X12 EDI, FHIR
- RESTful API creation experience or knowledge is a plus
- Experience with agentic AI and leveraging AI for development
Technologies
- Azure, AWS, GCP
- Spark, Python, SQL
- Microsoft SQL Server, Databricks
- Terraform
- Data lake, lakehouse
- HL7, X12 EDI, FHIR
- RESTful APIs
Benefits
- Medical Insurance
- Dental Insurance
- Vision Insurance
- Short & Long Term Disability
- Life Insurance
- 401k with company match
- Flexible Time Off
- Paid Parental Leave
Location
- Hybrid in Dallas, TX (at least 3 days/week in the office)
About you
- Use logic in decision-making and understand that progress is critical to making change
- Inclusion is a core personal belief
- Bring grit, drive, and ambition to tackle big problems
- Care deeply about customers and keep humanity in decisions
- Practice integrity and focus on the truth
- Thrive in a team environment with collaboration as a key part of innovation and creating change