Software/Data Engineer with Apache Iceberg / Boston
Boston, Massachusetts
Full Time
$150k - $170k
We are seeking a skilled Software/Data Engineer to join a team at a leading life sciences consulting company located in the Greater Boston area. In this role, you will leverage your expertise in data engineering to support clients in the life sciences sector, ensuring the efficient processing and analysis of large datasets. You will work with advanced technologies, including Apache Iceberg, Python, PySpark, and Databricks, to design and implement robust data pipelines and ETL processes that drive actionable insights for clients. You will also be doing some web development, so the ideal candidate will have experience in both software and data engineering.
As part of a dynamic and collaborative team, you will engage with cross-functional groups to understand their data needs and develop innovative solutions tailored to the life sciences domain. Your contributions will play a crucial role in enhancing data quality and integrity, enabling clients to make informed decisions based on reliable data. Candidates must be local to the Greater Boston area, as this position offers opportunities for in-person collaboration and engagement with the team and clients.
Required Skills and Experience
- Proficiency in Apache Iceberg
- Strong experience with Python
- Expertise in PySpark
- Familiarity with Databricks
- Solid understanding of data engineering principles and best practices
- Solid understanding of software web development with Python
What You Will be Doing
- Designing and implementing data pipelines using Apache Iceberg and PySpark
- Collaborating with cross-functional teams to understand data needs and optimize workflows
- Developing and maintaining ETL processes in Databricks
- Ensuring data quality and integrity throughout the data lifecycle
- Contributing to the architecture and strategy of data solutions
The Offer
- Medical Insurance
- Dental Benefits
- Vision Benefits
- Paid Time Off (PTO)
- 401(k) {including match}