When you join the growing BILH team, you're not just taking a job, you’re making a difference in people’s lives.

The AI Data Scientist role is designed for individuals who are interested in applying data science, machine learning, and generative AI to healthcare and operational challenges.

This position emphasizes fundamental understanding of generative AI and large language models (LLMs), including how models are trained, finetuned, evaluated, and applied responsibly. The role focuses on model development, experimentation, evaluation, and analytical reasoning.

The AI Data Scientist will work as part of a multidisciplinary team and receive mentorship while developing skills across the AI and data science lifecycle, from data exploration and modeling to evaluation and communication of results.

Job Description:

 Essential Duties & Responsibilities including but not limited to:

1. Support the development and evaluation of machine learning and generative AI models for healthcare analytics, automation, and decision support.  

2. Build a foundational understanding of large and small language models (LLMs), including basic architecture concepts, embeddings, inference behavior, and limitations.  

3. Assist with prompt design, prompt testing, and prompt optimization to improve accuracy, relevance, and consistency of LLM outputs.  

4. Participate in LLM finetuning activities (such as instruction tuning or parameter efficient finetuning) under guidance and within established workflows.  

5. Help design and execute model evaluation approaches, including quantitative metrics and qualitative review of LLM outputs (accuracy, completeness, bias, hallucinations).  

6. Contribute to retrieval of augmented generation (RAG) projects by assisting with data preparation, document evaluation, and grounding assessments.  

7. Perform exploratory data analysis, data validation, and feature engineering for predictive and descriptive modeling tasks.  

8. Collaborate with senior data scientists, data engineers, clinicians, and business stakeholders to translate problems into data science and AI modeling work.  

9. Create visualizations, written summaries, and presentations to communicate insights and model performance to technical and nontechnical audiences.  

10. Follow Responsible AI practices, including awareness of fairness, bias, privacy, transparency, and appropriate AI use in healthcare.  

11. Participate in team meetings, mentoring sessions, and ongoing learning activities related to AI and data science.

Minimum Qualifications:

Education: 

Bachelor’s degree in Data Science, Computer Science, Artificial Intelligence, Statistics, Mathematics, or a related quantitative field required.  

Relevant coursework or academic projects in machine learning, NLP, or AI strongly preferred. 

Licensure, Certification & Registration: 

None required 

Experience: 

0–2 years of related experience, including internships, research, academic projects, or entry level roles.  

Hands on experience through coursework, capstone projects, labs, or internships involving data analysis or AI modeling. 

Skills, Knowledge & Abilities: 

Foundational understanding of data science, machine learning, and generative AI concepts.  

Basic familiarity with large language models (LLMs) and common generative AI use cases.  

Experience using Python for data analysis, modeling, or experimentation.  

Understanding of model evaluation concepts, including metrics and qualitative assessment approaches.  

Strong analytical and problem-solving skills with attention to detail.  

Ability to explain technical concepts clearly in both written and verbal form.  

Willingness to learn new tools, methods, and AI techniques in a collaborative environment. 

Preferred Qualifications & Skills: 

Coursework or project experience in natural language processing (NLP) or generative AI.  

Exposure to LLM finetuning methods or experimentation with pretrained models.  

Familiarity with LLM evaluation techniques, such as human review, test datasets, or scoring frameworks.  

Experience with data visualization tools (e.g., matplotlib, seaborn, Power BI, Tableau).  

Awareness of AI ethics, fairness, and responsible AI practices.  

Interest in healthcare analytics or working with regulated data. 

Key Business Relationships: (Title and Purpose) 

1 Senior Data Scientists 

Mentorship, model review, and technical guidance 

2 Data Engineers 

Access to curated datasets and data pipelines 

3 Clinical Stakeholders 

Understanding healthcare problems and success criteria 

Pay Range:

$100,000.00 USD - $145,000.00 USD

The pay range listed for this position is the annual base salary range the organization reasonably and in good faith expects to pay for this position at this time. Actual compensation is determined based on several factors, that may include seniority, education, training, relevant experience, relevant certifications, geography of work location, job responsibilities, or other applicable factors permissible by law. 

As a health care organization, we have a responsibility to do everything in our power to care for and protect our patients, our colleagues and our communities. Beth Israel Lahey Health requires that all staff be vaccinated against influenza (flu) as a condition of employment.

More than 35,000 people working together. Nurses, doctors, technicians, therapists, researchers, teachers and more, making a difference in patients' lives. Your skill and compassion can make us even stronger.

Equal Opportunity Employer/Veterans/Disabled