Sr. Data Engineer

About Providence

Providence, one of the US’s largest not-for-profit healthcare systems, is committed to high quality, compassionate healthcare for all. Driven by the belief that health is a human right and the vision, ‘Health for a better world’, Providence and its 121,000 caregivers strive to provide everyone access to affordable quality care and services.

Providence has a network of 51 hospitals, 1,000+ care clinics, senior services, supportive housing, and other health and educational services in the US.

Providence India is bringing to fruition the transformational shift of the healthcare ecosystem to Health 2.0. The India center will have focused efforts around healthcare technology and innovation, and play a vital role in driving digital transformation of health systems for improved patient outcomes and experiences, caregiver efficiency, and running the business of Providence at scale.


Why Us?

  • Best In-class Benefits
  • Inclusive Leadership
  • Reimagining Healthcare
  • Competitive Pay
  • Supportive Reporting Relation

How is this team contributing to vision of Providence?

- Ensure a continual and seamless service for customers regardless of which services they access. What will you be responsible for?

- Design, develop, and maintain end to end data pipelines and ETL/ELT workflows using Python, SQL, Azure Data Factory, Snowflake, Databricks, and related services.

- Build scalable data ingestion frameworks to extract, parse, transform, and load structured, semi-structured, and unstructured data from files, APIs, databases, and enterprise applications.

- Drive improvements in data architecture, performance tuning, optimization, and reduce technical debt across data systems

- Monitor, troubleshoot, and enhance existing data pipelines and systems; proactively resolve data issues and production defects.

- Developing Ad hoc and delivered reports using SQL backend queries with Power BI to display the data.

- Displaying advanced analytics skills for providing insights to business owners.

- Communicate clearly when faced with unclear requirements or difficult situations so blockers can quickly be removed.

- Maintain strong documentation of data processes, ER diagrams, and architecture.

- Stay current with emerging data technologies, tools, and industry best practices, and advocate improvements within the team. What would your day look like?

- Understand business and feature requirements.

- Create design documents and architecture documents along with principal engineer and architects.

- Build and enhance data pipelines using Azure Data Factory, Databricks, Python, and Snowflake.

- Onboard different data sources for integration using ADF, Databricks, Snowflake.

- Work in Agile mode and work on assigned user stories.

- Ensure code is always checked in and ensure source control standards are followed.

- Collaborate with different teams to understand end to end requirement for new data/report.

- Working on AI use cases/initiatives. Who are we looking for?

- 5–8 years of professional experience in Data Engineering.

- Strong programming skills in Python for ETL, data ingestion, and data transformation.

- Hands on expertise in Azure Cloud (ADF, Azure Databricks, Azure Storage, Azure SQL, Synapse, etc.).

- Strong knowledge on Power BI and advanced analytics.

- Deep knowledge of SQL including complex queries, performance tuning, stored procedures.

- Experience with Snowflake—warehouse design. Solid understanding of data modeling (Star/Snowflake schemas), data warehousing concepts, workflows, and metadata management.

- Experience working with structured, semi structured (JSON, Parquet), and unstructured data.

- Strong knowledge of Agile methodologies, version control (Git), and CI/CD practices, Azure DevOps.

- Excellent analytical and problem-solving skills, with the ability to work in highly collaborative and fast paced environments.

- Experience with data testing, understanding requirements, working with product owner.

- Good to have:

o Understanding of AI/ML and Generative AI concepts, including data preparation for AI use cases.

o Exposure to Snowflake Cortex AI, Azure OpenAI, Document Intelligence, or AI-powered document extraction solutions.

Providence’s vision to create ‘Health for a Better World’ aids us to provide a fair and equitable workplace for all in our employment, whether temporary, part-time or full time, and to promote individuality and diversity of thought and background, and acknowledge its role in the organization’s success. This makes us committed towards equal employment opportunities, regardless of race, religion or belief, color, ancestry, disability, marital status, gender, sexual orientation, age, nationality, ethnic origin, pregnancy, or related needs, mental or sensory disability, HIV Status, or any other category protected by applicable law. In furtherance to our mission in building a more inclusive and equitable environment, we shall, from time to time, undertake programs to assist, uplift and empower underrepresented groups including but not limited to Women, PWD (Persons with Disabilities), LGTBQ+ (Lesbian, Gay, Transgender, Bisexual or Queer), Veterans and others. We strive to address all forms of discrimination or harassment and provide a safe and confidential process to report any misconduct.

Contact our Integrity hotline also, read our Code of Conduct.