Strength Through Diversity
Ground breaking science. Advancing medicine. Healing made personal.
The Data Warehouse ETL Developer designs, tests, implements, maintains, and controls the ETL process for the Mount Sinai Data Warehouse, with the overarching goal of accelerating translational research and improving clinical care.
The incumbent will develop and transform databases and data marts across multiple platforms, technologies (e.g., Relational, Columnar) and computing environments (e.g., host based, distributed systems, cloud) for Sinai-specific and NIH-funded national resources and projects. The incumbent will design, develop, and manage these resources in a high performance computing and data warehousing environment, utilizing a thorough understanding of available technology, tools, and best practices. Specific responsibilities are listed below:
- Designs, tests, implements, maintains, and controls data pipelines and ETL jobs for integrating data into the Epic Caboodle data warehouse, and transforming data from Epic Caboodle into an Observational Medical Outcomes Partnership (OMOP) common data model database for medical research.
- Designs, tests, implements, maintains, and controls Mount Sinai’s research-oriented Data Warehouse, Data Marts, and other associated Research Databases for researchers and clinicians for grant-funded projects. This work supports major national and regional projects and data sharing initiatives such as the NIEHS-funded national Human Health Exposure Analysis Resource (HHEAR) and the data submissions and study support for the INSIGHT Clinical Research Network.
- Works closely with technical management and researcher-clients to design and implement databases and database support tools in support of complex business application development requirements and processes (e.g., diverse development platforms, technological environments, software, hardware, tools, etc.).
- Approaches all relationships with a world-class customer service approach. Maintains a customer-focused approach with users to provide solutions that are science/research-driven.
- Supports, designs, and manages upgrades to Sinai-developed software that interacts with these databases, such as the Cohort Query Tool.
- Monitors transaction activities and assists in the utilization of databases. ETL maintenance and job monitoring is required. On-call support is sometimes required.
- Responsible for the integrity and security of data in Data Warehouses and Data Marts.
- Conduct code walkthroughs, peer reviews, and produce technical documentation.
- Work effectively with other IT professionals throughout Mount Sinai.
- Maintain the confidentiality, privacy, and integrity of all healthcare data. Comply with all applicable laws, policies, and procedures, including those of the Institutional Review Board (IRB), HIPAA and New York State laws, and IT Security.
- Assists in the development of standards and procedures affecting database management, design, and maintenance.
- Establishes and maintains databases for user tests and production purposes.
- Performance tuning of database objects, stored procedures, ETL jobs, and related scripts.
- Trains user groups on procedures and standards.
- Must have flexibility to learn and embrace a dynamic environment, which could include other database and pipeline technologies (e.g. Oracle, PostgreSQL, MongoDB, SQL Server, various ETL tools such as SSIS and SAP BODS, Kafka, cloud database services, etc.) and other coding/scripting languages.
- May act as a project leader.
- Performs related duties as assigned or requested.
- Bachelor degree in Computer Science or a related discipline, or equivalent experience; Advanced degree preferred.
- Five years minimum experience in the design and administration of relational databases and ETL processes in diverse technological environments.
- Knowledge of ETL development best practices is required, including explicit source-to-target mappings; pattern-based and parameter-driven development; and rigorous version control using Git, Microsoft Team Foundation Server (TFS), or equivalent.
- Strong ETL development experience is required. Development with Microsoft SSIS, Visual Studio, and SQL Server Data Tools is strongly preferred. Prior experience with other ETL tools, especially SAP Business Objects Data Services (BODS), is a plus.
- Database Administration experience is required: database design and configuration; DDL and DML performance tuning using indexes, partitioning, materialized views, and other methods for improving query performance.
- Strong SQL development skills are required: stored procedures, functions, triggers, sequences, queries with advanced SQL. Microsoft T-SQL experience is required; hands-on experience with Oracle PL/SQL and/or PostgreSQL PL/pgSQL is a strong plus.
- Experience with Software Development Life Cycle (SDLC) best practices is required. Experience with Agile developments methods (Scrum, Kanban) and tools (e.g., Atlassian JIRA) is a strong plus.
- Strong knowledge of relational and dimensional data modeling principles and best practices.
- Experience working with healthcare data (electronic health records, medical and pharmacy claims, healthcare cost accounting systems) is strongly preferred. Experience with Epic Systems Corporation’s Clarity and Caboodle reporting databases is strongly preferred.
- Excellent critical thinking, problem-solving, multi-tasking, and collaboration skills.
- Fast learner with the ability to work independently and in a team environment.
- Strong consultative customer service and communication skills (verbal and written) to effectively interact with researchers, clinicians, hospital administrators, and other IT personnel.
- Experience with HL7 messages and interfaces (e.g., Iguana, Cloverleaf) is a plusScripting experience (PowerShell, Python, PERL, or similar) is a plus.
- Microsoft SQL Server Reporting Services (SSRS), Power BI, and/or Tableau is a plus.