Lilly MD IDS - Data Engineer (InfoHub) in Bengaluru, India
At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our 35,000 employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities through philanthropy and volunteerism. We give our best effort to our work, and we put people first. We’re looking for people who are determined to make life better for people around the world.
At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our 39,000 employees work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities through philanthropy and volunteerism. We give our best effort to our work, and we put people first. We’re looking for people who are determined to make life better for people around the globe.
Medicines Development serves a strategic function within Lilly Research Laboratories (LRL). Development of most medicines requires about a billion dollars and a decade or more to bring to market. At Lilly, we’re investing to make it faster, better and cheaper, to the benefit of patients... and the Information and Digital Solutions organization is a critical partner in reaching success. Broad trends in science and healthcare are driving integration across Medicines Development, Research, Manufacturing, and global Business Units. New digital capabilities in the broader business model, both internally and externally, will require agile and creative evolution of the processes and digital solutions that support clinical and product development.
Data engineers are responsible for ensuring the availability and quality of data needed for analysis and business transactions. This includes data integration, acquisition, cleansing, harmonization and transforming raw data into curated datasets for data science, data discovery, and BI/analytics. Responsible for developing, constructing, testing and maintaining data sets and scalable data processing systems.
Data engineers work closest with Data Architects and Data Scientists. They also work with business and IT groups beyond the data sphere, understanding the enterprise infrastructure and the many source systems. Input is raw datasets. Output is analytics-ready, integrated/curated datasets.
Key capabilities in this role family include:
Data Acquisition - is the process of gathering and storing data in a location and format that it can be consumed for data preparation and/or downstream business uses.
Data Preparation - is an iterative process for exploring, integrating, cleaning, validating and transforming raw data into curated datasets
Data Publishing - is the act of releasing data in consumable form for (re)use by others.
Note: All data engineer roles should have a foundational set of knowledge in: communication, leadership, teamwork, problem solving skills, solution / blueprint definition, business acumen, architectural processes (e.g. blueprinting, reference architecture, governance, etc.), technical standards, project delivery, and industry knowledge.
Bachelor’s degree in computer science, information technology, management information systems or equivalent work experience.
4+ years of hands on application development experience in one or more programming languages like Python
2+ years of hands on development experience with Big Data technologies, particularly Spark, Pyspark in Glue/EMR.
2+ years of hands on experience in development and deployment of cloud native solutions leveraging AWS Services: Compute(EC2, Lambda), Storage (S3), Database (RDS, Aurora, Postgres, DynamoDB), Orchestration (Apache Airflow, Step Function, SNS), ETL/Analytics(Glue, EMR, Athena, Redshift), Infra (Cloud Formation, Code Pipeline), Data Migration (AWS DataSync, AWS DMS), APIGateway, IAM etc.
Expertise in the handling large data sets and data models in terms of design, data model creation, development of data pipeline for data ingestion, migration and transformation
Strong on SQL Server, stored procedure
Expertise with analytics and business intelligence tools and solutions (e.g. Trifacta, TAMR, QuickSight)
Knowledge of code versioning tools like Github, SVN, Bitbucket
Experience working in regulated environments and with internal systems quality policies and procedures
Experience in working in Scrum - agile methodologies, coding standards, code reviews, source management, build processes (CI/CD Pipeline).
Knowledge of the data architectures associated with information integration, data visualization, & data warehousing
Experience in development and deployment on cloud infrastructure
Pharmaceutical or healthcare industry experience
Defining best practices and developing technical standards, design principals, best practices, and frameworks
Technical curiosity and desire to innovate
Business Analysis and Technical Leadership
Engages with business and proactively seeks opportunities to deliver business value.
Understands business requirements and effectively translates business needs and process into technical terms, and vice versa
Elicits and defines requirements
Ensures appropriate business roles are engaged in solution execution.
Participates in design reviews to ensure traceability of requirements.
Networks with appropriate IT colleagues to determine solutions to meet business partners’ needs.
Seeks opportunities to reuse existing processes and services to streamline support and implementation of key systems.
Stay abreast of tools and technologies to influence IT strategy so that it provides best usage opportunities for business
Partner with and influence vendor resources on solution development to ensure understanding of data and technical direction for solutions as well as delivery
Ability to adapt quickly in a constantly changing environment
Knowledge of Clinical Domain or Clinical Experience is highly desired
Eli Lilly and Company, Lilly USA, LLC and our wholly owned subsidiaries (collectively “Lilly”) are committed to help individuals with disabilities to participate in the workforce and ensure equal opportunity to compete for jobs. If you require an accommodation to submit a resume for positions at Lilly, please email Lilly Human Resources ( LillyRecruitingCompliance@lists.lilly.com ) for further assistance. Please note This email address is intended for use only to request an accommodation as part of the application process. Any other correspondence will not receive a response.
Lilly does not discriminate on the basis of age, race, color, religion, gender, sexual orientation, gender identity, gender expression, national origin, protected veteran status, disability or any other legally protected status.