Job Description
Role: Azure Databricks Engineer
Location: Louisville, KY (Day 1 Onsite)
Job Description:
Azure Databricks
Role : Data Engineer (Sr)
The Senior Data Engineer will be responsible for the build of Enterprise Data platform.
Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and business-specific processing of healthcare data.
Build Azure Data Lake leveraging Databricks technology to consolidate all data across the company and serve the data to various products and services.
The scope of this role will include working with engineering, product management, program management and operations teams in delivering pipeline platform, foundational and application-specific pipelines and building the Data Lake in collaboration with business and other teams.
Responsibilities
Design, Develop, Operate and drive scalable and resilient data platform to address the business requirements
Drive technology and business transformation through the creation of the Azure Data Lake
Ensure industry best practices around data pipelines, metadata management, data quality, data governance and data privacy
Partner with Product Management and Business leaders to drive Agile delivery of both existing and new offerings; assist with the Leadership and collaboration with engineering organizations within Change to manage and optimize the portfolio
Required Skills
10+ years working experience in Data processing / ETL / Big data technologies like Informatica, Hadoop, Cloudera
4+ years working experience in Databricks (essential) and Python
Experience with Cloud / Azure architectural components
Experience building data pipelines and infrastructure
Deep understanding of Data warehousing concepts, reporting and Analytical concepts
Experience with Big Data tech stack, including Spark, Scala, and SQL
Bachelor's degree in Mathematics, Physical Sciences, Engineering or Computer Science
...Epic Travel Staffing is hiring aTravel - Pediatric OT - Outpatient Shift: Variable/ 8x5, 40hrs/week,No weekends. No holidays. No call. Length: 13 Weeks Requirements:~ ND license ~1-2 years of experience in the pediatric setting ~ Must beWilling to work...
...Responsible for the coordination, and implementation of Retail Pharmacy Services at assigned locations. Ensure that all local, state... ...pharmaceutical protocols. Facilitates the development and ongoing management of systems that promote desirable patient outcomes using safe,...
...innovator offering end-to-end solutions to customers at every step in their energy journey. Industry leaders including Amazon, American Airlines, Borealis and IAG are customers of Infinium. Learn more at Position Summary Infinium is seeking to fill a position at...
...Sodexo - 2951 MAPLE AVENUE [Valet Parking Attendant] As a Valet at Sodexo, you'll: Understand and follow all policies and procedures; Perform valet duties and park vehicles in open spots; Collect tickets from patrons and park or retrieve vehicles; Manipulate vehicles carefully...
...Responsibilities Patient Transporters Del Amo Behavioral Health System, a subsidiary of UHS , offers a safe and compassionate environment for individuals looking for hope and healing from emotional, psychiatric and addiction issues. Del Amo Behavioral Health...