Azure Data Engineer Job at mavinsys, Louisville, KY

RWx3b0M5RW9zTzBwbFpWRUY3Uks3OTV3a1E9PQ==
  • mavinsys
  • Louisville, KY

Job Description

Healthcare is Must
PBM experience is desired
Skills must have: Azure SynapseDatabricks SnowFlake Python PySpark(ETL)


Job Title: Azure Data Engineer
Job Details:
Considering Python as the ETL tool for reading data from the source handling datatype and data transformations managing error handling logging and loading data into Databricksmanaged Delta tables the candidate should have strong expertise in Python along with solid knowledge of Databricks and PySpark enabling them to evaluate and perform data transformations within Databricks. They should be proficient in all aspects of Python including classes objects methods dictionaries loops Wheel files and packages and should be able to connect to various data sources including databases and streaming data
Expertise in Azure services such as Azure SQL Database Azure Data Factory Azure Synapse Analytics and Azure Data Lake is also required.
The ideal candidate has extensive experience in data engineering working with largescale data infrastructures and optimizing ETL processes
Expertise in Azure services such as Azure SQL Database Azure Data Factory Azure Synapse Analytics and Azure Data Lake
At least 6 years of experience in data engineering with a focus on building data pipelines
Proven experience with Spark Scala and other related technologies
Familiarity with Could Warehouses data lakes storage formats.
Strong knowledge of data modeling and ETL processes
Experience leading data engineering projects.
Proven experience with Databricks and Apache Spark
Strong proficiency in Python
Experience in Unix shell scripting and scheduling tools

Python

Job Tags

Similar Jobs

Sargent & Lundy

Project Manager -- Clean Energy Consultant Job at Sargent & Lundy

 ...Description This position is based on a hybrid work schedule and will require in-office work 3 days per week. Sargent & Lundy...  ...plus Sargent & Lundy is an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for... 

Louie Louie

Barback Job at Louie Louie

 ...BARBACK POSITION AT LOUIE LOUIE A PART OF FEARLESS RESTAURANTS What makes Fearless Restaurants special and a great place to work?! Cuz we give a damn! We are part of Fearless Restaurant Group; a multi-concept group of 11 independent restaurants based in Philadelphia... 

University of California Davis Health System

Medical Interpreter (Vietnamese) Per Diem | University of California Davis Health System Job at University of California Davis Health System

 ...Medical Interpreter (Vietnamese) Per Diem Job Summary This position provides oral interpreting services for non-English speaking and limited English-speaking patients of the University of the California, Davis Health. Apply By November 20, 2024 Minimum Qualifications... 

Crime Scene Resources, Inc

Forensic Technician II - DNA Job at Crime Scene Resources, Inc

 ...supervision of a qualified analyst, perform analytical techniques on forensic samples to assist with casework analysis. Provide expert...  ...have good communication skills. Basic working knowledge of computers and commonly utilized programs. Must be able to obtain... 

Department of Transportation

Associate Government Program Analyst/ Staff Services Analyst Job at Department of Transportation

Job Description and Duties Will Consider Staff Services Analyst. Under the general supervision of the Manager of Employee Services a Staff Services Manager I, the incumbent serves as the Employee Engagement Administrator for District 4. In this role, the incumbent...