Data Engineer -Databricks

Data Engineer -1

Primary Skill Set

• 4-6 years of experience as a Spark & Python developer.
• Experience in Azure components like Azure Data Bricks, ADLS Storage, Key Vault, and cosmos db.
• Able to understand Optimizations on Spark, and SQL
• Create and Manage API deployed in Azure.
• Work experience as a Python Developer and Expertise in at least one popular Python framework (like Django, Flask, or Pyramid)
• Writing scalable code using Python programming language.
• A deep understanding and multi-process architecture and the threading limitations of Python
• Experience with Active Directory Authentication Excellent analytical problem solving and debugging skills Familiar with Visual Studio Code
• Familiarity with testing tools.(Unit, Functional and Load testing)
• Ability to collaborate on projects and work independently when required.
• Good to have delta lake and unity catalog knowledge.
• Azure Git working experience.

Secondary Skill Set

• Good understanding over Azure Devops and should be able to understand Azure Arm template script and make changes whenever it’s required.
• Understand APIM or Gateway and should be able to deploy applications.
• Work experience with pandas
• API debugging skills