##### Job Description :
** Data Engineer (Python/Databricks)**
_Direct Hire 1099 or W2 only._
_The client is not offering VISA sponsorship or subcontracting for this
position._
_Position is Hybrid : 2 days WFH and 3 days in office_
__
Our client needs highly enthusiastic Python/Databricks engineers to create,
tune, maintain and build reporting for the Big Data platforms that drive their
retail business. This role is key to the company's continued market dominance
and requires people that are passionate about data and seeking perfection in
their development.
Requirements:
**KEY DUTIES AND RESPONSIBILITIES:**
*
Performing systems integration design and development in cloud architecture
design (Azure)
* Building sizing and cost models for Cloud Services (Azure)
* Review enhancement requests and recommend the best solution to stakeholders as SME.
* Containerizing ingestion processes using docker and Kubernetes services.
* Understand business requirements to design, build, develop and test data integration pipelines.
* Plan, and direct DevOps implementation and system hardware/software updates for better performance, and stability.
* Work on the BI dashboards to support retail stores and the Azure AI platform that runs the personalized consumer experiences used by millions each day.
**EDUCATION AND EXPERIENCE:**
**EDUCATION: **Bachelors/4 Yr Degree
**YEARS OF RELEVANT WORK EXPERIENCE: **5+ years
**YEARS OF MANAGEMENT EXPERIENCE: **NA
**SPECIFIC KNOWLEDGE AND SKILLS:**
*
3+ years or demonstrated mastery of development with programming languages -
Python, SQL, Unix.
* 2+ years experience with Apache Spark and Databricks cloud tool sets (AWS or Azure).
* 1+ years experience with GCP/Azure Cloud Big Data tools (PowerBI/DataLake/ Azure Databricks).
* Self-motivated with excellent analytical, problem-solving, verbal and communication skills.
* Proficiency in API security frameworks, token management and UAC including OAuth, JWT, etc.
* BIG Data Engineer - Python, SQL, Spark , Cloud skill set are mandatory
* Basic knowledge of using DevOps, Github, and JIRA tools and the ability to work in agile environment.
* Bachelor's degree - Computer Science or equivalent.
