##### Job Description :
**Primary Purpose:**
Responsible for the blending different datasets by building automated
pipelines in AAH approved technologies. Applicant should be experienced data
pipeline builder and data wrangler who enjoys optimizing data systems and
building them from the ground up. Contributes to the Cloud-DevOps effort to
provide development and design support for data movement in AAH cloud
infrastructure. Data Engineer will be responsible for building data pipelines,
automation and designing tables and views for enterprise data warehouse
supported in AAH Platform.
**Major Responsibilities:**
Responsible for building repeatable framework to ingest data into Azure and
Snowflake.
Develop data transformation and movement pipelines using approved AAH
technology (using Python or GUI based ETL /ELT tools)
Design parameter driven orchestration to allow for change data capture and
monitoring using ETL/ELT tools
Assemble large, complex data sets that meet functional / non-functional
business requirements.
Drive technical design, application build, product configuration, unit
testing, and production deployment.
Build the infrastructure required for optimal extraction, transformation, and
loading of data from a wide variety of data sources using SQL, Python and
complementing technologies.
Build processes supporting data transformation, data structures, metadata,
dependency, and workload management.
Ensure delivered solutions are realized in time frame committed; work in
conjunction with project sponsors to size and manage scope and risk.
**Licensure, Registration and/or Certification Required:**
Must have experience in data transformation and data pipeline development
using Fivetran/HVR and DBT
**Education Required:**
Bachelor's Degree in Computer Science or related field.
**Experience Required:**
Typically requires 2 years of experience in at least two IT disciplines,
including database development, pipeline development, data engineering
**Knowledge, Skills & Abilities Required:**
Advanced working SQL knowledge and experience working with relational
databases, query authoring (SQL) as well as working familiarity with a variety
of databases.
Experience building and optimizing data pipelines, architectures, and data
sets.
Understanding of ADLS. Snowflake is preferred.
