ExperienceFlow.ai Logo ExperienceFlow.ai
⏩ ExperienceFlow.ai Logo
@

Senior Data Lake Engineer

πŸ’° $70,000 - $100,000 πŸ“… 11/30/2023

Apply

Job Description

Job Description
Do you love to program? Are you excited about new technology experimentation?
Are you looking for a new challenge that stretches your talents? Then this
could be the role for you.
At ExperienceFlow.ai, we are looking for a Big Data Developer that loves
solving complex problems across a full spectrum of technologies. You will help
ensure our technological infrastructure operates seamlessly in support of our
business objectives.
Objectives of this Role
β€’ Develop and implement data pipelines that extracts, transforms and loads
data into an information product that helps to inform the organization in
reaching strategic goals
β€’ Work on ingesting, storing, processing and analyzing large data sets
β€’ Create scalable and high-performance web services for tracking data
β€’ Translate complex technical and functional requirements into detailed
designs
β€’ Investigate and analyze alternative solutions to data storing, processing
etc. to ensure most streamlined approaches are implemented
β€’ Serve as a mentor to junior staff by conducting technical training sessions
and reviewing project outputs
Daily and Monthly Responsibilities
β€’ Develop and maintain data pipelines implementing ETL processes
β€’ Take responsibility for Hadoop development and implementation
β€’ Work closely with a data science team implementing data analytic pipelines
β€’ Help define data governance policies and support data versioning processes
β€’ Maintain security and data privacy working closely with Data Protection
Officer internally
β€’ Analyze a vast number of data stores and uncover insights
Skills and Qualifications
β€’ Experience in Python, Spark and Hive
β€’ Understanding of data warehousing and data modeling techniques
β€’ Knowledge of industry-wide analytical and visualization tools (Tableau and
R)
β€’ Strong data engineering skills on the Azure Cloud Platform is essential
β€’ Streaming frameworks like Kafka
β€’ Knowledge of core Java, Linux, SQL, and any scripting language
β€’ Good interpersonal skills and positive attitude
Preferred Qualifications
β€’ Degree in computer sciences, maths or engineering
β€’ Expertise in ETL methodology of Data Extraction, Transformation and Load
processing in corporate wide ETL solution design using Data Stage

ExperienceFlow.ai focuses on Enterprise Software, Artificial Intelligence,
Artificial Intelligence / Machine Learning, and B2B Β· SaaS Β· Mobile Β·
Artificial Intelligence / Machine Learning. Their company has offices in San
Francisco, Boston, India, and Ukraine. They have a small team that's between
11-50 employees.

You can view their website at <https://www.experienceflow.ai>