We are looking for a Data Engineer to help build our data infrastructure.
We are seeking a junior to mid-level Data Engineer to join our dynamic data
engineering team. This role involves building and optimizing ETL workflows,
rewriting data science notebooks for production environments, and repricing
parcel carrier data according to various discount terms. The successful
candidate will be immediately involved in feature development for our core
product, handling EDI and CSV formatted data across different parcel shipping
schemas.
This person should be familiar with PySpark, Python, and Databricks in the AWS
ecosystem. Experience working with SQL (e.g. PostgreSQL) is also preferred.
This role is fairly autonomous. A successful applicant should be comfortable
using their skill, intuition, and creativity to accomplish a task without
detailed direction on how it should be accomplished. While the ideal candidate
should be capable and independent, they will be part of a supportive and
friendly team dedicated to mutual success. This person should be comfortable
working in 2-week sprint cycles.
Minimum Requirements:
Bachelor’s degree in Computer Science or a related field, or equivalent
experience.
US citizenship or permanent residence
Key Responsibilities
* Develop and maintain efficient ETL workflows using Databricks within AWS.
* Optimize data science notebooks for a robust production environment.
* Implement repricing logic for parcel carrier data based on various discount agreements.
* Parse and process data in various formats, including EDI and CSV, across multiple shipping schemas.
* Collaborate actively in a team setting within 2-week sprint cycles, contributing to the team's success while working autonomously on assigned tasks.
Preferred if applicant is skilled in the following technologies
* Databricks
* PySpark
* SQL (Databricks SQL or Spark SQL preferred)
* Git
* Python
Bonus if familiar with
* EDI, CSV, and JSON data feeds
* Parcel shipping data
* Parcel audit
In recent years, we’ve pioneered first-in-industry shipping data analytics
software, so that our clients can understand the factors affecting their
shipping spend. No other company is helping businesses reduce shipping costs
with technology like Reveel. Candidly, the logic behind shipping costs is
insane and very hard to understand! We make that easy for our customers by
creating amazing software.
Since 2006, Reveel® has been dedicated to providing Shipping Intelligence® for
the smartest business decisions possible. Founded by former DHL sales
executives, Reveel was created to level the playing field. Over the past
decade-plus, our zero-risk services have saved our clients millions of
dollars.
Reveel focuses on Logistics, Logistics Company, Logistics Software, and
Logistics / Transportation / Shipping. Their company has offices in Irvine.
They have a small team that's between 11-50 employees.
You can view their website at <https://www.reveelgroup.com>
