**Job Description:**
As a Senior Data Engineer at Quarter Lab, you will be responsible for
designing, implementing, and maintaining robust data infrastructure solutions
and a complex ETL which drives our core business operations. You will work
closely with our team to ensure the efficient and effective processing of
large datasets. Your expertise in SQL and ETL processes will be crucial in
shaping our data strategy!
**Key Responsibilities:**
* **Database Design and Implementation** : Architect scalable and high-performance data solutions to process millions of rows of data.
* **ETL Development** : Design, implement, and manage ETL pipelines to support data integration and transformation processes.
* **Data Modeling** : Develop and maintain complex data models and database schemas to support various business needs.
* **Tool Integration** : Utilize tools like DBT and Prefect (or similar) to streamline data workflows and ensure data quality.
* **Collaboration** : Work closely with company stakeholders & engineers to understand data requirements, deliver solutions, and collaborate cross-functionally.
* **Documentation** : Document core data processes using industry standard best practices
* **Performance Tuning:** Optimize database performance and ensure efficient query execution.
**Requirements:**
* **Experience** : Minimum of 5 years of experience in data engineering or software engineering
* **SQL** : Mastery of SQL with a strong ability to write and optimize complex queries and stored procedures.
* **Python** : Strong programming skills using python or other OO programming language
* **DBT** : Hands-on experience with DBT (Data Build Tool) for data transformation and modeling.
* **ETL Skills** : Proven experience in designing and implementing robust ETL processes.
**Nice to Haves:**
* **Automated Testing** : Experience writing and devloping unit or E2E tests for data pipelines and/or python backends
* **Prefect** : Experience building data pipelines with Prefect, or other similar ETL tools
* **DevOps Experience** : Familiarity with DevOps practices and tools to manage and deploy data solutions.
* **Web Development** : General familiarity with PHP / Javascript / HTML / CSS
