Scroll Capital Logo Scroll Capital
Scroll Capital Logo
@

Senior Data Engineer (Data Pipelines / 10+ years of experience)

💰 $50,000 - $90,000 📅 10/12/2023

Apply

Job Description

### Lead Data Engineer - Python Expert

$45k – $90k • 0.1% – 0.25%

### About Our Company

We are a VC backed Fintech Startup in the Bay Area.

### The Role

**Staff/Lead Software Engineer**

This is a core and very important role for the company. You’ll have a lot of
agency in architecting and implementing a corner store of modern financial
infrastructure.

You'll be enhancing and maintainging the data pipeline that powers the backend
of our company.

You'll be building a cutting edge fintech platform that helps SaaS companies
get funded.

### Qualifications

* 10+ years of experience with "Big data" data pipelines, architectures and data sets .
* Knowledge of ETL and ELT processes etc.
* 10+ years of Python expeirence. You should be an exper in python & pandas.
* You have experience in building pipelines. **Luigi** , **Python** , **Pandas** , Redshift, Airflow or any other pipeline building tools.
* Experience with big data tools: Hadoop, **Spark** , Kafka, Spark & Kafka Streaming, (Preferred)
* Advanced working SQL experience working with relational databases, query authoring (SQL) and working familiarity with a variety of databases
* Expert in **Docker** , **AWS Fargate** , **ECS** , **ELB** \- AWS Stack etc.
* Knowledge of Data Science (pandas, sci-kit learn)
* Experience with different databases: distributed DBs like Hadoop and Spark, relational DBs like PostgreSQL and mySQL, and NoSQL DBs such as MongoDB or Couchbase.
* You have built, deployed, owned and maintained production systems with real world workloads which includes database schema design, api design, deploying code, product design and building websites, backend processing systems and more.
* You have deployed production systems on AWS(preferred) or GCP
* Write clean, readable and testable code and refactor code as capabilities evolve.
* Can build and maintain end to end systems and put them into production on your own.

### Tech Stack

* Big Data - Python, Pandas, Luigi, Redshift, SQL, (Must Have Skills)
* Deployment - AWS Fargate, Docker.
* Experience interfacing via API and JSON with Ruby on Rails or Node.js
* Web development - Ruby on Rails or Node.js.
* Backend - Postgres or Mysql database, SQL, Sidekiq
* Data Science, ML - pytorch, (Highly preferred but not a requirement.)

### Why you should Join

You should join our company if the following sounds exciting:

* Well funded startup with 5+ years of runway.
* You want to build your skills to work towards becoming a technical lead who can own the architecture and implementation of the entire system.
* You want to take ownership for your work and have agency/voice in building systems.
* You are a self-starter - you set ambitious goals and timelines for yourself and follow through.

Scroll Capital focuses on Financial Services and Finance Technology. Their
company has offices in San Francisco. They have a small team that's between
1-10 employees.

You can view their website at <https://www.scrollcapital.com>