North Logo North
North Logo
@

Cloud DevOps Engineer (Data Engineering Focus)

💰 $200 - $110,000 📅 06/19/2024

Apply

Job Description

### Company Description

North is an AWS optimization platform that automates your cloud finance in 3
clicks, allowing you to save 50% on your cloud expenses while spending zero
time doing so.

### Summary:

We are looking for an experienced and motivated DevOps engineer with a focus
in Data Engineering to join us as we scale our AWS based infrastructure and
introduce exciting features for our current and future customers. You will be
working closely with the CTO and Engineering team on features that will
automate the future of cloud FinOps. This is a perfect opportunity to join an
early-stage VC funded and high growth start up in the FinTech space.

### Responsibilities:

**AWS Infrastructure Management:** Proactively maintain, monitor, and enhance
our application's serverless micro-service architecture on AWS to ensure
maximum reliability and performance. Employ best practices in infrastructure
as code (IaC) using Terraform, enabling scalable and manageable deployments.
Comfortable building and deploying Lambda, API GateWay, Step Functions,
DynamoDB, CloudWatch, IAM roles, S3, Athena, Glue, SSM, and others.

**Cost Optimization:** Vigilantly monitor AWS service costs and usage to
identify optimization opportunities. Develop and implement strategies to keep
operational costs at a minimum while maintaining service reliability and
performance standards.Our primary objective is to achieve rate optimization
for our clients, which necessitates implementing cost optimization strategies
internally before proposing them to our clients.

**Compliance and Security:** Spearhead initiatives to ensure and maintain SOC2
compliance across all aspects of our backend infrastructure. Craft and
maintain code that adheres to security best practices, with a strong emphasis
on limited permissions and robust authorization mechanisms to safeguard
against vulnerabilities. Strong understanding of OAuth and RBAC principals.

**Development and Maintenance:** Collaborate closely with the CTO and
development teams to devise and implement new features, as well as improve
existing functionalities. Take charge of diving into and refining existing
codebases for enhanced performance, maintainability, and scalability.

**Data Pipeline Management:** Design, code, and manage industry-standard data
pipelines, optimizing for efficiency and integration for machine learning
processes. Ensure data flow adheres to ACID principles and enhance data
processing capabilities to support predictive analytics and machine learning-
driven applications effectively.

**AWS Cost and Usage Analysis:** Possess a deep understanding of AWS service
costs, Savings Plans, Reserved Instances, usage patterns, and optimization
techniques. Regularly provide recommendations for cost-effective resource
utilization without compromising on performance or reliability.

**Technical Expertise:** Demonstrate advanced proficiency in Python, with the
ability to develop complex applications, scripts, and automation tools.
Utilize this expertise in API development, focusing on optimizing direct AWS
service integration, security, and authorization protocols.

**Infrastructure as Code (IaC):** Deploy and manage infrastructure using
Terraform, creating reusable modules that promote efficiency and consistency
across deployment processes. Embrace and advocate for IaC principles to
streamline infrastructure provisioning and management tasks.

**Independence:** Act as a self-starter with the capability to work
independently, requiring minimal guidance. Take ownership of product features
from conception to deployment, organizing timelines and resources effectively
to meet project milestones and objectives.

**Collaboration and Problem Solving:** Engage in productive collaboration with
the CTO and development teams to address, debug, and resolve backend-related
issues promptly. Exhibit strong problem-solving skills, with a focus on
delivering solutions that enhance system reliability and functionality.

### Requirements:

* Bachelor’s degree in Computer Science, Software Engineering, or a related field. This can be substituted for strong knowledge and experience on AWS and computer science fundamentals.
* AWS Associate Level Certification (Technical DevOps or Solution Architect preferred)
* Solid experience with AWS services and backend development (Lambda, API Gateway, DynamoDB, Glue, Athena, SQS, SNS)
* Proficient understanding of data engineering concepts (SQL, pySpark, Dataframes,numpy)
* Experience using and maintaining scalable infrastructure on Terraform
* Ability to diagnose and troubleshoot complex technical issues through CloudWatch and setting up solid unit testing.
* Strong knowledge of Git and code version control
* Strong coding skills in Python preferred, SQL optional.
* Effective verbal and written communication skills.

**Nice to have:**

* Experience working in a high paced start-up environment.
* Principles of code low latency.
* Understanding of AWS security principals
* Familiar with Agile methodologies, JIRA
* Familiarity with AWS FinOps and CUR concepts is a plus
* Front-end experience
* GCP experience

**Benefits:**
Remote friendly, work from anywhere policy. We keep a small office & home base
in NYC, and regularly meet for team dinners & events. We want you to do your
best work from wherever that happens to be! Unlimited PTO. Additional benefits
will be shared in-person.