##### Job Description :
_Publisher Discovery_ **** is hiring a remote back-end engineer to help build,
run and evolve the back-end, pipelines and platform that underpin our business
insights technology.
We make it easier for online advertisers to identify where best to associate
ads across affiliate networks. We collate 'big data' from a wide variety of
resources and APIs. We then process and transform this data to power ML models
and present it to our customers, either through our UI or directly transferred
to them. This cost-saving and advertising effectiveness solution is especially
relevant during a toughening economic climate.
We offer a role that's diverse in the nature and scope of challenge, and we
can find initiatives that suit your current skills and ambitions, and help you
grow.
You'll work closely with our CTO and engineers, getting involved with
everything from our product, APIs, automation, methods and tooling, and the
production environment. The role will be approximately equal parts green field
development and enhancing our existing codebase and infrastructure - working
mainly with Python and Node.js. We have a compact dev team and run a
lightweight Kanban process, we release early and often.
We offer a collaborative and friendly culture, with a flat structure. We can
offer technical mentoring, pairing and guidance while you progress into
delivering on more challenging objectives. You'll also have lots of autonomy,
with plenty of time for research, to try things out and to complete projects.
You'll find us open minded and supportive of your development and ideas.
##### **What we're working on:**
Migrating manual data pipelines to become fully automated, towards CI/CD
Updating the data scraping methods that collect data - it's an arms race!
Configuring and adding new affiliate networks to our system, with Python
Modernising deployment infrastructure, e.g. with Airflow/Kubeflow Evolving
pipeline orchestration methods Maintaining the pipelines that manifest ML
Modifying and extending APIs and creating new product back-end capabilities
with Python Supporting medium term project to adopt and build out MLOps
Production ops - observability, security, maintenance etc.
##### **Current ecosystem - we'll help you get up to speed:**
Microservices | Python, asyncio | Kubernetes | Google ML tools, Tensorflow |
big data | Elasticsearch, moving to Google Cloud SQL (Postgres), Google
BigQuery | Linux | Node.js | Apache Arrow | batch and stream processing | and
more!
