Senior Data Engineer
We are looking for a Senior Data Engineer that is passionate about building large-scale data processing systems and motivated to make an impact in creating a robust and scalable data platform used by every team, come join us.
What You'll Be Doing;
Designing and Building large scale data collection and processing infrastructure in production
Designing, implementing, and debugging distributed systems
Working on data enrichment in collaboration with our data science team to extract meaningful signals from the data
Streaming and batch computation and training ML models
Keeping up-to-date with the latest developments in the field
Keys For Success;
+3 years of Experience with programming in Python
+3 years of Experience with Java/Spark/Scala.
Distributed Queues like celery, RabbitMQ, SQS
Protobuf or Parquet
Kafka or Kinesis
Workflow management (Airflow, or similar)
Experience working in AWS (S3)
Every role in the library, ranked against your CV.
Rewritten from your real, matching experience for the job you pick.
Your whole pipeline in one place, with a fresh move every morning.