Data Engineer

by | Dec 13, 2022 | Data, JOBS

$

Fully remote, UK, Germany, Netherlands, France, Belgium, Poland

$

Permanent

$

£70,000-£110,000

Our client empowers others to be at their best. As a business, their software product allows revenue teams to engage buyers through industry-leading training and coaching software as well as innovative sales content and engagement solutions. They provide sales and marketing with the software and support they need to enable their teams, drive more revenue and deliver incredible buying experiences.

Founded in 2011 in Belgium, our client is a team of more than 500 people working from their headquarters in Belgium and Chicago or regional offices in London, Munich, San Francisco and Wroclaw.

As an employer who understands the importance of diversity, we are committed to proudly representing the various identities of the communities in which we work and the clients that we serve. We have been recognized as a top workplace by Built In Chicago, Built In San Francisco and Inc. Magazine, as a top 10 software company in the Inc. 5000 Europe list and won the award for “Most Sustainable Growth Company” by Deloitte Belgium.

You will need to:

  • Architect, develop and maintain a data management and exploration platform to be used by data scientists and other engineers
  • Build out a robust infrastructure for dealing with large amounts of data
  • Work closely with data scientists and other engineers to design and maintain scalable data models and pipelines
  • Define ways to measure the quality and consistency of data
  • Define measures to keep up a high level of code quality
  • Be passionate about data and keeping it organised and accessible
  • Team up on projects and coach and learn good practices
  • Having regular scrums and focus meetings
  • Having lots of fun with your passionate engineers

To be successful in the role you will need to:

  • Proficiency in Big Data data integration technologies such as Spark, Kafka
  • Previous Cloud Solution experience, preferably AWS (S3, ECS/Fargate, EMR, Glue)
  • Proficiency with traditional database SQL technologies (Oracle, SQL Server, MySQL, PostgreSQL)
  • Experience with integration of data from multiple data sources
  • Writing high-performance, reliable and maintainable code
  • Analytical and problem solving skills, applied to Big Data domain
  • Experience of CI/CD best practice
  • Good aptitude in multi-threading and concurrency concepts
  • Experience with cloud deployment
  • Familiarity with the fundamentals of Linux scripting language

Desirable:

  • Previous proficiency with ETL technologies (e.g. Talend, Informatica, Abinitio)
  • API and library design skills
  • Previous exposure to Python and Cython
  • Exposure to building applications for a cloud environment
  • Knowledge of workflow/schedulers like Yarn &  Oozie/Airflow
  • Experience with NoSQL databases, such as HBase, Cassandra, MongoDB or DynamoDB
  • Experience with various messaging systems, such as Kafka or RabbitMQ
  • Experience with Business Intelligence tools such as Tableau, Qlik, PowerBI or QuickSight

Apply

Click or drag a file to this area to upload.