Connecting...

Big Data Solution Engineer (Linux)

Big Data Solution Engineer (Linux)

  • Location

    Munich, Bayern

  • Sector:

    Insurance

  • Job type:

    Permanent

  • Salary:

    £75000 - £92000.00 per annum + Benefits Package

  • Contact:

    Simon Lee

  • Contact email:

    slee@venquis.com

  • Salary high:

    92000

  • Salary low:

    75000

  • Job ref:

    BBBH14155_1594391877

  • Published:

    seit 3 Monaten

  • Expiry date:

    2020-08-09

  • Startdate:

    ASAP

  • Consultant:

    #

We are looking for a Big Data Solution Engineer who will be tasked with the following responsibilities:

  • Rollout a Global Data Platform to customers and support the adaption of the technical services and the data capabilities
  • Design the solutions of the complete use-case pipelines, from data ingestion to data processing, software deployment and feedback loop
  • Understand and explain advantages and disadvantages of the proposed solutions to internal and external stakeholders
  • Build and maintain data driven applications on top of GDP
  • Define and apply best practices based on the platform
  • Contribute to improve the GDP stack and define the final production environment
  • Keep up with trends and evolving technology in the big data and analytics world
  • Look for opportunities to improve performance, reliability and automation
  • Write technical documentation, announcements, and blog posts

Technical Skills

The platform is a diverse product consisting of several technologies. This characteristic should be reflected the cross functional team of individuals who have a deep understanding of their technical specialty and at the same time are able to work outside of their core area. The company encourage to contribute your individual strengths and personality to the team and give you the room to develop some new skills and experiences. The following technical skills are required for this particular position:

Data Engineering (using the tools to build data-driven solutions)

  • Competence in running big data workloads in production at scale
  • Data Engineering Pattern (Ingestion, Transformation, Storage, Consumption etc.)
  • Event-based systems (deep knowledge on the Kafka confluent stack)
  • Databases (e.g. PostgreSQL, Neo4J, Stardog)
  • Cloud Storage (Azure Datalake or AWS S3 with EMR)
  • Distributed systems (e.g. Spark)
  • Knowledge Graph (e.g. Stardog)

Software Development

  • Proficiency in at least one programming language (have components written in Angular, Coljure, Python, Scala, Elm etc.)
  • Software engineering (micro services, design patterns, version control, automated testing, concurrent programming etc.)
  • Continuous integration, deployment, and delivery

General IT Skills

  • Advanced Experience with Linux
  • Containerization / Container Orchestration (Docker & Kubernetes)
  • General understanding of Infrastructure, Orchestration and IT Security Principles (especially on an enterprise level)

Other Skills

  • Bachelor (BSc), Master (MSc) or equivalent experience in a technical field (for example, Computer Science, Engineering...)
  • DevOps mindset (you build it, you run it; taking responsibility for your work)
  • Willingness and ability to learn new technologies and tools
  • Team player open to work in an agile environment
  • Fluent English (written and spoken) is a must, other languages (e.g. German, French, Italian, etc.) are a plus
  • Capability of result oriented communication with people from different departments with different skill sets