Senior Data Engineering Lead

  • 34679
  • Non-Life - Data Science
  • |
  • Japan
  • |
  • Feb 4, 2019
  • |
  • Japanese
Insurance
RESPONSIBILITIES
  • Cooperate with Innovation Lead from data engineering perspective to achieve goals of projects.
  • Lead and support data engineers to fulfill technical requirements for projects.
  • Develop data science PoC model with Data Strategy Department and deploy it with appropriate technical architecture.
  • Analyze the requirements, design, implement, and manage the big data platform in on premise and cloud, while heeding data security and privacy concerns that could arise.
  • Support BAU works for data extraction to be provided to various parties based on the requirements from business users, while improving operational efficiency by implementing tools and applications
QUALIFICATIONS
  • Bachelor or higher degree in computer science or similar subjects
  • Team leading experience of 5-10 members
  • Possess excellent verbal and written communication skills.
  • Work creatively and analytically in a problem-solving environment.
  • Analyze business problems and technical environments and use this in designing the solution.
  • Be a supportive team leader capable of teaching members in hand-on manner.
  • 8+ years’ experience programming in Java, Python or C/C++ in production grade software development.
  • Experience with Hadoop stack.
  • Experience of designing and modelling SQL/NoSQL database for data lake, data warehousing, and BI systems.
  • Familiarity with tools in DevOps environment like Jenkins, GitHub, Ansible, Docker, Kubernetes etc.
  • Experience of implementing high performance, large scale distributed systems, preferably by utilizing cloud services such as AWS Kinesis, Lambda, EMR, ECS etc.
  • Experience with different development methodologies.
  • Dynamic and/or functional languages experience such as Scala and Ruby are desirable.
  • Machine learning engineering experience such as model management and model training.
  • Experience with data integration tools such as Talend, Informatica, Pentaho, etc.
  • Experience with BI tools such as Spotfire, Tableau, MicroStrategy, Power BI, Domo, QuickSight, etc.
  • Japanese.
  • English.