Senior Data Engineer

  • 39055
  • Non-Life - Data Science
  • |
  • British Columbia, Canada
  • |
  • Feb 5, 2021
Insurance
RESPONSIBILITIES
  • Working in collaboration with customers across the organization to plan, scope, implement and sustain predictive analytics solutions
  • Acting as a Lead Data Engineer in machine learning projects
  • Perform ETL to build model features, develop systems to serve models in production
  • Collaborate with innovative teams to put machine learning functionalities into production systems
  • Architect, design and evaluate new approaches to deploy and sustain models in production
  • Own the development, optimizing and deployment of machine learning systems
  • Develop measurements and feedback systems
  • Leading the department in building and adhering to data engineering best practices
  • Conducting analysis for moderate to complex requests, defining data fields and determining data availability, developing information layout, format and interactivity. Presenting findings and providing clarification.
QUALIFICATIONS
  • Advanced skill in programming languages such as Scala or Java
  • Working experience with Big Data platforms, with exposure to Hadoop ecosystem (HDFS, Hive, Spark, Kafka)
  • Working experience in building and deploying machine learning models
  • Advanced working SQL knowledge and experience working with relational databases and SQL
  • Strong analytic skills related to working with unstructured datasets.
  • Demonstrated ability to work with large and complex datasets, while managing priorities and responding to time pressures
  • Detail-oriented with demonstrated ability to meet deadlines, manage multiple priorities and work effectively under pressure
  • Strong data quality management process understanding, data analysis and data profiling
  • Ability to apply critical thinking skills to troubleshoot and perform root cause analysis on technical problems and solution design
  • Providing technical advice and guidance to staff in resolving complex data ingestion and transformation issues
  • Experience with performance tuning and code optimization
  • Design, develop and enforce best practices and standards around data engineering
  • Ability to work effectively with a team or independently, as well as lead small teams as needed
  • Understanding of Agile Methodologies
  • Excellent interpersonal, verbal and written communication skills to work with Managers, Directors & Executive level
  • stakeholders
  • Experience with reporting and visualization tools, such as Tableau, user interface design, and iterative customer-driven design processes would be an asset.