Senior Data Engineer

  • 38975
  • Non-Life - Data Science
  • |
  • British Columbia, Canada
  • |
  • Jan 26, 2021
  • Working in collaboration with customers across the organization (Claims, Insurance, Finance etc.) to plan, scope, execute and sustain data-based solutions
  • Responding to internal and external ad hoc requests, review and clarify data requirements, ensuring report content is
  • acceptable within policy and privacy protocols
  • Providing subject matter expertise within the department and to clients on data sources, reporting workflows, business process, and the appropriate tools with which to analyze their data
  • Participating with corporate data user teams, developing data validation and test plans, performing user acceptance testing, and providing feedback to development and sustainment teams
  • Conducting analysis for moderate to complex requests, defining data fields and determining data availability, developing information layout, format and interactivity. Presenting findings and providing clarification
  • Leading a team of Data Engineers.
  • Advanced skill in programming languages such as Scala or Java
  • Working experience with Big Data platforms, ideally with exposure to Hadoop ecosystem (HDFS, Hive, SPARK, NoSQL,YARN)
  • Strong SQL and analytic skills with large datasets
  • Hands-on experience with structured and unstructured databases
  • Demonstrated ability to work with large and complex datasets, while managing priorities and responding to time pressures
  • Excellent interpersonal, verbal and written communication skills to work with Managers, Directors & Executive level
  • stakeholders
  • Detail-oriented with demonstrated ability to meet deadlines, manage multiple priorities and work effectively under pressure
  • Strong understanding of data quality process, data analysis and data profiling
  • Ability to apply critical thinking skills to troubleshoot and perform root cause analysis on technical problems and solution design
  • Providing technical advice and guidance to staff in resolving complex querying or data integration issues
  • Experience with performance tuning and code optimization
  • Design, develop and enforce best practices and standards around data quality and querying
  • Ability to work effectively with a team or independently, as well as lead small teams as needed
  • Understanding of Agile Methodologies
  • Experience with DevOps and visualization tools, such as Tableau would be an asset.