Senior Data Engineer

  • 38318
  • Non-Life - Data Science
  • |
  • Ontario, Canada
  • |
  • Oct 5, 2020
Insurance
RESPONSIBILITIES
  • Design, develop, and document new data solutions, including data pipelines and data storage systems.
  • Collect and analyze requirements to help inform development activities and objectives.
  • Identify new opportunities for data acquisition and help with utilization of new data assets.
  • Maintain and improve existing data solutions on an ongoing basis.
  • Mentor and assist team members with solution implementation and technology adoption.
QUALIFICATIONS
  • Undergraduate degree in a technical field such as Computer Science, Software Engineering, etc.
  • Proficiency with and in-depth understanding of development best practices in Python and SQL
  • Extensive experience developing Object Oriented and Functional programs, applications, and APIs.
  • Extensive knowledge and experience with data pipeline development using PySpark preferably within Databricks.
  • Experience working with and analyzing structured, semi-structured, and unstructured datasets, and identification and extraction of key metrics from large and disparate data sources.
  • Experience modelling data storage systems using modern approaches and best practices.
  • Experience with the Azure platform, including core data services such as Data Factory, Event Hubs, Databricks, Azure Synapse, Kubernetes, etc.
  • Nice to Have:
  • Graduate degree in a technical field with specialization in Analytics, Data Science, or a related subject.
  • Azure certification.