Senior Data Engineer

Description:

We are currently looking for a Senior Data Engineer with a passion for turning disparate streams of data into organized and actionable analytics services and insights. As a Data Engineer on the Enablement & Governance Analytics team, you will be joining a group of hardworking and savvy innovators who has made it their mission to find new ways to glean value out of rapidly increasing volumes of operational data in Canadian Operations.

Working within a diverse and motivated team of analytics professionals, the Data Engineer will lead the development of efficient data capture and transformation processes and complex data models that form the core of a new generation of analytics services and self-serve solutions for our customers in Canadian Operations.

What will you do?

• Lead development of new batch/low-latency analytical solutions that leverages both traditional and emerging technologies

• Design, develop and implement highly scalable data capture and transformation processes

• Create effective ETLs/ELTs to move large volumes of data from various operational systems to dimensional data models for analytics consumption

• Act as principal designer and reviewer for new data models, make data architectural decision, and provide coaching on data modeling and process design

• Expand and grow data existing platform capabilities to solve new data problems and challenges

• Ensure all automated processes preserve data integrity by managing the alignment of data availability and integration processes

• Support quantitative analysts and data scientists with data discovery and rapid assembly of large data sets from disparate sources

• Identify opportunities for new data acquisition and new uses for existing data resources

• Research and make recommendations for new data management technologies and software engineering practices. Collaborate on decisions around the use of new tools and practices

• Perform quality assurance and testing according to risk assessment guidelines to minimize operational, reputation, and legal risk.

• Define data retention policy, establish data governance best practice, and create automated anomaly detection services

• Document and update business continuity and disaster recovery procedures.

• Engage in ongoing collaboration with data architects, modellers and other members to achieve common goals.

• Provide guidance to development teams regarding best practices and design patterns for analytics solutions. Coach and provide guidance to junior team members

• Produce and maintain support documentation for ongoing operations.

• Act as Tier-2/3 support to troubleshoot and resolve technical issues with production data models and services

What do you need to succeed?

• University degree in Computer Science, Software Engineering, or equivalent.

• Experience with hybrid data environments that leverage both distributed and relational database technologies to support analytics services

• Solid understanding of data warehousing principles, architecture and its implementation in complex environments.

• 4+ hands- on experience with development of ELT/ETL processes in traditional and distributed environments

• 4+ years experience as designer of complex Dimensional data models for analytics services

• 4+ years experience with development for Microsoft SQL Server Analysis Services or equivalent technologies.

• Solid skills in SQL and other languages used in data manipulation

• Experience with various testing methodologies and user acceptance testing.

• Experience with processing large datasets from multiple sources.

• Ability to operate effectively and independently in a dynamic, fluid environment.

• Understanding of ITIL processes Incident/Change/Release management methodologies.

• Strong verbal and written communications skills with experience in relating complex concepts to non-technical users.

• Demonstrated ability to exchange ideas and convey complex information clearly and concisely