Description:
As a Data Engineer you will develop and maintain Microsoft SQL databases (including creating and maintaining tables, views, stored procedures), and ETL (Azure Data Factory, Azure functions, logic apps, Databricks, Spark, PySpark) processes.
Excellent communication is key, as well as motivation to learn new technologies as Colliers data management platform evolves over time. A proven history of delivering results with brilliantly efficient procedures will be a definite plus.
What you bring
- Intermediate to advanced ETL experience and skills (5+ years of experience)
- Two plus years’ experience in Azure Data Factory, Azure functions, logic app
- Three plus years’ experience in Databricks or Spark technologies.
- Intermediate to advanced SQL, preferably MS SQL Server and experience in object-oriented programming languages like C#, VB.Net and Python
- Intermediate MS SSIS scripting
- Advanced MS SQL Server Stored Procedures
- MS SQL Server database management, as in building tables and tuning queries and stored procedures
- Data profiling and data quality assessment skills
- Experience in MS Azure platform or Google Cloud platform
- Strong technical problem-solving skills and proficiency in trouble shooting issues related to operating systems and application systems.
- Good written and verbal communication skills for coordinating development across teams.
- A drive to learn and master new technologies and techniques.
- Experience in DevOps and CI/CD
Bonus skills and experience
- Experience in Commercial Real Estate
- Knowledge of Master Data Management including matching, survivorship and golden record creation.
- GCP experience including Dataflow, BigQuery, Cloud SQL and Cloud Storage
- Experience in Optimizing query speed and reducing cost in BigQuery