Job Description :Our client in Regina, SK is currently looking for a Senior Data Engineer.
Must Have Primary Skills :Educational & Experience Requirements:
- Degree or Diploma in Computer Science, Engineering, Data Sciences, or a quantitative discipline
- has 5+ years’ recent experience in ETL, data design, data architecture, data management, and data modeling
- Relevant job experience in North America
Core Technical Skills:
- SQL Server & SSIS: Expert proficiency with SQL Server (on-premises), including stored procedures, and SSIS package-level deployment.
- Data Pipelines: Proven experience designing, creating, and maintaining robust data pipelines and ETL processes.
- Monitoring: Skilled in monitoring and troubleshooting database issues to ensure compliance with policies and regulations.
-
Python for ETL: Advanced Python skills applied to developing ETL processes following software development best practices (including automated testing and code reviews).
- Big Data Tools: Proficient in leveraging big data technologies, including PySpark and SparkSQL for large-scale data processing.
- Cloud Expertise: Hands-on experience with cloud-based platforms such as Databricks, Azure Data Factory, and Azure Data Lake.
-
Lakehouse Architecture: Knowledgeable in implementing lakehouse architectures using Delta format and optimization strategies.
- API Integration: Experience working with external third-party APIs as ETL sources, including Microsoft Graph APIs to integrate and automate tasks across Microsoft services.
- Automation & Deployment: Familiar with CI/CD processes and tools—including Databricks asset bundles (DABs) for managing workflows—and proficient with version control systems (e.g., Git) for ETL deployments.
Nice To Have Secondary Skills :Data Management & Communication:
- Understanding of data management principles as outlined by DAMA/DMBoK.
- Ability to provide insights on evolving database integration, storage, and utilization needs.
- Overseeing integration from legacy/on-premises systems to new solutions.
- Clear communication of technical information and the ability to train/support staff
- Knowledge of data privacy and confidentiality regulations (e.g., PIPEDA)
Proven Experience In :Typical activities in this role include but not limited to:
- Work closely with the Enterprise Analytics team to create and maintain ELT processes;
- Assemble large, complex datasets that meet functional / non-functional business requirements;
- Consulting DT&S and Business leaders on data and information management practices and governance.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.;
-
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and other technologies;
- Work with stakeholders including the Executive, to assist with data-related technical issues and support their data infrastructure needs.
- Create data tools for analytics and data scientist team members that assist them in building and optimizing our business.
-
Work with data and analytics experts to strive for greater functionality in our data systems.
- Championing efforts to improve business performance through enterprise information capabilities, such as master data management (MDM), metadata management, analytics, content management, data integration, and related data management or data infrastructure;
- Provide insight into the changing database integration, storage and utilization requirements for the company and offer suggestions for solutions;
- Monitor and understand Information Management trends and emerging technologies.
IND1 Please send your resume to
[email protected]