Senior ETL Developer Job at The Accurate, Canada

djAyMnBYYk9nbWk1cUtXQ1VJekVGdVJCeFE9PQ==
  • The Accurate
  • Canada

Job Description

Job Description

Hi Everyone,

I Hope all are doing well,

Wondering if you are available for Contract position for Senior ETL Developer role with one our Client in Canada

if you are interested and need to get more information about this role please reach to me adam@the-accurate.com

Software Developer - ETL – Senior

Location : Toronto, ON (Hybrid)

Contract Position

Hybrid - Candidate MUST work 3 days onsite and 2 days remote

MUST HAVES:

5+ years of experience in data engineering:

· Must have demonstrated expertise in designing and implementing comprehensive data pipelines and transformations in a Microsoft Azure + Databricks and Power BI technology stack.

· Must have strong knowledge and hands-on experience with:

· Microsoft Azure Data Services (ADF, ADLS Gen 2, Synapse, Azure SQL)

· Azure Databricks

· PySpark and SQL

· Power BI (data preparation, modelling, and visualization)

· Must have demonstrated experience in developing and maintaining data pipelines and release management through Continuous Integration and Continuous Delivery (CI/CD) and DevOps practices using Azure DevOps, Git, Visual Studio Code, and related tools

Must have experience conducting software quality functional assessments, systems testing, performance evaluation, automated testing, using a variety of tools such as:

- JIRA or Azure DevOps for defect tracking,

- Selenium for automated testing of web-based apps, including Power BI reports and dashboards,

- JMeter for performance evaluation.

· Conducting data quality assessments, validation, and profiling using tools like Great Expectations

· Developing and maintaining automated testing frameworks integrated into CI/CD pipelines and DevOps practices using Azure DevOps, Git, Visual Studio Code, and related tools.

Description

Responsibilities:

We are seeking a highly skilled Software Developer with ETL implementation experience to join our data engineering team. This role is critical in ensuring the accuracy, reliability, and performance of our data pipelines and analytics infrastructure built on the Microsoft Azure platform and Databricks. Under the supervision of the IT QA Lead, you will collaborate closely with data engineers and DevOps teams to design and implement robust data quality frameworks, automated testing pipelines, and CI/CD processes.

· Design and implement comprehensive test plans for data pipelines and transformations in a Microsoft Azure + Databricks and Power BI technology stack.

· Conduct data quality assessments, validation, and profiling using tools like Great Expectations.

· Develop and maintain automated testing frameworks integrated into CI/CD pipelines.

· Collaborate with data engineers to ensure adherence to Medallion Architecture best practices.

· Monitor and assess pipeline performance, scalability, and data integrity.

· Implement and manage DevOps practices using Azure DevOps, Git, and related tools.

· Document test cases, validation rules, and QA processes clearly and consistently.

· Perform functional testing on Power BI Reports and dashboards

· Participate in Agile ceremonies and contribute to sprint planning and retrospectives.

Skills

Experience and Skill Set Requirements

Public Sector Experience

· 5+ years of experience working in the federal/provincial/broader public-sector as a software developer / data specialist / quality assurance tester

5 points

Core ETL Development Skill & Experience

5+ years of experience in data engineering:

· Must have demonstrated expertise in designing and implementing comprehensive data pipelines and transformations in a Microsoft Azure + Databricks and Power BI technology stack.

· Must have strong knowledge and hands-on experience with:

· Microsoft Azure Data Services (ADF, ADLS Gen 2, Synapse, Azure SQL)

· Azure Databricks

· PySpark and SQL

· Power BI (data preparation, modelling, and visualization)

· Must have demonstrated experience in developing and maintaining data pipelines and release management through Continuous Integration and Continuous Delivery (CI/CD) and DevOps practices using Azure DevOps, Git, Visual Studio Code, and related tools.

· Demonstrated experience in collaborating with data engineers to ensure adherence to Medallion Architecture best practices (Staging, Bronze, Silver, Gold layers),

· Certifications (preferred but not required):

- Microsoft Certified: Azure Data Engineer Associate

- Databricks Certified Data Engineer Associate/Professional

- Microsoft Certified: Fabric Analytics Engineer Associate

- Microsoft Certified: Power BI Data Analyst Associate

Microsoft Certified: DevOps Engineer

75 points

Quality Assurance Skill & Experience

5+ years of experience in quality assurance and automated testing:

· Must have experience conducting software quality functional assessments, systems testing, performance evaluation, automated testing, using a variety of tools such as:

- JIRA or Azure DevOps for defect tracking,

- Selenium for automated testing of web-based apps, including Power BI reports and dashboards,

- JMeter for performance evaluation.

· Conducting data quality assessments, validation, and profiling using tools like Great Expectations

· Developing and maintaining automated testing frameworks integrated into CI/CD pipelines and DevOps practices using Azure DevOps, Git, Visual Studio Code, and related tools.

· Certifications (preferred but not required):

- Certified Software Tester (CSTE)

- Certified Tester Test Automation Engineer.

20 points

Job Tags

Contract work, Remote job,

Similar Jobs

Avisi Technologies

Digital Marketing & Graphic Design Intern Job at Avisi Technologies

 ...are a creative and enthusiastic individual with a passion for web design, social media, digital marketing, and graphic design. You have a...  ..., technically skilled Digital Marketing & Graphic Design Intern to join our team. This role is ideal for someone passionate about... 

Private Family Office

Residential Security Agent Job at Private Family Office

 ...About: The Residential Security Agent position is assigned to an in-house protective security detail responsible for the safety and...  ...access to properties and maintenance of security logs for guests, service personnel, and vendors Successfully executing existing... 

Sky Climber Renewables

Wind Turbine Technician - Tech One Program Job at Sky Climber Renewables

Overview: TOP - Wind Technician Level 1 Description The #1 Wind Technician Development Program Build an exciting, rewarding...  ...home. Work on a service team to achieve safe and efficient wind turbine maintenance. Reports directly to the Program Manager and Site... 

Lowe's

Cashier Part Time Job at Lowe's

Your Impact at Lowe's Maximise your chances of a successful application to this job by ensuring your CV and skills are a good match...  ...for their money. How We Support You Whether you need a part-time position or a place to plant yourself and grow, Lowe's is ready... 

Decagon AI, Inc.

Sales Development Representative (SDR) Job at Decagon AI, Inc.

 ...Airtable, Rippling, Okta, Lattice, and Klaviyo.About the Role: Were looking for a driven, high-energy Sales Development Representative (SDR) to join our expanding Go-To-Market team. As an SDR, youll play an essential role in growing our customer base by identifying and...