Location: Toronto, ON Hybrid (3 days Onsite- Tue, Wed, Thursday)
Total Experience: 8-10 Years
AWS: 5 Years
Databricks: 1-2 Years.
Note: Citizens or PR only considered for the TCS role, sorry, OWP won't work.
Responsibilities
- Design, develop, and maintain scalable and robust data pipelines on Databricks.
- Collaborate with data scientists and analysts to understand data requirements and deliver solutions.
- Optimize and troubleshoot existing data pipelines for performance and reliability.
- Ensure data quality and integrity across various data sources.
- Implement data security and compliance best practices.
- Monitor data pipeline performance and conduct necessary maintenance and updates.
- Document data pipeline processes and technical specifications.
Qualifications
- Bachelor's degree in Computer Science, E...