Data Developer
RBC
Software Engineering
Toronto, ON, Canada
Job Description
What is the opportunity?
At RBC, our data engineering team enhances visibility into assets across the Public Cloud and Application Security landscape. Our mission is to provide clear insights into digital infrastructure, enabling effective identification and management of security risks. As a Data Developer, you will be a vital member of our team, driving the development of a cloud-based data platform that powers analytics and operational reporting. We harness industry-leading tools like Databricks, Python, and SQL, transforming data into strategic assets. Your experience will enable you to design reliable ingestion pipelines and facilitate data accessibility while maintaining robust security measures. Collaboration is key to our success, fostering an innovative environment where team members leverage their technical skills to drive continuous advancements in cloud security and data utilization across the organization.
What will you do?
Develop and maintain Databricks-based data platform using Azure Databricks, leveraging Python, PySpark, and Spark SQL to support analytics and operational reporting
Design robust data ingestion and transformation pipelines using Python and PySpark to efficiently process large datasets
Build and manage CDC (Change Data Capture) pipelines leveraging Python for real-time data synchronization and incremental data loads
Develop and optimize ELT/ETL workflows using Databricks Workflows or Apache Airflow, with Python-based orchestration and automation
Design and manage Delta Lake solutions for data versioning, efficient data storage, and schema evolution
Write production-grade Python code for data processing, pipeline automation, and custom data transformations
Ensure datasets are clean, reliable, and ready for consumption by implementing data quality checks and validation processes using Python and SQL
Implement data governance and compliance standards using Unity Catalog for access management and data lineage tracking
Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand data requirements and deliver actionable insights
Monitor, troubleshoot, and optimize Spark jobs for performance, addressing pipeline bottlenecks and ensuring cost efficiency
Implement CI/CD methodologies for automated deployment and testing of data pipelines using Python-based frameworks
Develop reusable Python libraries and frameworks to accelerate data platform development
Develop and maintain comprehensive documentation for data pipelines, transformations, and data models
Contribute to data platform enhancements that drive excellence across multiple business units
What do you need to succeed?
Must-Have
Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field
Minimum 3+ years of experience in data development, preferably in cloud-based environments
Expert-level proficiency in Python including advanced features, object-oriented programming, and design patterns
Strong experience with Python data libraries (Pandas, NumPy) and testing frameworks (pytest, unittest)
Deep understanding of PySpark for distributed data processing and large-scale transformations
Strong SQL skills for complex data queries and transformations
Hands-on experience with Databricks platform including Delta Lake, Unity Catalog, and Lakehouse Architecture
Experience building CDC pipelines and implementing real-time data synchronization solutions
Experience managing cloud setups, particularly Azure Cloud Services
Proven ability to write clean, maintainable, and well-documented Python code following best practices
Understanding of data governance frameworks and compliance requirements
Ability to work in fast-paced environments and adapt to changing priorities
English fluency, verbal and written
Strong problem-solving skills and an engineering mindset
Nice to Have
Familiarity with CI/CD methodologies and Infrastructure-as-Code (Terraform)
Experience with Databricks Workflows or Apache Airflow for orchestration
Knowledge of SCM (Source Code Management) tools and version control
Databricks certifications (e.g., Databricks Certified Data Engineer)
Exposure to Docker and containerization technologies
Understanding of business intelligence and reporting tools (e.g., Tableau, Power BI)
Familiarity with Cyber Security concepts and secure data practices
Experience with data modeling and dimensional design
What’s in it for you?
We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice `to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.
A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
Leaders who support your development through coaching and managing opportunities
Work in a dynamic, collaborative, progressive, and high-performing team
A world-class training program in financial services
Flexible work/life balance options
Opportunities to do challenging work
Opportunities to take on progressively greater accountabilities
Opportunities to building close relationships with clients
#LI-POST
#TECHPJ
Job Skills
Active Learning, Application Integrations, Detail-Oriented, Group Problem Solving, Programming Languages, Software Development Life Cycle (SDLC)Additional Job Details
Address:
City:
Country:
Work hours/week:
Employment Type:
Platform:
Job Type:
Pay Type:
Posted Date:
Application Deadline:
Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date above
Our Employment Opportunities
At RBC, we are guided by living shared values of Client First, Integrity, Collaboration, Respect and Excellence and winning together as One RBC. We believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.
Join our Talent Community
Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.
Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at jobs.rbc.com.
RBC is presently inviting candidates to apply for this existing vacancy. Applying to this posting allows you to express your interest in this current career opportunity at RBC. Qualified applicants may be contacted to review their resume in more detail.