Data Solution Designer

Job Title: Data Solution Designer

Location: Calgary, AB (Hybrid)

Estimated Duration: 12 Months

Our client is a leader in the responsible development and reliable and safe operation of North American energy infrastructure. They are one of the continent’s largest providers of gas storage and related services.
 
They are currently looking for a Data Solution Designer for Calgary, AB location.
 
Job Description:
 
As part of the ES Awareness, Strategy & Performance team and in collaboration with management across the ES department, the ES Data Solution Designer manages the flow of data from source systems into cloud platforms (AWS and Microsoft Fabric), ensuring it's accurate, secure, and arrives on time. You'll act as the expert on how data is structured and moved, working with business teams to understand what data they need and building the pipelines to deliver it. You'd also monitor data quality and security, catching problems early through validation rules and tracking system health metrics like speed and error rates. Additionally, you'll create dashboards and reports that give leadership real-time visibility into compliance and performance, while building automated systems to continuously monitor regulatory requirements. Finally, you'll drive continuous improvement by staying current with industry best practices and introducing new solutions to optimize how data flows through the organization.
 
Key Responsibilites:
 
• Act as the subject matter expert on data model and data architecture.
• Manage data extraction, transformation, and loading (ETL) processes to ensure data accuracy and timeliness.
• Maintain and enhance existing ingestions into AWS Datalake and Microsoft Fabric.
• Design, build, and document data flows, including defining and setting up data requirements and standards aligned with compliance needs.
• Collaborate with business stakeholders to identify data needs and deliver effective data ingestion solutions.
• Proactively optimize processes by fine-tuning system configurations, balancing workloads, and implementing fault-tolerant mechanisms
• Implement validation rules, cleansing procedures, and monitoring systems to detect and rectify anomalies within datasets.
• Ensure security and privacy measures are applied at both the report and data layers.
• Maintain data integrity and consistency across all reporting layers.
• Establish data governance frameworks that define standards and policies for data usage, ensuring consistency and reliability.
• Track the health of data pipelines, assessing metrics such as latency, error rates, and throughput.
• Design and develop dashboards and reports for actionable compliance and performance insights.
• Monitor presentation layer and data feeds to ensure continuous operation and resolve issues promptly.
• Continuous monitoring of data workflows to maintain system performance and identify potential issues before they escalate.
• Work with compliance team to build out the roadmap and key components critical for maturing our real time compliance and monitoring.
• Facilitate the implementation of real-time data gathering systems to realize real time compliance.
• Leverage existing systems and automated compliance systems to monitor, manage and enforce regulatory and corporate policies automatically.
• Assist and where appropriate, build out automation as required.
• Utilize real-time dashboards to provide instant insights into compliance status, risks, and operational metrics.
• Develop expertise in the space and maintain strong understand of all our key performance metrics, risks and desired outcomes.
• Seek guidance from vendor partners and industry experts to ensure best practice.
• Introduce innovative solutions and services to help achieve service goals and objectives.
 
Minimum Qualifications:
 
• Must have experience working with PowerBI
• Five to 10 years in ETL (extract, load, transform) tools, techniques, data warehousing, and metadata & quality management
• Strong understanding of what Key Performance Indicators and how they drive key outcomes
• Experience with modern data engineering tools in addition to strong relational database skills
• A bachelor’s or master’s degree in computer science, computer engineering, software engineering or a related technical field
• Strong analytical and problem-solving skills and well-versed with fundamental programming concepts and/or data structures and algorithms.
• Strong computing foundation and fundamentals, including experience with design patterns
• Ability to build excellent relationships with peers, leaders, technical teams, business users and executives
• A positive “can do” attitude; works through challenging situations with integrity and dignity
Preferred Qualifications
• Experience using ServiceNow for performance reporting
• PowerBI, Fabric, AWS
• Experience with automation and real time compliance