Sanka Weerathunga
As a dedicated Data Engineer with over five years of industry experience, I specialize in building robust data pipelines, integrating diverse data sources, and developing high-impact visualizations. My expertise spans across cloud platforms like AWS and Azure, and I am particularly skilled in delivering real-time and batch data processing solutions that drive organizational transformation.
My technical proficiency includes a deep understanding of modern big data architecture, data security, and design principles, with hands-on experience in handling structured, semi-structured, and unstructured data. I thrive on collaborating with cross-functional teams to enhance data flow, implement governance and privacy measures, and ensure data quality across the board.
Driven by curiosity and a passion for data, I continuously seek to refine, enhance, and adapt data solutions to the ever-evolving technological landscape. My fascination with the transformative power of data motivates my ongoing learning and exploration in the field, with the goal of advancing best practices and contributing to data-driven decision-making.
In this dynamic field, I am committed to being a lifelong learner and innovator, always ready to adapt and apply my knowledge to new challenges. Join me on this journey of discovery and growth, where every dataset tells a story, and every challenge is an opportunity for innovation.
Portfolio
A Data-Driven Approach to Understanding Child Abuse in Sri Lanka
This project transforms government reports on child abuse in Sri Lanka into interactive data visualizations, aiming to raise awareness and facilitate informed discussions among stakeholders to address the issue effectivel
Check out the project and work in here.
Host Your Static Website on AWS S3 with Terraform
This guide walks you through hosting your static website on AWS S3 using Terraform. Follow these steps to set up your environment and deploy your website.
Check out the project and work in here.
Toronto Auto Theft Dashboard
An interactive Tableau dashboard visualizing auto theft data across Toronto, with insights into theft locations, premises types, and trends by division. Filter by year, month, and location type for a comprehensive look at auto theft incidents. Powered by open data from the Toronto Police Service.
Check out the project and work in here.
...
...
Experience
Senior Data Engineer (remote)
- Developed automated end-to-end data pipelines on Hadoop, leveraging real-time Kafka feeds and optimizing data extraction processes to enhance data ingestion and integration strategies.
- Created real-time visualization dashboards using Tableau, significantly improving operational monitoring and decision-making efficiency.
- Implemented a real-time monitoring system for sales operations, integrating data from multiple sources and providing a hierarchical view of sales data from retailers to CXOs.
- Drove data quality initiatives, achieving up to 99% data pipeline accuracy through daily monitoring processes.
- Sent automated alerts based on historical trends and current performance to the monitoring team and end-users, ensuring proactive issue resolution and performance optimization.
Data Engineer
- Developed analytical dashboards using Tableau to evaluate customer experience in service centers, enhancing service quality and customer satisfaction
- Produced ad hoc analyses and deep dives on specific issues, identifying areas of opportunity for business improvements.
- Performed data preprocessing for the data modeling team, creating datasets and database views for cross-functional teams to support diverse business functions.
- Optimized queries to improve data retrieval performance and validated data with other sources to maintain pipeline reliability.
- Utilized Agile methodologies, including JIRA, for effective project management and collaboration.
Software Engineer(Co-op)
- Developed a full-stack web application for inventory management and finance system using MVC architecture, enhancing user interaction with a seamless frontend and robust backend.
- Designed and optimized the database schema, implementing database tables to ensure data integrity and improve system reliability and efficiency.
- Led the end-to-end development process, from application flow conceptualization to deployment, collaborating with team members to deliver a user-friendly and robust application.
- Created Crystal Reports for dynamic data visualization and reporting within the application, providing users with insightful and actionable information
- Technology Stack: C# .NET, JavaScript, HTML, CSS, Bootstrap, JQuery, and MSSQL Server
Education
Big Data Solution Architecture - Postgraduate Certificate
- Focus: Specialized postgraduate training in Big Data management, emphasizing development, design, and visualization of large-scale data solutions.
- Learning Approach: Hands-on, problem-based learning for real-world data challenges.
- Core Skills Acquired:
- Development of software solutions for data collection, manipulation, and mining.
- Analysis and selection of appropriate system architectures and data storage technologies.
- Designing data models and visualizations for business decision-making.
- Utilization of business analytics and intelligence tools.
- Commitment to data privacy, security, and sustainable practices.
- Semester 01 GPA: 3.86/4
Bachelor of Science (Honours) in Information Technology
- Core modules: Machine Learning and Pattern Recognition, Big Data Analytics, Data mining, Artificial Neural Networks, Artificial Intelligence, Computational Mathematics, Operational Research, Data Structures and Algorithms, Object-oriented Programming, Web Technologies, Enterprise Application Development, Advanced Database Management Systems, Project Management
- Publications: Weerathunga HPSD, Silva AT. DRNN-ARIMA Approach to Short-term Trend Forecasting in Forex Market.18th International Conference on Advances in ICT for Emerging Regions (ICTer)Sep. 2018 (pp. 287-293).
Skills
Interests
Apart from working with Data, I enjoy most of my time being outdoors Cycling, walking and travelling.
When forced indoors, I follow a number of sci-fi and fantasy genre movies and television shows, especially documentaries related to Science and Technology. Other than that, I love to cook various cuisines such as traditional Sri Lankan curries and fancy breakfast recipes. Furthermore, I always listen to songs and sing (karaoke) in my leisure time.