Lead Data Engineer - Python/PySpark - Virtusa Colombo

Posted August 7, 2025 by Virtusa Pvt Ltd

Closing Date : September 5, 2025

Colombo ,

Full Time

Information & Communication Technology |

Engineering - Software |

About the job:

We are looking for a skilled and motivated Data Engineer with over 4+ years of experience in building and maintaining scalable data pipelines.
The ideal candidate will have strong expertise in AWS Redshift and Python/PySpark, with exposure to AWS Glue, Lambda, and ETL tools being a plus.
You will play a key role in designing robust data solutions to support analytical and operational needs across the organization.
Design, develop, and optimize large-scale ETL/ELT data pipelines using PySpark or Python.
Implement and manage data models and workflows in AWS Redshift.
Work closely with analysts, data scientists, and stakeholders to understand data requirements and deliver reliable solutions.
Perform data validation, cleansing, and transformation to ensure high data quality.
Build and maintain automation scripts and jobs using Lambda and Glue (if applicable).
Ingest, transform, and manage data from various sources into cloud-based data lakes (e.g., S3).
Participate in data architecture and platform design discussions.
Monitor pipeline performance, troubleshoot issues, and ensure data reliability.
Document data workflows, processes, and infrastructure components.

Desired Skills and Experience:

CI & CD, AWS Lambda, Airflow

Data Analytics Programming Languages CI/CD Pipelines Leadership and Team Management

සෑලකිය යුතුයි : අපි ඔබව මෙම රැකියාව උපුටා ගත් පිටුවට හරවා යවන්නෙමු . අපි ඔබ වෙනුවෙන් ඔබේ CV , තොරතුරු අදාළ ආයතනය වෙත නොයවන බව කරුණාවෙන් සලකන්න

கவனமாக இருக்க வேண்டும் : இந்த வேலை மேற்கோள் காட்டப்பட்டுள்ள பக்கத்திற்கு உங்களை திருப்பி விடுவோம். உங்களுக்கான CV, தகவல்களை சம்பந்தப்பட்ட நிறுவனத்திற்கு நாங்கள் அனுப்ப மாட்டோம் என்பதை நினைவில் கொள்ளவும்

Disclaimer : By clicking the button below, you consent for CareerFirst and partners to use automated technology, including pre-recorded messages, cell phones and texts, and email to contact you at the number and email address provided. This includes if the number is currently on any Do Not Call Lists. This consent is not required to make a purchase. We are redirecting you to the employer's career page. Please note that we are not sending your CV to the employer on your behalf. Privacy Policy.