SENIOR DATA ENGINEER
IRD Global
Date: 7 hours ago
City: Karachi
Contract type: Full time
Job Description
Department
Digital Transformation
Reporting To
Head of Digital Transformation
Employement Type
Full-time (Contractual)
Location
Karachi, Pakistan
JOb Purpose
The incumbent will be responsible for designing, building, and optimizing scalable data analytics systems and pipelines, impacting the efficiency, reliability, and performance of data-driven solutions to enable high-quality insights and informed decision-making across the organization.
Responsibilities
Required Qualification
Department
Digital Transformation
Reporting To
Head of Digital Transformation
Employement Type
Full-time (Contractual)
Location
Karachi, Pakistan
JOb Purpose
The incumbent will be responsible for designing, building, and optimizing scalable data analytics systems and pipelines, impacting the efficiency, reliability, and performance of data-driven solutions to enable high-quality insights and informed decision-making across the organization.
Responsibilities
- Design and implement scalable data ingestion and processing workflows using Apache NiFi and Apache Spark.
- Optimize and maintain analytical databases such as Vertica and ClickHouse for high-performance querying on large datasets.
- Administer and tune MySQL Server and MongoDB to ensure reliability, availability, and optimal performance.
- Develop robust data models for both OLTP and OLAP systems to support analytics and operational use cases.
- Build and manage distributed data architectures integrated with microservices, ensuring seamless and secure data access.
- Apply advanced query optimization and data lifecycle management practices to enhance overall system efficiency.
- Managing the complexity of designing and maintaining scalable data pipelines and distributed systems that can reliably process and serve 100 M+ row datasets across diverse platforms.
- Ensuring optimal performance and availability of analytical databases (e.g., Vertica, ClickHouse) while balancing cost, speed, and storage efficiency in high-demand environments.
- Integrating data workflows within microservice-based architectures, while maintaining data consistency, security, and low-latency access across teams and systems.
Required Qualification
- Bachelor’s degree in Computer Science, Data Science, Data Engineering, Software Engineering, or other related fields.
- At least 5 years of professional experience in data engineering or software development with focus on large scale data solutions.
- Hands-on experience with Apache NiFi or Apache Spark for data ingestion and processing.
- Strong experience in MySQL Server and MongoDB database administration and optimization.
- In-depth understanding of Linux-based environments and shell scripting.
- Strong knowledge of data modeling principles for both OLTP and OLAP systems.
- Experience in building and optimizing distributed datastores for high availability and performance.
- Familiarity with microservice architectures and their integration with data platforms.
- Expertise in query optimization techniques to enhance system performance.
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Linehaul Lead
Daraz,
Karachi
2 days ago
About DarazFounded in 2015, Daraz is South Asia’s leading e-commerce platform in Pakistan, Bangladesh, Sri Lanka, Nepal and Myanmar. It empowers more than 100,000 active sellers with world-class marketplace technology to reach the fast-growing consumer class in a region of 500 million people. Through Daraz Express and Daraz Pay, it operates the most efficient and digitalized logistics and payments infrastructure...
Green Business Consultant
LeadingEdge HR Solutions,
Karachi
3 days ago
Job SummaryDevelop and implement sustainable business strategies that integrate ESG principles, helping businesses reduce environmental impact and improve social responsibility while enhancing their reputation and competitiveness.Key Responsibilities:1. Help businesses integrate ESG (Environmental, Social, and Governance) principles into operations.2. Conduct ESG assessments and identify areas for improvement.3. Develop and implement sustainable business strategies aligned with ESG goals.4. Provide guidance on environmental...
Audit Manager
Standard Chartered,
Karachi
1 week ago
Job SummaryTo act as a Team Member on assigned audit work involving audits primarily in Pakistan; To act as Team Leader and take responsibility for overseeing the planning and execution of the audit, maintaining the audit budget, including drafting of audit issues and the audit report; To ensure that assigned audit work is executed in an efficient and effective manner,...
