SENIOR DATA ENGINEER
IRD Global
Date: 3 weeks ago
City: Karachi
Contract type: Full time
Job Description
Department
Digital Transformation
Reporting To
Head of Digital Transformation
Employement Type
Full-time (Contractual)
Location
Karachi, Pakistan
JOb Purpose
The incumbent will be responsible for designing, building, and optimizing scalable data analytics systems and pipelines, impacting the efficiency, reliability, and performance of data-driven solutions to enable high-quality insights and informed decision-making across the organization.
Responsibilities
Required Qualification
Department
Digital Transformation
Reporting To
Head of Digital Transformation
Employement Type
Full-time (Contractual)
Location
Karachi, Pakistan
JOb Purpose
The incumbent will be responsible for designing, building, and optimizing scalable data analytics systems and pipelines, impacting the efficiency, reliability, and performance of data-driven solutions to enable high-quality insights and informed decision-making across the organization.
Responsibilities
- Design and implement scalable data ingestion and processing workflows using Apache NiFi and Apache Spark.
- Optimize and maintain analytical databases such as Vertica and ClickHouse for high-performance querying on large datasets.
- Administer and tune MySQL Server and MongoDB to ensure reliability, availability, and optimal performance.
- Develop robust data models for both OLTP and OLAP systems to support analytics and operational use cases.
- Build and manage distributed data architectures integrated with microservices, ensuring seamless and secure data access.
- Apply advanced query optimization and data lifecycle management practices to enhance overall system efficiency.
- Managing the complexity of designing and maintaining scalable data pipelines and distributed systems that can reliably process and serve 100 M+ row datasets across diverse platforms.
- Ensuring optimal performance and availability of analytical databases (e.g., Vertica, ClickHouse) while balancing cost, speed, and storage efficiency in high-demand environments.
- Integrating data workflows within microservice-based architectures, while maintaining data consistency, security, and low-latency access across teams and systems.
Required Qualification
- Bachelor’s degree in Computer Science, Data Science, Data Engineering, Software Engineering, or other related fields.
- At least 5 years of professional experience in data engineering or software development with focus on large scale data solutions.
- Hands-on experience with Apache NiFi or Apache Spark for data ingestion and processing.
- Strong experience in MySQL Server and MongoDB database administration and optimization.
- In-depth understanding of Linux-based environments and shell scripting.
- Strong knowledge of data modeling principles for both OLTP and OLAP systems.
- Experience in building and optimizing distributed datastores for high availability and performance.
- Familiarity with microservice architectures and their integration with data platforms.
- Expertise in query optimization techniques to enhance system performance.
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Talent Acquisition Coordinator, Pakistan
Standard Chartered,
Karachi
1 day ago
Job SummaryResponsible for efficiently and effectively completing all talent acquisition administration processes for new hires and internal moves, including hardcopy CV management and system updating, interview scheduling, offer letter and contract creation, processing interview expenses and vendor invoices, pre-employment verification check co-ordination with external vendorsKey Responsibilities Support Talent Acquisition Managers / Specialists in updating Requisitions and posting quality adverts aligned...
General Manager New Ventures
K-Electric,
Karachi
2 days ago
Our employees are our company's greatest asset - they are our real competitive advantage. We possesse immense power of innovation, immagination and a desire to attract and retain the best; provide them with encouragement, stimulus, and make them feel that they are an integral part of the company's mission.Purpose –The position reports directly to Director New Ventures and is responsible...
Assistant Engineer Execution
K-Electric,
Karachi
2 days ago
Our employees are our company's greatest asset - they are our real competitive advantage. We possesse immense power of innovation, immagination and a desire to attract and retain the best; provide them with encouragement, stimulus, and make them feel that they are an integral part of the company's mission.PurposeTo ensure timely and proper execution of schemes in accordance with safety...