Data Engineer

Job Overview:

A Data Engineer is responsible for building and optimizing data pipelines, ensuring the availability of data for analysis, and designing systems for effective data storage, access, and processing. The role requires deep expertise in database management, ETL processes, and big data technologies.

Key Responsibilities:

1. Design and Build Data Pipelines:

o Develop, maintain, and optimize ETL (Extract, Transform, Load) workflows to move data from various sources into the data warehouse.

o Implement data transformation logic to clean and structure raw data for analytical use.

2. Data Storage and Architecture:

o Design and manage scalable and efficient databases, data lakes, and data warehouses.

o Collaborate with data architects and analysts to optimize data storage and retrieval.

3. Data Quality and Governance:

o Ensure data quality, accuracy, and integrity throughout the data lifecycle.

o Implement and monitor data validation procedures and governance policies.

Qualifications:

· Education: Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or related field.

Experience:

o 1-2 years of experience in data engineering, software development, or database management.

o Experience with cloud platforms (AWS, Azure, Google Cloud).

o Proficiency in SQL, Python, and data integration tools.

Skills:

o Expertise in database systems (SQL, NoSQL).

o Familiarity with big data technologies (Hadoop, Spark, Kafka).

o Strong understanding of ETL pipelines and data warehousing (e.g., Snowflake, Redshift).

o Experience with data modeling and schema design.

Preferred Skills:

· Experience with data streaming technologies.

· Knowledge of machine learning frameworks and tools.

Key Tools:

· Programming Languages: Python, Scala, SQL

· Databases: PostgreSQL, MSSQL, MongoDB, Cassandra

· Cloud Services: AWS Redshift, Google BigQuery, Azure Synapse

Location: The Enteprise Building, Multan Road Lahore

Timing: 9pm to 6am