Data Engineer
NorthBay Solutions
Date: 10 hours ago
City: Lahore
Contract type: Full time
As a Data Engineer in our team, you will be responsible for assessing complex new data sources and
quickly turning these into business insights. You also will support the implementation and integration
of these new data sources into our Azure Data platform.
Responsibilities:
quickly turning these into business insights. You also will support the implementation and integration
of these new data sources into our Azure Data platform.
Responsibilities:
- You are detailed reviewing and analyzing structured, semi-structured and unstructured data
- sources for quality, completeness, and business value.
- You design, architect, implement and test rapid prototypes that demonstrate value of the
- data and present them to diverse audiences.
- You participate in early state design and feature definition activities.
- Responsible for implementing robust data pipeline using Microsoft, Databricks Stack
- Responsible for creating reusable and scalable data pipelines.
- You are a Team-Player, collaborating with team members across multiple engineering teams
- to support the integration of proven prototypes into core intelligence products.
- You have strong communication skills to effectively convey complex data insights to non-
- technical stakeholders.
- You have an experience working collaboratively in cross-functional teams and manage
- multiple projects simultaneously.
- Advanced working knowledge and experience with relational and non-relational databases.
- Experience building and optimizing Big Data pipelines, architectures, and datasets.
- Strong analytic skills related to working with structured and unstructured datasets.
- Hands-on experience in Azure Databricks utilizing Spark to develop ETL pipelines.
- Strong proficiency in data analysis, manipulation, and statistical modeling using tools like Spark,
- Python, Scala, SQL, or similar languages.
- Strong experience in Azure Data Lake Storage Gen2, Azure Data Factory, Databricks, Event
- Hub, Azure Synapse.
- Familiarity with several of the following technologies: Event Hub, Docker, Azure Kubernetes
- Service, Azure DWH, API Azure, Azure Function, Power BI, Azure Cognitive Services.
- Azure DevOps experience to deploy the data pipelines through CI/CD.
- Minimum 5-7 years of practical experience as Data Engineer.
- Bachelor’s degree in computer science, software engineering, information technology, or a related field.
- Azure cloud stack in-production experience.
Note : Contractual job for 2 months
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Game Quality Assurance Lead
FRAG Games,
Lahore
16 hours ago
About the Role:We are looking for a passionate and experienced Game QA Lead to join our growing team! You will play a pivotal role in leading our Game Analysts team, ensuring high-quality testing across diverse platforms and projects.Qualifications:Minimum of 4 years of experience in the Gaming industry.Proven ability to lead large projects.Demonstrated success in executing at least 2 large projects...
Account Executive
HR Ways - Hiring Tech Talent,
Lahore
16 hours ago
Account Executive- Onsite in Lahore, PakistanClient company introduction:Our Client Company is group of digital craftsmen with international expertise dedicated to helping the business grow and engineering beautiful experiences. The company is headquartered in KSA. They are highly experienced software developers who have a deep understanding of how to leverage top programming languages, frameworks, and other software development tools to create the...
Care & Service Operations Associate - Pay
Careem,
Lahore
1 day ago
Careem is building the Everything App for the greater Middle East, making it easier than ever to move around, order food and groceries, manage payments, and more. Careem is led by a powerful purpose to simplify and improve the lives of people and build an awesome organisation that inspires. Since 2012, Careem has created earnings for over 2.5 million Captains,...