Data Engineer

NorthBay Solutions


Date: 2 weeks ago
City: Lahore
Contract type: Full time
As a Data Engineer in our team, you will be responsible for assessing complex new data sources and
quickly turning these into business insights. You also will support the implementation and integration
of these new data sources into our Azure Data platform.

Responsibilities:
  • You are detailed reviewing and analyzing structured, semi-structured and unstructured data
  • sources for quality, completeness, and business value.
  • You design, architect, implement and test rapid prototypes that demonstrate value of the
  • data and present them to diverse audiences.
  • You participate in early state design and feature definition activities.
  • Responsible for implementing robust data pipeline using Microsoft, Databricks Stack
  • Responsible for creating reusable and scalable data pipelines.
  • You are a Team-Player, collaborating with team members across multiple engineering teams
  • to support the integration of proven prototypes into core intelligence products.
  • You have strong communication skills to effectively convey complex data insights to non-
  • technical stakeholders.
  • You have an experience working collaboratively in cross-functional teams and manage
  • multiple projects simultaneously.
Skills:
  • Advanced working knowledge and experience with relational and non-relational databases.
  • Experience building and optimizing Big Data pipelines, architectures, and datasets.
  • Strong analytic skills related to working with structured and unstructured datasets.
  • Hands-on experience in Azure Databricks utilizing Spark to develop ETL pipelines.
  • Strong proficiency in data analysis, manipulation, and statistical modeling using tools like Spark,
  • Python, Scala, SQL, or similar languages.
  • Strong experience in Azure Data Lake Storage Gen2, Azure Data Factory, Databricks, Event
  • Hub, Azure Synapse.
  • Familiarity with several of the following technologies: Event Hub, Docker, Azure Kubernetes
  • Service, Azure DWH, API Azure, Azure Function, Power BI, Azure Cognitive Services.
  • Azure DevOps experience to deploy the data pipelines through CI/CD.
Qualifications and Experience:
  • Minimum 5-7 years of practical experience as Data Engineer.
  • Bachelor’s degree in computer science, software engineering, information technology, or a related field.
  • Azure cloud stack in-production experience.

    Note : Contractual job for 2 months

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

Junior Amazon PPC Manager

AdNativ, Lahore
2 days ago
Your Mission:- Manage and optimize Amazon Ads campaigns that drive REAL sales and growth- Analyze data like a hawk and make adjustments that get results- Collaborate with our team of rockstars to deliver exceptional partner experiencesRequirements:- 6+ months of hands-on Amazon Ads experience (no exceptions)- English communication skills that drive clarity and action- Excel/Google Sheets mastery for data analysis and...

Associate Software Engineer

9D Technologies, Lahore
2 days ago
Hazel Mobile is at the forefront of app and game publishing, delivering innovative and engaging mobile experiences to users around the globe. Our mission is to create extraordinary digital experiences that captivate and entertain, and we are committed to pushing the boundaries of creativity and technology.Responsibilities:Assist in developing, testing, and optimizing mobile applications for either Android or iOS platforms. Develop...

Chief Operations Officer (COO)

GatedTalent - Connecting Top Executive Search Firms And Executives, Lahore
4 days ago
Job Description:As the Chief Operations Officer, you will oversee the company’s operational heartbeat, ensuring seamless execution of daily activities while managing staff and enforcing operational excellence. You’ll play a pivotal role in streamlining workflows, improving overall efficiency, and maintaining high service standards for valued customers.Key Responsibilities:Lead and inspire the floor operations team, driving productivity, engagement, and a culture of continuous...