Python Data Engineer – APIs, Scraping & Containerization

We are looking for a Python Data Engineer with 0–1 year of experience to join our team. This is an excellent opportunity for someone early in their career to work on real-world data engineering tasks involving APIs, web scraping, databases, and containerized deployments. You'll get hands-on experience with Linux servers, cloud platforms, and learn how to build reliable data pipelines that scale.

Responsibilities

• Write Python scripts to extract, clean, and transform data from web sources and APIs
• Develop and maintain web scraping solutions using tools like BeautifulSoup, Scrapy, or Selenium
• Build and manage lightweight ETL/data pipelines
• Work with APIs for data ingestion and automation
• Interact with SQL and NoSQL databases (e.g., PostgreSQL, MongoDB) to store and query data
• Package applications using Docker for deployment and reproducibility
• Work with Linux-based servers to run, monitor, and troubleshoot jobs
• Collaborate with team members to ensure data quality and efficient workflows
• Deploy and test solutions on cloud environments like AWS, GCP, or Azure

Qualifications

• Strong foundation in Python
• Basic understanding of RESTful APIs – consuming and integrating APIs
• Experience or familiarity with web scraping libraries (e.g., BeautifulSoup, Scrapy, Requests)
• Understanding of SQL and at least one database system (e.g., MySQL, PostgreSQL)
• Familiarity with Docker and containerization concepts
• Comfortable working in Linux command-line environments
• Good problem-solving skills and willingness to learn
• Clear communication and ability to document work

Bonus Points (Nice to Have)

• Familiarity with cloud services (like EC2, Lambda, S3, GCS, etc.)
• Experience with Git/GitHub for version control
• Exposure to task schedulers (like cron or Airflow)
• Understanding of basic networking concepts

What We Offer

• Opportunity to work on real-world data projects from day one
• Supportive learning environment with mentoring and code reviews
• Access to cloud and container tech stacks
• Flexible work hours and remote-friendly culture
• A chance to grow into a full-stack data engineering role

How to Apply:

If you meet the qualifications and are enthusiastic about joining the dynamic team at Cognilium.ai, please submit your updated CV highlighting your relevant experience to [email protected]. 

Alternatively, you can fill out our application form at this link “https://forms.gle/3wFuNBbxHiubQcfH9”