[FullTime] Python Selenium Django Backend Developer [LongTerm]
M365Connect
Date: 2 days ago
City: Lahore
Contract type: Full time
Remote
We are looking for a skilled Python Selenium Django Backend Developer to join our team for a long-term, full-time position of more than 6 months.
Your role will involve:
We have multiple projects. One of them you can find here for your reference and as an EXAMPLE:
Required Skills:
1. Programming Language: Python
The job scraper will be implemented using Python programming language.
2. Web Scraping: Selenium
Selenium will be used for web scraping tasks, as it provides a powerful framework for automating browser interactions.
3. Web Framework: Django
The job scraper will be integrated into a Django web framework, allowing for easy management and storage of scraped job data.
4. Front-end: HTML and CSS
HTML and CSS will be used to design and develop the user interface of the Django dashboard.
5. Platforms:
The bot will be capable of scraping jobs from multiple platforms, including LinkedIn, Glassdoor, Indeed
6. User Input:
The user will be able to enter a filtered URL for the job page and specify the number of jobs they want to scrape.
7. Job Data Extraction:
The bot will extract the following information from each job listing:
=> Job title
=> Job location
=> Company name
=> Job description
=> Source URL
8. Company Website Extraction:
After obtaining the company name, the bot will search for it on Google and retrieve the first non-sponsored link. If the link belongs to a social website or information website like Quora or Wikipedia, it will be skipped. Otherwise, it will be included on the company website.
9. Email Address Extraction:
The bot will navigate to the company website URL and scrape the email address from the contact section. This email address will be included as the company email.
10 . Data Storage:
The scraped job data, including company details, will be saved to the Django model for easy management and retrieval.
11. Duplicate Job Handling:
The bot will check for duplicate job listings and merge them if the same job is found on multiple platforms. The source websites' names will be included under the "source website" column.
============================================================
Your role will involve:
- Django stack development
- API
- Database architecture
- Python scripting
- RESTful API development
- Developing, maintaining, and updating the backend architecture of our web application.
- Working closely with our front-end developers
- Ensure seamless integration of the user interface with the backend
- Responsibility for database management and architecture, ensuring the efficient storage and retrieval of data.
We have multiple projects. One of them you can find here for your reference and as an EXAMPLE:
Required Skills:
- Experience with Python programming language.
- Proficiency in web scraping using Selenium, Bs4, and requests.
- Knowledge of automation techniques.
- Familiarity with the Django web framework.
- Strong understanding of HTML and CSS for front-end development.
- Experience with database integration, specifically Django models.
- Ability to handle duplicate data and merge records efficiently.
- Knowledge of Google search and web crawling techniques.
- Attention to detail and ability to handle complex scraping scenarios.
- Strong problem-solving skills and ability to work independently.
- Good communication skills to understand and implement the project requirements effectively.
1. Programming Language: Python
The job scraper will be implemented using Python programming language.
2. Web Scraping: Selenium
Selenium will be used for web scraping tasks, as it provides a powerful framework for automating browser interactions.
3. Web Framework: Django
The job scraper will be integrated into a Django web framework, allowing for easy management and storage of scraped job data.
4. Front-end: HTML and CSS
HTML and CSS will be used to design and develop the user interface of the Django dashboard.
5. Platforms:
The bot will be capable of scraping jobs from multiple platforms, including LinkedIn, Glassdoor, Indeed
6. User Input:
The user will be able to enter a filtered URL for the job page and specify the number of jobs they want to scrape.
7. Job Data Extraction:
The bot will extract the following information from each job listing:
=> Job title
=> Job location
=> Company name
=> Job description
=> Source URL
8. Company Website Extraction:
After obtaining the company name, the bot will search for it on Google and retrieve the first non-sponsored link. If the link belongs to a social website or information website like Quora or Wikipedia, it will be skipped. Otherwise, it will be included on the company website.
9. Email Address Extraction:
The bot will navigate to the company website URL and scrape the email address from the contact section. This email address will be included as the company email.
10 . Data Storage:
The scraped job data, including company details, will be saved to the Django model for easy management and retrieval.
11. Duplicate Job Handling:
The bot will check for duplicate job listings and merge them if the same job is found on multiple platforms. The source websites' names will be included under the "source website" column.
============================================================
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Team Leader, PCM
Wärtsilä,
Lahore
16 hours ago
Wärtsilä is a world leader in marine technology and leading the industry's transformation towards a decarbonised and sustainable future. With the world’s widest portfolio and service network, we – Wärtsilians - deliver efficient, safe and sustainable integrated products and solutions to enhance the business of our customers. The opportunities presented through digitalisation and new technologies are offering a new era...
Communications and Media Expert
PITCO (Pvt) Ltd.,
Lahore
17 hours ago
Position SummaryThe expert is responsible for oversight and coordination of all aspects and is responsible for planning and organizing events and/or meetings for the organization. The Expert will work to strategize, plan, and implement effective special events to educate our constituents, increase awareness of energy efficiency and conservation. Requires extensive awareness and outreach, however, the content development, designing and operationalization...
Senior Registrar
The Indus Hospital,
Lahore
1 day ago
Job DescriptionJOB SUMMARY:Good clinical knowledge on emergency medicine .He/she should be possess good communication skills and soft skills. Additional benefit to those who has valid certification of BLS, ACLS,PALS and ATLS.Tasks & AccountabilitiesTo lead a “quality team” of medical and nursing staffs.To work towards ensuring quality care service delivery in A&E.Supervise and direct the medical officers/ senior medical officers on...