Client:
Start Date:
End Date:
Technologies:
- Python programming language
- Selenium
- Requests
- Beautiful Soup
- JavaScript
- HTML and CSS markup language
- Bootstrap
- SQLite database
Project Description:
The aforementioned Polish client previously manually checked industrial machinery auctions from 15 target websites and participated in the best auctions. However, this process is exhausting and time-consuming for an individual. Therefore, he requested a platform that automatically extracts auction information from these 15 websites, presents new items on the site in an integrated manner, and sends daily emails for quick access to the best auctions.
Our Tasks:
- Creating a web scraping bot to extract information from 15 user-selected websites
- Collecting, integrating, and cleaning data (Data Preprocessing)
- Sending new data via email
- Designing and implementing backend and frontend web pages for data display and also allowing user configurations for the scraping bot (execution time, search keywords, etc.)