Web data extracting, categorisation and listing according to user's queries

The Project Website consists of an automated and customizable website which is able to automatically and regularly (i) collect(extract) product/service information from third party e-commerce websites, (ii) categorize products/services according to such information under categories and sub-categories defined by the Administrator of the Project Website and (iii) list products/services on the Project Website on the basis of the collected information. It is important to keep the Administrator's role in information collection, categorization, listing process at minimum level. That being said, the website Administrator should have the authority (i) to create, edit, delete product categories and sub-categories; (ii) create, edit, delete the content displayed on the first page of the Project Website; (iii) add and delete third party e-commerce websites to the Project Website and do the same for individual products to be individually extracted from a particular website; (iv) create, edit, delete product information and products manually without the interference of the auto-collection process; (v) monitor and keep statistics of individual Visitors' likes, unlikes, clicks and the actions/purchases resulting from clicks on the website. The Administrator of the Project Website will be a non-tech person with very basic information of computer. As such, the programmer of the Project Website should programme the Project Website, for a example using a CMS like WP, so that the Administrator should be able to execute her/his tasks without technical involvement of a tech-person. The Project Website, in its nature, is not an e-commerce website. Instead of selling products, it will market and promote goods/services being sold on third party e-commerce websites by categorising and listing them. Visitors to the Project Website shall be able search and sort products according to their categories and sub-categories and display mainly the product (i) visual (picture) and (ii) price, and secondly basic product information such as product brand, model, color, style, etc. Visitors should go to the product's respective e-commerce website by clicking the product visual. Kindly present your similar past work and advise what kind of tool/technology would you use to collect/extract product details and categorise them. ## Deliverables WEBSITE FUNCTIONS - ADMINISTRATOR-SIDE Information Collection The Project Website should be able to collect automatically product information such as product visual (picture), brand, model, price, color, style, etc. from third party e-commerce websites in a regular way and without the involvement of the Administrator of the Project Website. The information collection process shall start with the application of e-commerce website owners for their products to be listed on the Project Website, and once registered with the Project Website and approved by the Administrator of the Project Website, product details shall be automatically extracted from their respective e-commerce websites and be categorized and listed on the Project Website regardless of the coding language of the e-commerce website. Taking into account the high number of e-commerce websites and products, it is essential that and the information collection process shall be carried out (i) automatically and (ii) regularly so that the administrator doesn't need to assume an active role in this process and product information on the Project Website remain up to date. For instance, if a particular product is removed from its respective e-commerce website, it should not any longer be listed on the Project Website, or if its price changes, such new detail should be immediately available on Project Website. . Information Categorization The product information collected from e-commerce websites shall be automatically categorized according to the categories/sub-categories defined by the Administrator before being listed on the Project Website. Such categories shall be defined by the Administrator and contain different sub-categories for different genre of products. It is, once again, essential to keep the Administrator's role in information categorization process at minimum level. That being said, the Administrator should have the authority to (i) create and delete manually product categories and sub-categories and edit and delete the same, (ii) categorize products and edit manually product information by disabling information collection process for that particular product. For instance, if the Administrator, after defining categories/sub-categories and product being listed under such categories/sub-categories, notices that a product's detail is missing or a product detail is wrong, she/he should be able to edit such detail manually and prevent the automatic information process to update/change the manually edited information. Information Listing Products, after their visuals and related information are collected from their e-commerce websites and they are categorized, they shall be listed on the Project website under their respective categories. The listing should be automatically renewed when the search is customized using the side-bar by entering more specific details such as brand, style, etc. Products should be listed in individual boxes/grids displaying only the product visual and its price right under the visual and like and unlike buttons at the bottom of the box. In the case that there has been a discount in product's price the former price should remain next to the product and a small downward arrow should appear next to the new price. Administrator's Role The Administrator of the Project Website will be a non-tech person with very basic information of computer. As such, the prospect programmer of the Project Website should programme the Project Website so that the Administrator should be able to execute her/his tasks without technical involvement of a tech-person. For instance, an administrator panel or dashboard would be useful for the Administrator to execute her/his tasks. The Administrator's tasks shall include: to (i) upload and install the website via FTP/cPanel; (ii) assign new administrators, (iii) create, edit, delete product categories and sub-categories; (iv) create, edit, delete the content displayed on the first page of the Project Website; (v) add and delete third party e-commerce websites to the Project Website and do the same for individual products to be individually extracted from a particular website; (vi) create, edit, delete product informations and products manually without the interference of the auto-collection process; (vii) monitor and keep statistics of individual Visitors' likes, unlikes, clicks and the actions/purchases resulting from clicks on the website. WEBSITE FUNCTIONS - VISITOR-SIDE As the first specification, the Project Website is not a place for the Visitors to buy products/services; Visitors will use the Project Website to find a particular product/service that they are looking for by entering specific product details or searching key words. Visitors will be able to search and sort product/services according to categories defined by the Administrator. Visitor should be provided with a Like and Unlike button at the bottom of each product visual boxes, and the administrator shall be able to keep the track of liked and unliked products. Visitor should be able to see which products they previously liked or unliked. There shall be a register link at the right of the header inviting Visitors to enter their e-mail, age, sex and products they are interested in. Social media buttons like FB, Twitter should be placed next to register link. MAIN PAGE LAYOUT The Project Website should have a header and a horizantal main navigation bar right under the header and a notable search box right under the main navigation. The main navigation bar should contain main product types. When hovering over the products on the navigation bar, a drop-down menu where sub-products are listed should automatically appear. There should be a side-bar on the left side of the page which will allow Visitors to choose the details of the product they desired to find. Below the main navigation bar and on the right of the side bar there shall be a clickable auto-sliding content box. The sliding content box should contain clickable product visuals. Below the auto sliding content box, there should be one line of three boxes similar to those that are displayed when making a product search. The Administrator should use these boxes for showing featured visuals. PROJECT OWNER'S PRIORITIES Project Owner's first and main concern about the Project Website is (i) sustainability and (i) simplicity. The Project Website shall be sustainable enough to handle big volume of third party e-commerce websites designed and programmed in different languages and high number of products. If the administrator needs the technical assistance from the programmer or the Project Website needs maintenance, the programmer should be always available and ready to provide assistance notwithstanding her/his professional, religious and geographical conditions. The project owner intends to use the Project Website as a template under different domain names for different segments of products. Accordingly, the website should be easy to install and edit for other segments of products. OTHER SPECIFICATIONS As denoted above, the Project Website is an open ended project. As such, the Project Website should be programmed and designed in a way allowing the project owner to develop it further by adding new features. The programming language shall be PHP and the codding shall be clear, i.e. simple to read and edit and contain necessary and relevant comments in English so that further development phases can be carried out easier. The Project Website shall be built SEO friendly. The Project language should be able to display letters in Turkish, English.