Listing Page Classifier

From edegan.com
Revision as of 14:51, 30 March 2019 by Ed (talk | contribs)
Jump to navigation Jump to search


Project
Listing Page Classifier
Project logo 02.png
Project Information
Has title Listing Page Classifier
Has owner Nancy Yu
Has start date
Has deadline date
Has project status Active
Copyright © 2019 edegan.com. All Rights Reserved.


Main Tasks

  1. Build a site map generator: output every internal links of input websites
  2. Build a generator that captures screenshot of individual web pages
  3. Build a CNN classifier using Python and TensorFlow

Approaches (IN PROGRESS)

  1. URL Crawler
E:\projects\listing page identifier\urlcrawler.py

Image Processing

This method would likely rely on a convolutional neural network (CNN) to classify HTML elements present in web page screenshots. Implementation could be achieved by combining the VGG16 model or ResNet architecture with batch normalization to increase accuracy in this context.