197
edits
Changes
Jump to navigation
Jump to search
no edit summary
[[Minh Le]] [[Work Logs]] [[Minh Le (Work Log)|(log page)]]
2018-06-27:
*Worked on optimizing and fixing issues with the crawler.
2018-06-26:
*Talked to Ed about where to head with the code
*Connected the 2 projects together: got rid of Kyran's crawler and Peter's analysis script for now (we might want the analysis code later on to see how good the crawler was)
*Ran on the list of accelerators Connor gave me. Got mixed results (probably because the 80% is low) and we had to deal with website with expire timestamp like Eventbrite (the html showed the list, but displaying the html in the web browser doesn't). Found a problem that the crawler only get the number of results of the first page so if we want to gather large numbers of result, it would not work.
2018-06-25:
