http://www.edegan.com/mediawiki/api.php?action=feedcontributions&feedformat=atom&user=MyTornado 2026-06-02T04:02:15Z User contributions MediaWiki 1.34.2 http://www.edegan.com/mediawiki/index.php?title=Software_Repository_Listing&diff=7994 2016-08-05T20:22:51Z

<p>MyTornado: /* Web Crawler */</p> <hr /> <div>This page lists all software/tools available on our [[Software Repository]]. The documentation on using a particular tool will be on its separate wiki page.<br /> <br /> For information and tutorial on how to access McNair git server, see [[Software Repository]].<br /> Read the tutorial and instructions first before pushing anything to the git-server.<br /> <br /> =Repositories on McNair [[Software Repository|git server]]=<br /> <br /> ==Center IT Sysadmin==<br /> This repository contains all tools and scripts meant for system administration (stuff like backup scripts..)<br /> *See the [[Center IT]] page for current documentation.<br /> <br /> <br /> ==Harvard Dataverse==<br /> This repository contains all tools and scripts related to Harvard Dataverse.<br /> *The [[Harvard Dataverse]] page provides instruction on how to access data.<br /> <br /> <br /> ==Geocoding Inventor Locations==<br /> This repository holds software for matching Inventor addresses to known locations.<br /> There are two programs/scripts that do same job. One is implemented in Perl(old) and other in Python(new). You should probably use the newer tool.<br /> *See [[Geocoding Inventor Locations (Tool)]] for documentation on the older version implemented in Perl.<br /> *See [[Geocode.py]] for the newer version in Python.<br /> <br /> ==Matcher==<br /> This repository contains the matcher tool which is used to match firm names given two lists.<br /> *See [[The Matcher (Tool)]] for documentation.<br /> <br /> ==Patent Data Parser==<br /> This repository contains all tools developed for patent data parsing.<br /> *[[Patent Data (Tool)]] and [[Patent Data Extraction Scripts (Tool)]] pages on the wiki describe our Patent Database schema and corresponding XML parsing tools.<br /> *Also, see [[USPTO Assignees Data]] which explains Patent Assignee Database schema and relevant XML parsing tools.<br /> <br /> ==Utilities==<br /> This repository contains various utilities developed for text processing and other generally useful tools. See the wiki pages for each tool's documentation.<br /> *[[Fuzzy match names (Tool)]]<br /> *[[Godo (Tool)]]<br /> *[[Normalizer Documentation | Normalizer]]. On the [[Software Repository|git-server]] we have many different versions like normalize fixed width, normalize surnames.<br /> <br /> ==Web Crawler==<br /> This repository contains all software for web crawlers.<br /> *[[Whois Parser]] pulls the Whois information given a list for URLs.<br /> *[[PhD Masterclass - How to Build a Web Crawler]]: Ed's class on building a web crawler.<br /> *[[LinkedIn Crawler (Tool)]] : web scraper for Linked In.<br /> <br /> <br /> [[category:McNair Admin]]<br /> [[admin_classification::Software Repository| ]]</div>

MyTornado