Existing Crawlers - Revision history

Ed at 17:33, 22 March 2017

2017-03-22T17:33:16Z

Juliette.richert at 21:03, 21 March 2017

2017-03-21T21:03:14Z

Juliette.richert at 21:02, 21 March 2017

2017-03-21T21:02:51Z

Juliette.richert at 21:02, 21 March 2017

2017-03-21T21:02:32Z

Ed at 22:20, 7 October 2016

2016-10-07T22:20:25Z

ChristyW: Created page with "== Twitter Crawler == http://mcnair.bakerinstitute.org/wiki/Twitter_Webcrawler_(Tool) https://github.com/scroungemyvibe/mcnair_center_builds/blob/master/Twitter_Webcrawler_Bui..."

2016-09-29T20:03:14Z

Created page with "== Twitter Crawler == http://mcnair.bakerinstitute.org/wiki/Twitter_Webcrawler_(Tool) https://github.com/scroungemyvibe/mcnair_center_builds/blob/master/Twitter_Webcrawler_Bui..."

New page

== Twitter Crawler ==
http://mcnair.bakerinstitute.org/wiki/Twitter_Webcrawler_(Tool)
https://github.com/scroungemyvibe/mcnair_center_builds/blob/master/Twitter_Webcrawler_Build.py

What it does:
Given the input of a twitter username, builds a chart of their most recent 200 tweets and information related to their tweets including content of tweet, number of retweeters, number of mentions, number (and what kind) of hashtags and number of favorites.

Potential (Simple) Uses to Us:
- Organize the tweets by how many Retweets they get, then see what hashtags were used that could be useful to our tweets or lead our content in a specific direction
- Build a count of people who RT tweets that have content similar to ours, assign scores to these users based on how often they engage with McNairish content, how many followers they have etc to produce lists of people we should follow/ try to respond to

== Event Brite Crawler ==
https://github.com/scroungemyvibe/mcnair_center_builds/blob/master/EventBrite_Webcrawler_Build.py

What it does:
Given the ID of an event organizer, creates a dataset of all the events being put on by that organizer. You can also query by name of event "startup weekend" and by category "science and technology" for example

Potential Uses to Us:
Basically find content for our twitter. Although it is already pretty easy to find good content by just searching on the actual website, we could work to refine search queries using the crawler to automatically return a list of events that are potentially interesting to our twitter follower whenever the people in charge of the twitter want to post about events.

@@ Line 2: / Line 2: @@
 |Has title=Existing Crawlers
 |Has owner=Christy Warden,
 |Has project status=Active
 }}

@@ Line 1: / Line 1: @@
 {{McNair Projects
 |Has title=Existing Crawlers
-|Has owner=
+|Has owner=Christy Warden,
-|Has start date=
+|Has project status=Active
 }}
 == Twitter Crawler ==
 http://mcnair.bakerinstitute.org/wiki/Twitter_Webcrawler_(Tool)

← Older revision		Revision as of 21:02, 21 March 2017
Line 1:		Line 1:
		+
		+	{{McNair Projects
		+	\|Has image=
		+	\|Has title=Existing Crawlers
		+	\|Has owner=
		+	\|Has start date=
		+	\|Has deadline=
		+	\|Has keywords=
		+	\|Is billed to=
		+	\|Has notes=
		+	\|Has project status=
		+	\|Is dependent on=
		+	\|Does subsume=
		+	}}
		+
	== Twitter Crawler ==		== Twitter Crawler ==
	http://mcnair.bakerinstitute.org/wiki/Twitter_Webcrawler_(Tool)		http://mcnair.bakerinstitute.org/wiki/Twitter_Webcrawler_(Tool)

← Older revision		Revision as of 22:20, 7 October 2016
Line 18:		Line 18:
	Potential Uses to Us:		Potential Uses to Us:
	Basically find content for our twitter. Although it is already pretty easy to find good content by just searching on the actual website, we could work to refine search queries using the crawler to automatically return a list of events that are potentially interesting to our twitter follower whenever the people in charge of the twitter want to post about events.		Basically find content for our twitter. Although it is already pretty easy to find good content by just searching on the actual website, we could work to refine search queries using the crawler to automatically return a list of events that are potentially interesting to our twitter follower whenever the people in charge of the twitter want to post about events.
		+	[[Category:Internal]]

@@ Line 1: / Line 1: @@
 == Twitter Crawler ==
 http://mcnair.bakerinstitute.org/wiki/Twitter_Webcrawler_(Tool)
@@ Line 24: / Line 18: @@
 Potential Uses to Us:
 Basically find content for our twitter. Although it is already pretty easy to find good content by just searching on the actual website, we could work to refine search queries using the crawler to automatically return a list of events that are potentially interesting to our twitter follower whenever the people in charge of the twitter want to post about events.
-[[Category:Internal]]