Changes

Jump to navigation Jump to search
2,747 bytes removed ,  17:35, 2 September 2016
no edit summary
This =Hubs Pages=*The main page represents the work used for mechanical turks for the paperHubs can be found: [[Hubs (Academic Paper)]]. *For the current work in progress for building the Hubs datasheet for the scorecard As of Spring 2016, go to: [[Hubs: Hubs Scorecard]]*For a list tracker of potential work in progress for the dataset building for the scorecard go to [[Hubs: Hubs with Data Building]]*For a set high-level overview of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a the variables for the scorecard go to help subjectively define [[Hubs: Hubs based on certain characteristics. Data]]
=List of Variables=For a more information on Mechanical Turks in general, -depth of the variables and procedure please see : [[Mechanical Turk (Tool)Hubs: Hubs Scorecard]]. This page will reflect the variables being collected separated into three categories. Each variable will include a breakdown of levels being collected if the definition is not trivial and an approximate approach.
The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data
=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city
==Grouping of Variables=='''07/29''' Ariel: code Hubs variable for Hubs There are a few categories the majority of the variables fall under:<code>E:/McNair/Projects/Hubs/Hubs Variable-Ariel</code>
'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors
'''As of Week of 7/25'''===Group 2: The 1==='''Variables Difficult to FindObtain'''#'''Founding Date''' ''(date_founded)''#*''' ''Difficulty:'' '''Finding date based on our strategiesThere are certain variables where the information is not readily available online #*''' ''New Approach:'' ''' #*#Whois.net Date#*#Factavia/other press release searches #'''Multiple locations within city + Franchise''' (as of now just addresses) ''(multi_address)''#*''' ''Difficulty:'' ''' Company or difficult to findestablishment level will impact measurements#*''' ''New Approach:'' ''' Will record all addresses at company level#'''Onsite Venture Capital v. Angel Investors''' (e.g.#Size and Assets Under Management) ''(onsite_Vc_bin)/(onsite_vc_list)'' ''(can try to find press releasesonsite_angel_bin)/etc.''#*''' ''Levels:'' ''' Binary, list of investors#*''' ''Difficulty:'' ''' Hub website usually does not include investors#*''' ''New Approach:'' ''' #*#Google key terms with address of Hub#*#Start with partners and use google/crunchbase
===Group 2==='''Variables Comfortable, Not Complete''' (rough order of most difficult to least difficult)#'''Onsite accelerator''' ''(onsite_accel_bin)/(onsite_accel_cnt)/(onsite_accel_list)''#*''' ''Levels:'' ''' Binary, count, list#*''' ''Difficulty:'Group 3' ''' Usually not a list, which requires more scrubbing as many other variables just require us to find one page on a website. #*''' ''Approach: In Between 1 '' '''#*#Google searches and 2procedure to use on website yields decent results#*#Similar procedure to onsite investors#'''Size (# members)''' ''(num_members)''#*''' ''Levels:'' ''' Count for companies (currently not planning to include list of companies given that some potential hubs have 200+ members)#*''' ''Difficulty:'' '''Some companies don’t list all members - only selective ones-, others do not separate current members and alumni, and some just write "we have served more than 120 startups..."Variables #*''' ''Approach:'' ''' For companies that have a list, we will count. For those with select members, we will count those they listed and try to see if there is a comment about how many they have. For those that arenjust have a statement "with over," we will write the number and + (e.g. "120+).#'''Office hours investors''' and '''Office hours mentor/advisors''' ''(OH_bin)/(OH_inv_bin)/(OH_inv_list)/etc.''#*''' ''Levels:'' ''' Binary for OH, binary for two separate OH, list of names/descriptions of OH#*''' ''Difficulty:'' 't too easy '' Some companies do not list who OH are with, not always obvious if investor, mentor, or difficult advisor, sometimes not clear if mentor is investor/future investor#*''' ''Approach:'' ''' Google approach to get to OH pages and then lookup key words in description to separate out#'''Onsite temporary workshops and Networking Meetups''' (Count) ''(onsite_temp_events_bin)/(onsite_temp_workshop_bin)/(onsite_temp_workshop_cnt)/etc.''#*''' ''Levels:'' ''' Binary for do they exist, count for each#*''' ''Difficulty:'' ''' Difficult for Turkers to differentiate between these two and also other potential events (e.g. symposiums)#*''' ''Approach:'' ''' Uses key search terms (e.g. Java/etc.) to find separate out workshops and automatekey terms (e.g.lunch/happy hour) for networking meetings#'''Onsite acceleratorcode school''' and '''Curriculum''' ''(onsite_long_term_courses)/(onsite_code_school_bin)''#*''' ''Levels:'' ''' Binary for do they exist, binary for each#*''' ''Difficulty:'' ''' Difficult for Turkers to differentiate between long-term coding programs for individuals and curriculum for startups#*''' ''Approach:'' ''' Uses key search terms (e.g. specific code schools) to separate out known code schools and also to look into key terms (e.g. leadership) for curriculum#'''Sponsors/Partners''' (University, Corporate) ''(sponsors_cnt)/(sponsors_list)/etc.''#*''' ''Levels:'' ''' Count, list of sponsors/partners (if exist), separate columns for university and corporate#*''' ''Difficulty:'' ''' Not all companies will list sponsors, partnesrs, or either. Not always clear the difference among sponsors, partners, investors.#*''' ''Approach:'' ''' Use two different levels and use of google search, then if list exists, separate by "college"/"university" and rest#'''Alumni mentorNetwork''' ''(alumni_bin)/(alumni_list)''#*''' ''Levels:'' ''' Binary, list#*''' ''Difficulty:'' ''' Not all companies list alumni, some only list "selected"#*''' ''Approach:'' ''' Include all that have lists#'''Size (sqft)''' ''(size_sqft)''#*''' ''Levels:'' ''' Number in sqft#*''' ''Difficulty:'' ''' Not all companies list square feet online#*''' ''Approach:'' '''#*#Google search with key words#*#If results do not appear, use of press releases is possible#'''Onsite Mentors''' ''(onsite_mentors_bin)/(onsite_mentors_cnt)/(onsite_mentors_list)''#*''' ''Levels:'' ''' Count and list of mentors (if exist)#*''' ''Difficulty:'' ''' Not all companies list mentors - bigger issue is onsite investors#*''' ''Approach:'' ''' Use two different levels and use of google search
===Group 3==='''Group 4: The Hard Variables Easy to DifferentiateObtain'''The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.#Onsite VC v. Angel Investors#Onsite OH Investors v. mentors#Onsite temporary workshops v. networking events#Curriculum v. code school '''Group 5: The Need further Discussion Before CollectionTwitter activity'''''Variables that need to be developed more prior to collection.#Franchise and multiple locations within a city#Community Membership ==Filters(twit_handle)/Scorecard==  =Variables for Hubs=We will be creating a "Hubs scorecard" to determine how hub-like potential spaces are. In order to do so, we will evaluate the places based on certain variables. Previous variables for potential hubs were collected. Below, we list those as well as other variables we think might be helpful to build out the scorecard. Ideally, we would have the following variables (not collected previouslytwit_prev_mon_cnt_tweets):#Onsite VC/Angel/Investors (Count or binarytwit_cnt_followers)##Comments:##Mechanical Turk Comments:#Onsite Mentors /(binarytwit_cnt_retweets) --- ''Are these the same as advisers?''##Comments:##Mechanical Turk Comments:#"Office hours" with investors or mentors (binary)##Comments: Previously collected included number of events, but did not separate them into categories (e.g. networking events, workshops, etc.). We view this separation as important, BUT very difficult to collect##Mechanical Turk Comments: #Onsite temporary workshops (binary or count) *** '''see mechanical turk'''##Comments:##Mechanical Turk CommentsLevels:#Networking Meetups (Binary or count) *** '''see mechanical turk'''Twitter Handle, #Tweets in a Month, #Comments:Followers, ##Mechanical Turk Comments:Retweets#Sponsors and Partners (binary and list) --- a*'''re these the same?''##CommentsApproach:##Mechanical Turk Comments:#Alumni Network (binary) --- ''not all potential hubslist this and the fact that some do might indicate its importance''##Comments:##Mechanical ' Easy to get twitter handle from Turk Comments:#Num or Veeral's code that allows us to run a series of Companies --- 'searches on google and then use Gunny's Twitter crawler to help determine size as getting physical sqfootage is difficult''##Comments:##Mechanical Turk Comments:get other levels from handle#Nonprofit (binary) --- ''helpful in determining goals of potential hubs''##Comments:##Mechanical Turk Comments:#Mission Includes Key Buzzwords (e.g. "ecosystem", "community") --- 'Site URL'help separate simple coworking spaces form hubs'' Example of Prior Variables Collected:*Specific Industry -- ''defined as LinkedIN Self Identifier, no categories just plain text. We think what we really want is to see if they have a specialty (e.g. healthcareurl)''#*Num of Events --- ''relatively complete inputs, but from March 2016 (see above as well)''*Price for Single Space --- 'Levels:'''defined as price for flexible desk, relatively complete inputs''URL#*Price for Office --- ''no inputs''*Twitter Activity (Multinomial or Count) --- 'Approach:'High=2/Moderate=1/No=0, no explanations on how to categorize the activity. Also no handles''*Size (sqft) --- ''no records for majority of the companies'Google using Veeral's code that allows us to search *Num Conference Rooms --- #''no records for majority of the companies''*Onsite accelerator (binary) --- 'Whois Date'relatively complete inputs''*Onsite code school (binary) --- ''relatively complete inputs''*Community Membership (binarydate_whois) --- ''relatively complete inputs'' =Test2=#*'''Twitter activity'''Levels: '' '''UPDATE (7/14)''': Updated turk to reflect our desired formatsDate#*'''UPDATE (7/12)'''Approach: '''AUDIT RESULTS''': We noticed Date active website was registered#'''UPDATE (7/11)Address''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.'(address)'#Copy the text in the Search Text into a search engine.#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs#Record the company's Twitter Handle into Twitter Handle#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.  *'''NUMBER OF EVENTS'''Levels: ''UPDATE: written, not published, on amazon's mechanical turk site''Will include all addresses#*'''Considerations'''*Difficulties Encountered:*Expected Time to Complete:*Expectation of Results (accuracy of turk, comprehensiveness):*Other CommentsApproach: '''Procedure'''#Copy the text in the Search Text into a search engineGoogle key terms (e.#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNEg.Contact Us) and URL using Veeral's code#Look for links related to events, such as 'Events' or 'CalendarNonprofit status''' on the homepage. #If not found on the homepage, check 'About' and check (nonprofit_binary)'Community'#Count the number of events in July 2016 and record it. If there is no information of events on the website, record DNE. Note***''' ''Levels: ''Events include meetups, workshops, info sessions etc. We do not want to count them separately since it is difficult to do so. Most companies put all ''' Binary variable indicating if the events on the same section and do not put event types in the titles of the events. We have to look into the details of the events to find out the type and even we do so some events descriptions do not allow us to determine the type easily. Differentiating the types of the events demands more time and effort and therefore potential Hub is not suitable to be a mechanical turk project.'' nonprofit organization#*'''Onsite Mentors'''Approach: ''UPDATE: written, not published, on amazon's mechanical turk site''#Copy the text in the Search Text into http://www.guidestar.org/ is a site that we can use to search engine.#Click on the result that if a company is the website of the company. If there does nonprofit or not exist a listing on the first three pages, mark as DNE.#Look for links related to mentorship such as 'mentors', 'mentorshipMission statement''' '' or (missions_stmt)'mentoring programs'#If the key words can be identified, mark as 1#If there is no explicit *'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,Levels:' 'Our Mission,' etc., look for a subsection or mention of mentor/mentorship/mentoring#If these exist, mark as 1.#If not, go to links related to membership 'benefits,' 'perks,' Official mission statement or related.#Do same process as end of 4 and 5#If there is no mention description of mentorship in these sections, type the company, city, and 'mentoring' into a search engine. If a link to a reliable website (such as Desktimeif mission does not exist) appears and mentorship can be found in the description, mark as 1.#If none of these steps result in a mark of 1, mark as 0   *'''Nonprofit'''Approach: ''UPDATE: written, not published, on amazon's mechanical turk site''#Copy the text in the Search Text into a search engine.#Click on the result that is the website of the company. If there does not exist a listing explicitly stated mission statement, will include "About" or statements on the first three pages, mark as DNE.main page#Go to links that describe the company, usually they are labelled: 'About', 'Our Story,Specific Industry' 'Mission'#Look for the key word 'nonprofit'/(spec_industry)'non-profit'#If 'nonprofit' is identified, mark as 1, otherwise 0.   *'''Number of Members'''Levels: ''UPDATE: written, not published, on amazon's mechanical turk site''#Copy the text Industry included in the Search Text into a search engine.statement (no aggregation)#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.#Look for the link *'''Members' or 'ResidentsApproach:', usually they are under the links 'Community', 'Membership'*Based on Mission Statement, not aggregated#'Our Space' or 'The SpacePrice for a space/office'.#Count the number of members#If the link or section of 'Members' is not found, go the 'Community' and (price_space)'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.#If number of members cannot be identified using above steps, record DNE.  *'''Sponsors and Partners'''Levels:''UPDATE: written, not published, on amazon's mechanical turk site''#Copy the text in the Search Text into a search engine.#Click on the result that is the website of the company. If there does not exist a listing on the first three pagesTwo prices one for shared, mark as DNE.other for private#Look for the link or mention of *'''Sponsors' or 'PartnersApproach:', many times of which is often under the section of 'About', 'Community', or related sectionsUses google methodology with key terms and URL[[Category: Internal]]#If sponsors or partners can be found mark as 1 and list them, otherwise mark as 0.[[Internal Classification: Legacy| ]]

Navigation menu