edegan.com - User contributions [en]

Work Hours

2016-09-26T18:18:45Z

ArielSun:

Please complete your preferred times for the Fall term of 2015 below.

{| class="wikitable sortable" style="border: 1px solid darkgray; bgcolor: #f9f9f9"
| align="center" style="background:#f0f0f0;"|'''Name'''
| align="center" style="background:#f0f0f0;"|'''Mon'''
| align="center" style="background:#f0f0f0;"|'''Tues'''
| align="center" style="background:#f0f0f0;"|'''Wed'''
| align="center" style="background:#f0f0f0;"|'''Thurs'''
| align="center" style="background:#f0f0f0;"|'''Fri'''
|-
| Albert Nabiullin||3-4:30||12:45-3:15||3-4:30||12:45-3:15||3-4:30
|-
| Amir Kazempour||||||||||
|-
| Avesh Krishna||9-11:00||2:30-4:00||2-5:30||2:30-4:00||2-4:00
|-
| Ariel Sun||11-12||||11-12||||11-12, 1:15-2:45
|-
| Ben Baldazo||2-5:00||1:-5:00||||||2-:500
|-
| Carlin Cherry||||10-12, 2:20-3:50||12:45-2, 3-5:30||2:20-3:50||12:45-2
|-
| Catherine Kirby||||1:00-3:00||3:00-5:00||2:00-5:00||1:00-4:00
|-
| Christy Warden||||2:00-4:45||||2:00-4:45||
|-
| Dylan Dickens||1-6:00||||||||
|-
| Harsh Upadhyay||3-5:30||3-5:30||3-5:30||3-5:30||3-5:30
|-
| Jake Silberman||||||||||
|-
| James Chen||||10:00-12:00||||3:00-5:00||10:00-4:00
|-
| Julia Wang||1-4:30||||1-4:30||||1-4:00
|-
| Marcela Interiano||||||||||
|-
| Meghana Gaur||||||||||
|-
| Ramee Saleh||3-5:00||3-5:00||3-5:00||3-5:00||3-5:00
|-
| Ravali Kruthiventi||3-6||||3-6||||3-6
|-
| Todd Rachowin||||||||||
|-
| Tay Jacobe||10:00-12:00||4:00-6:00||10:00-12:00||4:00-6:00||10:00-12:00
|-
| Will Cleland||||12:30-4||||12:30-4||2-5:00
|}

[[Category: McNair Admin]]
[[admin_classification::Admin| ]]

Ariel Sun (Work Log)

2016-09-07T19:29:40Z

ArielSun:

[[Category:Work Log]]
[[Ariel Sun]] [[Work Logs]] [[Ariel Sun (Work Log)|(log page)]]

06/01/2016 - Introduction/Wiki Building

06/02/2016 - Refined Wiki Organization and Content

06/03/2016 - Organized Topic Areas and Worked on Public Wiki Page

06/06/2016 - Continued Organizing Public Wiki Page

06/07/2016 - Draft of Women in Entrepreneurship blog post

06/08/2016 - Work on Challenges Women Entrepreneurs Face wiki page

06/09/2016 - Clean up content of patent trolls and put on the public page

06/10/2016 - Put up resources for business dynamism in high tech issue brief page

06/13/2016 - Clean up venture one data and LBO data

06/14/2016 - Match venture one and LBO data to patent data

06/15/2016 - Create tables that match patent information to each LBO/venture company

06/16/2016 - Create and Finalize LBO/venture company and patent summary table

06/17/2016 - Familiarize with Hubs datasets

06/20/2016 - Analyze existing SQL code of Hubs datasets

06/21/2016 - Clean up and rebuild Hubs datasets

06/22/2016 - First draft of complete SQL script for Hubs datasets

07/15/2016 - Help Ed send out VentureOne data, add grouping and considerations of Hubs scorecard variables

07/18/2016 - Work on differentiating curriculum v. code school, redo Matching VentureOne

07/19/2016 - Finish Marching Venture One, update on Wiki, work on differentiating curriculum v. code school

07/20/2016 - Work on differentiating OH investor v. mentor, temporary workshop v. networking meetup

07/21/2016 - Consolidate previously done hubs variables, work on number of onsite accelerators

07/22/2016 - Work on Hubs variables: price of flexible/dedicated desk, Onsite VCs v. Angel Investors, number of members

07/29/2016 - Code for Hubs variables that are hubs, E:/McNair/Projects/Hubs/Hus Variables-Ariel

09/07/2016 - Moved scorecard related pages to hubs scorecard academic paper, edit hubs vc sql data script

The Impact of Entrepreneurship Hubs on Urban Venture Capital Investment

2016-09-07T16:33:30Z

ArielSun:

{{McNair Projects
|Project Title=Hubs(Academic Paper)
|Topic Area=Entrepreneurship Ecosystems
|Owner=Todd Rachowin, Ariel Sun
|Start Term=Spring 2016
|Status=Active
|Deliverable=Academic Paper
|Audience=Academics
|Keywords=Hubs, Incubators, Accelerators, Venture, Capital, Angel, Investor, Startups
|Primary Billing=AccNBER01
}}

=Hubs Pages=
*This page [[Hubs (Academic Paper)]] is the main page for the Hubs project!
*The old work done by Rachael is on the [[Hubs]] page
*For a high-level overview of the variables for the scorecard go to [[Hubs Scorecard (Academic Paper)]]. This summarizes:
**Current work in progress for building the Hubs scorecard: [[Hubs: Hubs Scorecard]]
**Tracking of work in progress for the scorecard [[Hubs: Hubs Data Building]]

=Abstract=

The Hubs Research Project is a full-length academic paper analyzing the effectiveness of "hubs", a component of the entrepreneurship ecosystem, in the advancement and growth of entrepreneurial success in a metropolitan area.

This research will primarily be focused on large and mid-sized Metropolitan Statistical Areas (MSAs), as that is where the greater majority of Venture Capital funding is located.

A general overview of entrepreneurial ecosystems can be found here: [[Entrepreneurial Ecosystem]].

=Current Work=
==General Overview==
Currently there are '''3''' major tasks being performed (list to be updated):
#'''Creation of VC data table''': '''UPDATE: Complete''' (see completed work section below)
#'''Creation of Hubs Dataset''': '''UPDATE: See current work in progress for updates''' We will collect key variables for potential Hubs.
#'''Hazard Rate Model''': '''UPDATE: (7/11) Spoke to Xun Tang, econometrics professor in Rice's Economics Department, and now looking for appropriate proportional rate hazard models with time varying covariates.''' In order to perform our diff-diff model, we need to match MSAs. In order to do so, we will be using a hazard rate model to produce a probability that a MSA gets a Hub and compare MSAs that do and don't have hubs with similar probabilities.

==Work In Progress==

=Completed Work=
==Venture Capital Data General Overview==
The main goal of the data set is to aggregate company, fund, and round level data to be analyzed at a combined MSA and year level. The data set is compromised of two major parts: a granular company/fund/round and an aggregated CMSA-Year. The data includes all United States Venture Capital transactions (moneytree) from the twenty-five year period of 1990 through 2015.

The Hubs data set, from SDC Platinum, has been constructed in the server:
Data files are in 128.42.44.181/bulk/Hubs
All files are in 128.42.44.182/bulk/Projects/Hubs
psql Hubs2

Sql files:
:<code>E:\McNair\Projects\Hubs\Data Script v10.txt</code>
Note: We need to check that everything in '''Data Script v9 Ariel.txt''' has been incorporated into v10

Table Header Rows + 5 lines:
:<code>E:\McNair\Projects\Hubs\Data Table List v2.txt</code>
Note: This was generated by '''Data Script v10.txt'''

===Procedure - Granular Table===
#Start with separate raw datasets for Companies, Funds, and Rounds - '''Locate Raw Datasets and Determine Pedigree'''
#Add Data to Each Individual dataset (e.g. add MSA code)
#Clean and standardize names (e.g. company or fund name) for each dataset
#Join the Datasets (here we need to exclude undisclosed companies)

===Procedure - CMSA-Year Table===
#Create a consistent CMSA-Year table to be used later
#Using the tables from the granular table, parse out the right data
#Join the parsed out data with the CMSA-Year Table
#Join these Tables

==VC Specific Tables and Procedure==
===Raw data tables===
#'''Funds''': fund name, first investment date, last investment date, fund closing date, address, known investment, average investment, number of companies invested, MSA, MSA code.
#'''Rounds''': round date, company name, state, round number, stage 1, stage 2, stage 3
#'''Combined Rounds''': company name, round date, disclosed amount, investor
#'''Companies''': company name, first investment, last investment, MSA, MSA code, address, state, date founded, known funding, industry
#'''MSA List''': MSA, MSA code, CMSA, CMSA code
#'''Industry List''': changes 6 industry categories to 4— ICT, Life Sciences, Semiconductors, Other

===Granular Table (Fund-Round-Company)===
The final table here contains all venture capital transactions by disclosed funds and portfolio companies, together with their CMSAs.
To get the table, we processed the raw data sets in the following steps:
#Clean '''Company''' data
##Import raw data companies
##Add variable 'CMSA' from data set MSA list, update variable 'industry' by joining data set industry list
##Remove duplicates and remove undisclosed companies
#Clean '''Fund''' data
##Import raw data funds
##Add variable 'CMSA'
##Remove duplicates and remove undisclosed funds
##Match fund names with itself using [[The Matcher (Tool) |The Matcher]] to get the standard fund names
#Clean '''Round''' data
##Import raw data rounds and combined rounds
##Add variables 'number of investment', 'estimated investment' and 'year'
##Remove duplicates and remove undisclosed funds
#'''Combine''' '''Companies''' and '''Rounds'''
##Combine cleaned companies and rounds data table on company names
##Add variable 'round number' and 'stage'
##Remove duplicates
#'''Combine''' '''Funds''' and '''rounds-companies'''
##Match fund names in rounds data table with standard fund names using [[The Matcher (Tool) |The Matcher]] to standardize fund names in rounds data table
##Join standard fund names to rounds-companies table
##Join cleaned funds table to rounds-companies table on standard fund names

Note: This was done by Ariel and then edited by Todd.

===CMSA-Year Aggregated Table===

The original MSA to CMSA was done by Rachel and used here. '''LOCATE THE FILE!!!'''

The final table contains number of companies and amount of investment, categorized by distance and stages, of each CMSA.

We processed data as follows:
#Create the '''CMSA-Year''' Table
##Create single variable tables: Distinct CMSA, year, stage, found year of fund and found year of company.
##Create the cross production tables: CMSA-year, CMSA-year-fund year founded and CMSA-year-company year founded
#Draw data from cleaned companies, funds and rounds tables
##Create a table with 'CMSA', 'number of companies' and 'year Founded' from cleaned companies table and join it to CMSA -year founded
##Create a table with 'Company CMSA', 'round year', 'disclosed amount' from rounds-companies combined table, and add stage binary variables. Join it to CMSA-year-company year founded
##Create a table with 'CMSA', 'fund year', 'number of investors' from cleaned funds table and join it to CMSA-year-fund year founded
#Create '''near-far''' and stages table
##Add fund data to rounds-companies
##Create near-far and stages binary variable
##Count investment and deals by CMSA and year, categorized by near-far and stages
#Combine all tables by CMSA and round-year

==Supplementary Data Sets==

Supplementary data sets are cleaned and joined back to CMSAyear table on CMSA and year:

#Number of STEM graduate student, by university and year(2005 to 2014).
#University R&D spending, by university and year(2004 to 2014).
#Income per capital, by MSA and year(2000 to 2012)
#Wages and salaries, by MSA and year(2000 to 2012)

All of these files were created originally by Rachel. Some were cleaned in Excel. No new data was added (some extra cols, no extra rows).

The datasets can respectively be found at:
E:\McNair\Projects\Hubs\STEM grads for upload v2.xls
--Contains: university zipcode newmsacode msa msacode cmsa cmsacode year nostudents
--CMSA code inside sheet seems to be ours. Check with Ariel.
E:\McNair\Projects\Hubs\NSF spending for upload.xls
--Contains: Institution MSA CMSA code Year Spending
--We think the CMSA Code is ours. Check with Ariel.
E:\McNair\Projects\Hubs\Income per capita upload.xls
--Contains: Fips Area Year Income
--Lookup to CMSA was done using VLOOKUPs in Excel. See Matcher Helper vTR.xls, and other Matcher Helper ???.xls files
E:\McNair\Projects\Hubs\Wage for upload v2.xls
--Contains: Fips MSA Year Wage
--Lookup to CMSA was done using VLOOKUPs in Excel. See Matcher Helper vTR.xls, and other Matcher Helper ???.xls files

=Resources=

===Additional Resources===
* Yael Hochberg and Fehder (2015), located in dropbox
** Use this paper as a guideline on how to conduct the analysis
*US Census Bureau data on employment by MSA: http://factfinder.census.gov/faces/tableservices/jsf/pages/productview.xhtml?pid=ACS_14_5YR_B23027&prodType=table
*USPTO utility patents by MSA: http://www.uspto.gov/web/offices/ac/ido/oeip/taf/cls_cbsa/allcbsa_gd.htm
*MSA level trends: http://www.metrotrends.org/data.cf

<includeonly>
[[Category: McNair Projects]]
</includeonly>

Hubs Scorecard (Academic Paper)

2016-09-07T16:33:04Z

ArielSun:

{{McNair Projects
|Project Title=Hubs Scorecard(Academic Paper)
|Topic Area=Entrepreneurship Ecosystems
|Owner=Todd Rachowin, Ariel Sun
|Start Term=Summer 2016
|Status=Active
|Deliverable=Academic Paper
|Audience=Academics
|Keywords=Hubs, Incubators, Accelerators, Venture, Capital, Angel, Investor, Startups
|Primary Billing=AccNBER01
}}

=Abstract=
As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

=Work in Progress=
Our goal is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs (Complete)
#Determining the best variables for the scorecard (Complete)
#Building '''"filters"''' for automating the collection (Complete)
#'''Running''' and '''auditing''' of the automation (In Progress)
#Collecting the remaining manual data (next step)

*For the detailed current work in progress for building the Hubs datasheet for the scorecard go to: [[Hubs: Hubs Scorecard]]
*For a tracker of work in progress for the dataset building for the scorecard go to [[Hubs: Hubs Data Building]]
*For a high-level overview of the variables for the scorecard go to [[Hubs: Hubs Data]]
*For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].
*Comprehensive list of potential hubs can be found at:
##<code>E:\McNair\Projects\Hubs\Raw Program List</code> Contains 600 entities - vast majority are firmly not hubs (file pedigree unknown)
##<code>E:\McNair\Projects\Hubs\Hubs Data</code> - Contains 125 entities - many are not hubs (overlap with above file unknown, this file's pedigree from old Hubs project).

==Hubs Data==
'''(7/27 Onwards)'''

Collected variables for 30 hubs that are surely hubs. The results are here:
*<code>E:\McNair\Projects\Hubs\Hubs Variables -Ariel.xls</code>

'''(Until 7/27)'''

See [[Hubs: Hubs Scorecard]]

'''(Week of 7/11)'''

1) We published the twitter count on mechanical turk and received results.

2) We have audited the results and updated the amazon.

3) We are creating additional potential turks on the amazon site (See [[Hubs: Hubs Scorecard]])

4) We are finding more potential hubs from members of international national business innovation association

'''(Week of 7/4)'''

1) We have created the list and commented our thoughts after ---. For determining the variables, we have separated the list into two parts: a list of desired variables and ones that were previously collected, many of which are desired variables.

2) We have also created an example of how to write mechanical turks for collecting certain variables

==Variables to be Used==

Old variable list (see Hubs Data.xls) contains 18+3 variables. Overlap with new variable list is ~50%

===Current Complete List===
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

===Grouping of Variables===
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Twitter Activity
#URL
#Address
#Mission Statement
#Specific Industry
#Nonprofit
#Sponsors/Partners
#Price for a space + office
#Founding Date

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

=====General Approach Group 4=====
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

Hubs: Hubs Scorecard

2016-09-02T19:38:24Z

ArielSun:

=Hubs Pages=
*The main page for Hubs scorecard can be found: [[Hubs Scorecard (Academic Paper)]]
*For a tracker of work in progress for the dataset building for the scorecard go to [[Hubs: Hubs Data Building]]
*For a high-level overview of the variables for the scorecard go to [[Hubs: Hubs Data]]

=Background=
This page represents the work used for creating the hubs data for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

Our goal is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs (Complete)
##<code>E:\McNair\Projects\Hubs\Raw Program List</code> Contains 600 entities - vast majority are firmly not hubs (file pedigree unknown)
##<code>E:\McNair\Projects\Hubs\Hubs Data</code> - Contains 125 entities - many are not hubs (overlap with above file unknown, this file's pedigree from old Hubs project).
#Determining the best variables for the scorecard (Complete)
#Building '''"filters"''' for automating the collection (Complete)
#'''Running''' and '''auditing''' of the automation (In Progress)
#*See section 4.2
#Collecting the remaining manual data (next step)

=Variables to be Used=

Old variable list (see Hubs Data.xls) contains 18+3 variables. Overlap with new variable list is ~50%

==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Twitter Activity
#URL
#Address
#Mission Statement
#Specific Industry
#Nonprofit
#Sponsors/Partners
#Price for a space + office
#Founding Date

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

=====General Approach Group 4=====
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

=Steps Needed to Complete=
#Create Processes for Collecting Data
#*Status (7/27): Complete
#Have a comprehensive list of potential hubs
#*Status (7/27): Complete
#Test processes and audit
#*Status (7/27): In Progress (see section:)
#Fill in Remaining Data Manually
#*Status (7/27): NS

==How to Code the Variables==
===Group 1===
#Twitter Activity
#*'''UPDATE (7/20)''': Gunny has created a tool to do this process
#URL
#*'''UPDATE (7/22)''': Veeral has code to do this procedure (search company, city in google)
#Address
#*'''UPDATE (7/22)''': Code written. Difficulties occur with very large companies (e.g. Impact Hub). Will require Veeral's program, expected time for each assignment is 10-20 seconds - pay rate, therefore, recommended $.05
#*'''CODE'''
#*#Using Veeral's code, crossproduct allintext: (Group A) and site: (Group B), where '''Group A'''=Contact (high coverage), About Us, Find Us, Locations, Address, '''Group B'''= Company URLs.
#Mission Statement
#*'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (allintext: About/Mission site: from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Specific Industry
#*'''UPDATE (7/21)''': Given that most companies include their specialty in mission statement and difficulty to turk, we will manually check each mission statement and mark it accordingly.
#Nonprofit
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#Sponsors/Partners
#**'''UPDATE (7/21)''': Code written, but may require additional manual work. Expected time to complete is 45 seconds due to a potential list of a lot of sponsors/partners - pay rate, therefore, recommended $.12.
#*'''CODE'''
#*#Choose first result from Search Text 1 and Search Text 2 (allintext: Sponsors/Partnerrs site:URL)
#*#Record all Sponsors from Search Text 1 into SPONSORS. If there does not exist a list or the link was for only 1 sponsor, record DNE.
#*#If any Sponsors from Search Text 1 include a University or College (will be listed in name), record them into UNIVERSITY SPONSORS
#Price for a space + office
#*'''CODE 1 of 2'''
#*#Go to company’s URL
#*#On the homepage, look for the section related to pricing. If pricing is not found in the homepage, look for the links ‘coworking’, ‘work space’, ‘membership’, ‘pricing’ ,‘join’ or ‘Apply for membership’ , and look for the pricing information under those links. If there is no price related section, record DNE for both ‘Flexible Desk’ and ‘Dedicated Desk’.
#*#If there is pricing information, look for the price of sharing space per month, often denoted as Shared/Flexible desk/non-dedicated desk, record the price at ‘Flexible Desk’. If the price is not found, record DNE.
#*#Look for the price of a dedicated desk per month, often denoted as Reserved/dedicated desk/private desk record the price at ‘Dedicated Desk’. If the price is not found, record DNE.
#*#If price information is not found and there is a ‘locations’ link, click on it and choose the first location of the list. Repeat step 3 -4.
#*'''CODE 2 of 2'''
#*#Keywords: 24/7 access, dedicated desk, pricing
#*#Google allintext:"keywords" site:URL
#*#TBD
#Founding Date
#**'''UPDATE (7/21)''': Difficulties observed when figuring out how to Turk this, have solution (whois.net)

===Group 2===
#Size (SQFT)
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose first result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively
#Size (# Companies)
#*'''BRAINSTORM''': (7/22) Some companies don’t list all members but only selective ones. Some companies do not separate current members and alumni and goes like:"we have served more than 120 startups..."
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for the link 'Members' or 'Residents', usually they are under the links 'Community', 'Membership', 'Our Space' or 'The Space'.
#*#Count the number of members
#*#If the link or section of 'Members' is not found, go the 'Community' and 'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.
#*#If number of members cannot be identified using above steps, record DNE.
#*'''CODE 2 of 2'''
#*#Search allintitle:"Members/Startups/Residents/Villagers/Ventures" site:URL in Google.
#*#If no result found, record DNE.
#*#If there are results, go to the first result which is usually in the form like"Members - Company Name".
#*#If the result direct you to a page that lists the members of the company, count the number of companies and record the number.
#*#If the result direct you to a page that does not give information on number of members, record DNE.

===Group 3===
#Mentors
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text (Mentor/Mentorship) into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#**'''UPDATE (7/21)''': Code written - 2nd part, while more manual, appears to have greater range. 2nd code would only require Veeral's code. 1st code expected completion time is 30 seconds.
#*'''CODE 1 of 2'''
#*#Go to company's URL
#*#Look for the link 'Accelerators' or 'Accelerating/Accelerator/Acceleration/Accelerate Programs'
#*#If accelerators are found, count the number of accelerators/accelerating programs and record the number. **or also copy the names of the accelerators?
#*#If accelerators are not found in step 1, go to the links 'Services' , 'Benefit', 'Resources', 'For Entrepreneurs', 'Startups' and look for the section of 'Accelerator/Accelerating Programs'
#*#If accelerators are found, count the number of accelerators/accelerating programs and record the number.
#*#If accelerators are not found, record 0.
#*'''CODE 2 of 2'''
#*#Search [allintitle:"accelerator"/"accelerate" site:URL] in Google
#*#Copy the titles of the results. **We have to scrutinize the titles ourselves to determine whether they are distinct onsite accelerators and record the number manually.
#*#If no result appears, record 0.

===Group 4===
'''Curriculum and Code School'''

'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Cultivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
**'''Search Text''': Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
*'''TBD points'''
*'''Potential Turks'''
**'''Search Text 1''': website design, coding, web development, software, bootcamp
**'''Search Text 2''': General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Onsite OH Investors v. Mentors'''
*'''Potential Turks''':
#Search allintext:"office hours" site:URL
#Mark ''office hours'' as 1 if there is a result, otherwise mark as 0.
#Click on the first five results
#On each of the five pages, search for two items:
##search for 'mentor'. (Ctrl + F) If 'mentor' appears in the description paragraph of office hours on any of the five pages, mark ''mentor OH'' as 1. Otherwise mark as DNE and copy the description paragraph of office hours of all five pages.
##search for 'fund'. (Ctrl + F) If 'fund' appears in the description paragraph of office hours on any of the five pages, mark ''investor OH'' as 1. Otherwise mark as DNE and copy the description paragraph of office hours of all five pages.

'''Onsite temporary workshops v. networking events'''
*'''Turk for Both 1 of 2''':
*#Search the Search Text 1 (allintext: events site: URL) and choose link to "Events", "Calendar", or related. Record 'url' on SOURCE If this does not exist, go to Step 7
*#For all events that have dates, copy the events from today's date to the following month into ALL EVENTS
*#For all events that have Office Hours in the name, record the events in OFFICE HOURS. For all events that have summit, record the events in SUMMITS.
*#For all events that are related to teaching or learning (e.g. contain "Training," "Seminar," "Class," "Learn," "Bootcamp," "Workshop," "Pitch Event", copy the name of the events into WORKSHOPS
*#For all events that are related to scoial activities and networking (e.g. "Social," "Meet Up," "Breakfast"/"Lunch"/"Happy Hour", "Movie Night"/"Bowling"), copy the name of the events into NETWORKING. For all events that are unclear or did not fit into these descriptions
*#If a message explicity says there are no events, mark as 0 for ALL EVENTS, OFFICE HOURS, SUMMITS, WORKSHOPS, and NETWORKING
*#If this does not exist, search Search Text 2 (allintext: Company Name site: meetup.com) and click on the meetup.com for the company if it exists. If it does exist, record meetup on SOURCE. If not, go to step 9.
*#Repeat Steps 2-6.
*#If this does not exist, search Search Text 3 (allintext: Company Name site: eventbrite.com) and click on the eventbrite.com for the company if it exists. If it does exist, record eventbrite on SOURCE. If not, mark DNE for all variables.
*#Repeat Steps 2-6.

*'''Turk for Both 2 of 2''':
#Go to Company URL
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events from today's date to next months and record it in ALL EVENTS. If there is no information of events or dates of the events on the website, record DNE for all variables.
#For all events that have Office Hours in the name, count the number of events in OFFICE HOURS. For all events that have summit, count the number of the events in SUMMITS.
#For all events that are related to teaching or learning (e.g. contain "Training," "Seminar," "Class," "Learn," "Bootcamp," "Workshop," "Pitch Event", count the number of the events into WORKSHOPS
#For all events that are related to scoial activities and networking (e.g. "Social," "Meet Up," "Breakfast"/"Lunch"/"Happy Hour", "Movie Night"/"Bowling"), count the number of the events into NETWORKING

'''Onsite VC v. Angel Investors'''
*Notes: Few companies have a section for their onsite VCs or angel investors. Even the company(Innovation Pavilion) that has Angel programs and VC programs does not conduct the programs by itself, but cooperate with external angel investors or VCs. Some companies have mentors or board members who are from VCs, but it does not mean they will invest in the member startups in those companies.

===Group 5===
#Multiple Locations
#*Addresses are included in Group 1, but still needs to be discussed
#*Getting

==Generating the Data==
All files can be found in the E:/Mcnair/Projects/Hubs/Searching
Recommended to select the CSV and Excel worksheets because there are many JSON files

There are generally '''6''' steps we need to do for each variable when creating the data table:
*A good reference for this procedure is in the folder Address
#Run Veeral's Code on your search terms
#*A list of Companies Can be found in the file 'List of Companies'
#*Recommended to have the search file sorted by company (e.g. if searching 3 companies (A,B,C) with 2 search terms (S,T), recommend having your list as: A-S,A-T,B-S,etc.)
#*'''Procedure'''
#*# (Ariel or Veeral To Write)
#Check to see if output results are working properly
#*Recommend to do alt-d-f-f and choose only 1 and 2
#*Check at least 10 different companies and ensure desired result is in the results
#Clean table and format for Mechanical Turk
#*Ensure that mechanical turks are not getting error terms
#*We will likely use 1 row for each company and have specific headers that will allow for the inputs to be automatically populated (see [[Mechanical Turk (Tool)]]
#*You should also check to see if we need to find results manually
#Write the Turk on Amazon
#*See [[Mechanical Turk (Tool)]]
#Run and audit the Turk
#*Randomly choose ~30 companies (can use the above) and compare results with the Turkers
#*Check for AT LEAST the following:
#**% similar to manual
#**DNEs
#Post Results in [[Hubs: Hubs Data Building]]

=Completed Work=
See Section 3 of [[Hubs (Academic Paper)]]

Hubs Scorecard (Academic Paper)

2016-09-02T19:37:09Z

ArielSun: /* Work in Progress */

{{McNair Projects
|Project Title=Hubs Scorecard(Academic Paper)
|Topic Area=Entrepreneurship Ecosystems
|Owner=Todd Rachowin, Ariel Sun
|Start Term=Summer 2016
|Status=Active
|Deliverable=Academic Paper
|Audience=Academics
|Keywords=Hubs, Incubators, Accelerators, Venture, Capital, Angel, Investor, Startups
|Primary Billing=AccNBER01
}}

=Abstract=
As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

=Work in Progress=
Our goal is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs (Complete)
#Determining the best variables for the scorecard (Complete)
#Building '''"filters"''' for automating the collection (Complete)
#'''Running''' and '''auditing''' of the automation (In Progress)
#Collecting the remaining manual data (next step)

*For the detailed current work in progress for building the Hubs datasheet for the scorecard go to: [[Hubs: Hubs Scorecard]]
*For a tracker of work in progress for the dataset building for the scorecard go to [[Hubs: Hubs Data Building]]
*For a high-level overview of the variables for the scorecard go to [[Hubs: Hubs Data]]
*For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].
*Comprehensive list of potential hubs can be found at:
##<code>E:\McNair\Projects\Hubs\Raw Program List</code> Contains 600 entities - vast majority are firmly not hubs (file pedigree unknown)
##<code>E:\McNair\Projects\Hubs\Hubs Data</code> - Contains 125 entities - many are not hubs (overlap with above file unknown, this file's pedigree from old Hubs project).

==Variables to be Used==

Old variable list (see Hubs Data.xls) contains 18+3 variables. Overlap with new variable list is ~50%

===Current Complete List===
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

===Grouping of Variables===
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Twitter Activity
#URL
#Address
#Mission Statement
#Specific Industry
#Nonprofit
#Sponsors/Partners
#Price for a space + office
#Founding Date

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

=====General Approach Group 4=====
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

Hubs Scorecard (Academic Paper)

2016-09-02T19:36:31Z

ArielSun:

{{McNair Projects
|Project Title=Hubs Scorecard(Academic Paper)
|Topic Area=Entrepreneurship Ecosystems
|Owner=Todd Rachowin, Ariel Sun
|Start Term=Summer 2016
|Status=Active
|Deliverable=Academic Paper
|Audience=Academics
|Keywords=Hubs, Incubators, Accelerators, Venture, Capital, Angel, Investor, Startups
|Primary Billing=AccNBER01
}}

=Abstract=
As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

=Work in Progress=
Our goal is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs (Complete)
#Determining the best variables for the scorecard (Complete)
#Building '''"filters"''' for automating the collection (Complete)
#'''Running''' and '''auditing''' of the automation (In Progress)
#Collecting the remaining manual data (next step)

*For the current work in progress for building the Hubs datasheet for the scorecard go to: [[Hubs: Hubs Scorecard]]
*For a tracker of work in progress for the dataset building for the scorecard go to [[Hubs: Hubs Data Building]]
*For a high-level overview of the variables for the scorecard go to [[Hubs: Hubs Data]]
*For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].
*Comprehensive list of potential hubs can be found at:
##<code>E:\McNair\Projects\Hubs\Raw Program List</code> Contains 600 entities - vast majority are firmly not hubs (file pedigree unknown)
##<code>E:\McNair\Projects\Hubs\Hubs Data</code> - Contains 125 entities - many are not hubs (overlap with above file unknown, this file's pedigree from old Hubs project).

==Variables to be Used==

Old variable list (see Hubs Data.xls) contains 18+3 variables. Overlap with new variable list is ~50%

===Current Complete List===
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

===Grouping of Variables===
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Twitter Activity
#URL
#Address
#Mission Statement
#Specific Industry
#Nonprofit
#Sponsors/Partners
#Price for a space + office
#Founding Date

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

=====General Approach Group 4=====
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

Hubs Scorecard (Academic Paper)

2016-09-02T19:32:32Z

ArielSun:

Hubs Scorecard (Academic Paper)

2016-09-02T19:30:35Z

ArielSun: Created page with "{{McNair Projects |Project Title=Hubs Scorecard(Academic Paper) |Topic Area=Entrepreneurship Ecosystems |Owner=Todd Rachowin, Ariel Sun |Start Term=Summer 2016 |Status=Active..."

Work Hours

2016-08-31T19:20:13Z

ArielSun:

Please complete your preferred times for the Fall term of 2015 below.

{| class="wikitable sortable" style="border: 1px solid darkgray; bgcolor: #f9f9f9"
| align="center" style="background:#f0f0f0;"|'''Name'''
| align="center" style="background:#f0f0f0;"|'''Mon'''
| align="center" style="background:#f0f0f0;"|'''Tues'''
| align="center" style="background:#f0f0f0;"|'''Wed'''
| align="center" style="background:#f0f0f0;"|'''Thurs'''
| align="center" style="background:#f0f0f0;"|'''Fri'''
|-
| Albert Nabiullin||||||3-4:30||12:30-3||3-4:30
|-
| Amir Kazempour||||||||||
|-
| Ariel Sun||11-12, 1:15-2:45||||11-12, 1:15-2:45||||11-12, 1:15-2:45
|-
| Ben Baldazo||||||||||
|-
| Carlin Cherry||||||3-5:00||2:30-4||
|-
| Dylan Dickens||1-5:00||||||||
|-
| Harsh Upadhyay||3-5:30||3-5:30||3-5:30||3-5:30||3-5:30
|-
| Jake Silberman||||||||||
|-
| James Chen||||||||||
|-
| Julia Wang||||||1-4:30||||1-4:00
|-
| Marcela Interiano||||||||||
|-
| Meghana Gaur||||||||||
|-
| Ramee Saleh||||||3-5:00||3-5:00||3-5:00
|-
| Ravali Kruthiventi||3-6||||3-6||||3-6
|-
| Todd Rachowin||||||||||
|-
| Veeral Shah||12:30-2:30||||||||12:30-2:30
|-
| Will Cleland||||12:30-4||||12:30-4||2-5:00
|}

[[Category: McNair Admin]]
[[admin_classification::Admin| ]]

Hubs: Hubs Data

2016-07-29T22:51:08Z

ArielSun: /* List of Variables */

=Hubs Pages=
*The main page for Hubs can be found: [[Hubs (Academic Paper)]]
*For the current work in progress for building the Hubs datasheet for the scorecard go to: [[Hubs: Hubs Scorecard]]
*For a tracker of work in progress for the dataset building for the scorecard go to [[Hubs: Hubs Data Building]]
*For a high-level overview of the variables for the scorecard go to [[Hubs: Hubs Data]]

=List of Variables=
For a more in-depth of the variables and procedure please see: [[Hubs: Hubs Scorecard]]. This page will reflect the variables being collected separated into three categories. Each variable will include a breakdown of levels being collected if the definition is not trivial and an approximate approach.

'''07/29''' Ariel: code Hubs variable for Hubs E:/McNair/Projects/Hubs/Hubs Variable-Ariel

'''As of Week of 7/25'''
===Group 1===
'''Variables Difficult to Obtain'''
#'''Founding Date''' ''(date_founded)''
#*''' ''Difficulty:'' ''' Finding date based on our strategies
#*''' ''New Approach:'' '''
#*#Whois.net Date
#*#Factavia/other press release searches
#'''Multiple locations within city + Franchise''' (as of now just addresses) ''(multi_address)''
#*''' ''Difficulty:'' ''' Company or establishment level will impact measurements
#*''' ''New Approach:'' ''' Will record all addresses at company level
#'''Onsite Venture Capital v. Angel Investors''' (e.g. # and Assets Under Management) ''(onsite_Vc_bin)/(onsite_vc_list)'' ''(onsite_angel_bin)/etc.''
#*''' ''Levels:'' ''' Binary, list of investors
#*''' ''Difficulty:'' ''' Hub website usually does not include investors
#*''' ''New Approach:'' '''
#*#Google key terms with address of Hub
#*#Start with partners and use google/crunchbase

===Group 2===
'''Variables Comfortable, Not Complete''' (rough order of most difficult to least difficult)
#'''Onsite accelerator''' ''(onsite_accel_bin)/(onsite_accel_cnt)/(onsite_accel_list)''
#*''' ''Levels:'' ''' Binary, count, list
#*''' ''Difficulty:'' ''' Usually not a list, which requires more scrubbing as many other variables just require us to find one page on a website.
#*''' ''Approach:'' '''
#*#Google searches and procedure to use on website yields decent results
#*#Similar procedure to onsite investors
#'''Size (# members)''' ''(num_members)''
#*''' ''Levels:'' ''' Count for companies (currently not planning to include list of companies given that some potential hubs have 200+ members)
#*''' ''Difficulty:'' ''' Some companies don’t list all members - only selective ones-, others do not separate current members and alumni, and some just write "we have served more than 120 startups..."
#*''' ''Approach:'' ''' For companies that have a list, we will count. For those with select members, we will count those they listed and try to see if there is a comment about how many they have. For those that just have a statement "with over," we will write the number and + (e.g. "120+).
#'''Office hours investors''' and '''Office hours mentor/advisors''' ''(OH_bin)/(OH_inv_bin)/(OH_inv_list)/etc.''
#*''' ''Levels:'' ''' Binary for OH, binary for two separate OH, list of names/descriptions of OH
#*''' ''Difficulty:'' ''' Some companies do not list who OH are with, not always obvious if investor, mentor, or advisor, sometimes not clear if mentor is investor/future investor
#*''' ''Approach:'' ''' Google approach to get to OH pages and then lookup key words in description to separate out
#'''Onsite temporary workshops and Networking Meetups''' (Count) ''(onsite_temp_events_bin)/(onsite_temp_workshop_bin)/(onsite_temp_workshop_cnt)/etc.''
#*''' ''Levels:'' ''' Binary for do they exist, count for each
#*''' ''Difficulty:'' ''' Difficult for Turkers to differentiate between these two and also other potential events (e.g. symposiums)
#*''' ''Approach:'' ''' Uses key search terms (e.g. Java/etc.) to separate out workshops and key terms (e.g. lunch/happy hour) for networking meetings
#'''Onsite code school''' and '''Curriculum''' ''(onsite_long_term_courses)/(onsite_code_school_bin)''
#*''' ''Levels:'' ''' Binary for do they exist, binary for each
#*''' ''Difficulty:'' ''' Difficult for Turkers to differentiate between long-term coding programs for individuals and curriculum for startups
#*''' ''Approach:'' ''' Uses key search terms (e.g. specific code schools) to separate out known code schools and also to look into key terms (e.g. leadership) for curriculum
#'''Sponsors/Partners''' (University, Corporate) ''(sponsors_cnt)/(sponsors_list)/etc.''
#*''' ''Levels:'' ''' Count, list of sponsors/partners (if exist), separate columns for university and corporate
#*''' ''Difficulty:'' ''' Not all companies will list sponsors, partnesrs, or either. Not always clear the difference among sponsors, partners, investors.
#*''' ''Approach:'' ''' Use two different levels and use of google search, then if list exists, separate by "college"/"university" and rest
#'''Alumni Network''' ''(alumni_bin)/(alumni_list)''
#*''' ''Levels:'' ''' Binary, list
#*''' ''Difficulty:'' ''' Not all companies list alumni, some only list "selected"
#*''' ''Approach:'' ''' Include all that have lists
#'''Size (sqft)''' ''(size_sqft)''
#*''' ''Levels:'' ''' Number in sqft
#*''' ''Difficulty:'' ''' Not all companies list square feet online
#*''' ''Approach:'' '''
#*#Google search with key words
#*#If results do not appear, use of press releases is possible
#'''Onsite Mentors''' ''(onsite_mentors_bin)/(onsite_mentors_cnt)/(onsite_mentors_list)''
#*''' ''Levels:'' ''' Count and list of mentors (if exist)
#*''' ''Difficulty:'' ''' Not all companies list mentors - bigger issue is onsite investors
#*''' ''Approach:'' ''' Use two different levels and use of google search

===Group 3===
'''Variables Easy to Obtain'''
#'''Twitter activity''' ''(twit_handle)/(twit_prev_mon_cnt_tweets)/(twit_cnt_followers)/(twit_cnt_retweets)''
#*''' ''Levels:'' ''' Twitter Handle, # Tweets in a Month, # Followers, # Retweets
#*''' ''Approach:'' ''' Easy to get twitter handle from Turk or Veeral's code that allows us to run a series of searches on google and then use Gunny's Twitter crawler to get other levels from handle
#'''Site URL''' ''(url)''
#*''' ''Levels:'' ''' URL
#*''' ''Approach:'' ''' Google using Veeral's code that allows us to search
#''' ''Whois Date'' ''' ''(date_whois)''
#*''' ''Levels:'' ''' Date
#*''' ''Approach:'' ''' Date active website was registered
#'''Address''' ''(address)''
#*''' ''Levels:'' ''' Will include all addresses
#*''' ''Approach:'' ''' Google key terms (e.g. Contact Us) and URL using Veeral's code
#'''Nonprofit status''' ''(nonprofit_binary)''
#*''' ''Levels:'' ''' Binary variable indicating if the potential Hub is a nonprofit organization
#*''' ''Approach:'' ''' http://www.guidestar.org/ is a site that we can use to search if a company is nonprofit or not
#'''Mission statement''' ''(missions_stmt)''
#*''' ''Levels:'' ''' Official mission statement or description of company (if mission does not exist)
#*''' ''Approach:'' ''' If not explicitly stated mission statement, will include "About" or statements on main page
#'''Specific Industry''' ''(spec_industry)''
#*''' ''Levels:'' ''' Industry included in statement (no aggregation)
#*''' ''Approach:'' ''' *Based on Mission Statement, not aggregated
#'''Price for a space/office''' ''(price_space)''
#*''' ''Levels:'' ''' Two prices one for shared, other for private
#*''' ''Approach:'' ''' Uses google methodology with key terms and URL

Hubs: Hubs Data

2016-07-29T22:50:36Z

ArielSun: /* List of Variables */

=Hubs Pages=
*The main page for Hubs can be found: [[Hubs (Academic Paper)]]
*For the current work in progress for building the Hubs datasheet for the scorecard go to: [[Hubs: Hubs Scorecard]]
*For a tracker of work in progress for the dataset building for the scorecard go to [[Hubs: Hubs Data Building]]
*For a high-level overview of the variables for the scorecard go to [[Hubs: Hubs Data]]

=List of Variables=
For a more in-depth of the variables and procedure please see: [[Hubs: Hubs Scorecard]]. This page will reflect the variables being collected separated into three categories. Each variable will include a breakdown of levels being collected if the definition is not trivial and an approximate approach.

'''07/29''' Ariel E:/McNair/Projects/Hubs/Hubs Variale-Ariel

'''As of Week of 7/25'''
===Group 1===
'''Variables Difficult to Obtain'''
#'''Founding Date''' ''(date_founded)''
#*''' ''Difficulty:'' ''' Finding date based on our strategies
#*''' ''New Approach:'' '''
#*#Whois.net Date
#*#Factavia/other press release searches
#'''Multiple locations within city + Franchise''' (as of now just addresses) ''(multi_address)''
#*''' ''Difficulty:'' ''' Company or establishment level will impact measurements
#*''' ''New Approach:'' ''' Will record all addresses at company level
#'''Onsite Venture Capital v. Angel Investors''' (e.g. # and Assets Under Management) ''(onsite_Vc_bin)/(onsite_vc_list)'' ''(onsite_angel_bin)/etc.''
#*''' ''Levels:'' ''' Binary, list of investors
#*''' ''Difficulty:'' ''' Hub website usually does not include investors
#*''' ''New Approach:'' '''
#*#Google key terms with address of Hub
#*#Start with partners and use google/crunchbase

===Group 2===
'''Variables Comfortable, Not Complete''' (rough order of most difficult to least difficult)
#'''Onsite accelerator''' ''(onsite_accel_bin)/(onsite_accel_cnt)/(onsite_accel_list)''
#*''' ''Levels:'' ''' Binary, count, list
#*''' ''Difficulty:'' ''' Usually not a list, which requires more scrubbing as many other variables just require us to find one page on a website.
#*''' ''Approach:'' '''
#*#Google searches and procedure to use on website yields decent results
#*#Similar procedure to onsite investors
#'''Size (# members)''' ''(num_members)''
#*''' ''Levels:'' ''' Count for companies (currently not planning to include list of companies given that some potential hubs have 200+ members)
#*''' ''Difficulty:'' ''' Some companies don’t list all members - only selective ones-, others do not separate current members and alumni, and some just write "we have served more than 120 startups..."
#*''' ''Approach:'' ''' For companies that have a list, we will count. For those with select members, we will count those they listed and try to see if there is a comment about how many they have. For those that just have a statement "with over," we will write the number and + (e.g. "120+).
#'''Office hours investors''' and '''Office hours mentor/advisors''' ''(OH_bin)/(OH_inv_bin)/(OH_inv_list)/etc.''
#*''' ''Levels:'' ''' Binary for OH, binary for two separate OH, list of names/descriptions of OH
#*''' ''Difficulty:'' ''' Some companies do not list who OH are with, not always obvious if investor, mentor, or advisor, sometimes not clear if mentor is investor/future investor
#*''' ''Approach:'' ''' Google approach to get to OH pages and then lookup key words in description to separate out
#'''Onsite temporary workshops and Networking Meetups''' (Count) ''(onsite_temp_events_bin)/(onsite_temp_workshop_bin)/(onsite_temp_workshop_cnt)/etc.''
#*''' ''Levels:'' ''' Binary for do they exist, count for each
#*''' ''Difficulty:'' ''' Difficult for Turkers to differentiate between these two and also other potential events (e.g. symposiums)
#*''' ''Approach:'' ''' Uses key search terms (e.g. Java/etc.) to separate out workshops and key terms (e.g. lunch/happy hour) for networking meetings
#'''Onsite code school''' and '''Curriculum''' ''(onsite_long_term_courses)/(onsite_code_school_bin)''
#*''' ''Levels:'' ''' Binary for do they exist, binary for each
#*''' ''Difficulty:'' ''' Difficult for Turkers to differentiate between long-term coding programs for individuals and curriculum for startups
#*''' ''Approach:'' ''' Uses key search terms (e.g. specific code schools) to separate out known code schools and also to look into key terms (e.g. leadership) for curriculum
#'''Sponsors/Partners''' (University, Corporate) ''(sponsors_cnt)/(sponsors_list)/etc.''
#*''' ''Levels:'' ''' Count, list of sponsors/partners (if exist), separate columns for university and corporate
#*''' ''Difficulty:'' ''' Not all companies will list sponsors, partnesrs, or either. Not always clear the difference among sponsors, partners, investors.
#*''' ''Approach:'' ''' Use two different levels and use of google search, then if list exists, separate by "college"/"university" and rest
#'''Alumni Network''' ''(alumni_bin)/(alumni_list)''
#*''' ''Levels:'' ''' Binary, list
#*''' ''Difficulty:'' ''' Not all companies list alumni, some only list "selected"
#*''' ''Approach:'' ''' Include all that have lists
#'''Size (sqft)''' ''(size_sqft)''
#*''' ''Levels:'' ''' Number in sqft
#*''' ''Difficulty:'' ''' Not all companies list square feet online
#*''' ''Approach:'' '''
#*#Google search with key words
#*#If results do not appear, use of press releases is possible
#'''Onsite Mentors''' ''(onsite_mentors_bin)/(onsite_mentors_cnt)/(onsite_mentors_list)''
#*''' ''Levels:'' ''' Count and list of mentors (if exist)
#*''' ''Difficulty:'' ''' Not all companies list mentors - bigger issue is onsite investors
#*''' ''Approach:'' ''' Use two different levels and use of google search

===Group 3===
'''Variables Easy to Obtain'''
#'''Twitter activity''' ''(twit_handle)/(twit_prev_mon_cnt_tweets)/(twit_cnt_followers)/(twit_cnt_retweets)''
#*''' ''Levels:'' ''' Twitter Handle, # Tweets in a Month, # Followers, # Retweets
#*''' ''Approach:'' ''' Easy to get twitter handle from Turk or Veeral's code that allows us to run a series of searches on google and then use Gunny's Twitter crawler to get other levels from handle
#'''Site URL''' ''(url)''
#*''' ''Levels:'' ''' URL
#*''' ''Approach:'' ''' Google using Veeral's code that allows us to search
#''' ''Whois Date'' ''' ''(date_whois)''
#*''' ''Levels:'' ''' Date
#*''' ''Approach:'' ''' Date active website was registered
#'''Address''' ''(address)''
#*''' ''Levels:'' ''' Will include all addresses
#*''' ''Approach:'' ''' Google key terms (e.g. Contact Us) and URL using Veeral's code
#'''Nonprofit status''' ''(nonprofit_binary)''
#*''' ''Levels:'' ''' Binary variable indicating if the potential Hub is a nonprofit organization
#*''' ''Approach:'' ''' http://www.guidestar.org/ is a site that we can use to search if a company is nonprofit or not
#'''Mission statement''' ''(missions_stmt)''
#*''' ''Levels:'' ''' Official mission statement or description of company (if mission does not exist)
#*''' ''Approach:'' ''' If not explicitly stated mission statement, will include "About" or statements on main page
#'''Specific Industry''' ''(spec_industry)''
#*''' ''Levels:'' ''' Industry included in statement (no aggregation)
#*''' ''Approach:'' ''' *Based on Mission Statement, not aggregated
#'''Price for a space/office''' ''(price_space)''
#*''' ''Levels:'' ''' Two prices one for shared, other for private
#*''' ''Approach:'' ''' Uses google methodology with key terms and URL

Ariel Sun (Work Log)

2016-07-29T22:48:07Z

ArielSun:

Hubs: Hubs Data Building

2016-07-26T21:38:03Z

ArielSun:

==Variables==
Procedure copy the below for each variable being worked on:

#'''(URL)'''
#**'''STATUS''': Complete
#**'''Previously Collected''': Yes
#**'''Published on Mechanical Turk''': No
#**'''Audited''': NA
#***Audit Results: NA
#***#:
#**'''Updates''': The file is saved at E:/McNair/Projects/Hubs/Searching/URLs.csv
#'''(Address)'''
#**'''STATUS''': In Progress
#**'''Previously Collected''': No
#**'''Published on Mechanical Turk''': No
#**'''Audited''': No
#***Audit Results:
#***#:
#**'''Updates''': The file ready for Turk is saved at E:/McNair/Projects/Hubs/Mechanical Turk/Address.csv
#'''(Mission/About)'''
#**'''STATUS''': In Progress
#**'''Previously Collected''': Yes
#**'''Published on Mechanical Turk''': No
#**'''Audited''': No
#***Audit Results:
#***#:
#**'''Updates''': The file ready for Turk is saved at E:/McNair/Projects/Hubs/Mechanical Turk/Mission.csv

Hubs: Hubs Data Building

2016-07-26T21:37:22Z

ArielSun: /* Variables */

==Variables==
Procedure copy the below for each variable being worked on:

#'''(URL)'''
#**'''STATUS''': Complete
#**'''Previously Collected''': Yes
#**'''Published on Mechanical Turk''': No
#**'''Audited''': NA
#***Audit Results: NA
#***#:
#**'''Updates''': The file is saved at E:/McNair/Projects/Hubs/Searching/URLs.csv
#'''(Address)'''
#**'''STATUS''': In Progress
#**'''Previously Collected''': No
#**'''Published on Mechanical Turk''': No
#**'''Audited''': No
#***Audit Results:
#***#:
#**'''Updates''': The file ready for Turk is saved at E:/McNair/Projects/Hubs/Mechanical Turk/Address.csv
#'''(Mission/About)'''
#**'''STATUS''': In Progress
#**'''Previously Collected''': Yes
#**'''Published on Mechanical Turk''': No
#**'''Audited''': No
#***Audit Results:
#***#:
#**'''Updates''': The file is saved at E:/McNair/Projects/Hubs/Mechanical Turk/Mission.csv

Ariel Sun (Work Log)

2016-07-22T21:49:59Z

ArielSun:

Hubs: Hubs Data

2016-07-22T21:42:54Z

ArielSun: /* Onsite VC v. Angel Investors */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Twitter Activity
#URL
#Address
#Mission Statement
#Specific Industry
#Nonprofit
#Sponsors/Partners
#Price for a space + office
#Founding Date

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/21): G/Y: Founding date, size (members) issues
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/21): G/Y: much progress has been made, but issues with onsite venture capitalists/angel investors
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Have a comprehensive list of potential hubs
#*Status (7/21): Hannah working on this
#Test processes and audit
#*Status (7/21): NS
#*Begin Date: TBD
#*Reach Goal: TBD
#Fill in Remaining Data Manually
#*Status (7/21): NS
#*Begin Date: TBD
#*Reach Goal: TBD

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/20)''': Gunny has created a tool to do this process
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE''' (7/14)
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO/No Need (Veeral)
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/22)''': Veeral has code to do this procedure
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format ___.__/ (e.g. if url is example.us/other, record example.us/)
#Address
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/22)''': Code written. Difficulties occur with very large companies (e.g. Impact Hub). Will require Veeral's program, expected time for each assignment is 10-20 seconds - pay rate, therefore, recommended $.05
#*'''CODE'''
#*#Using Veeral's code, crossproduct allintext: (Group A) and site: (Group B), where '''Group A'''=Contact (high coverage), About Us, Find Us, Locations, Address, '''Group B'''= Company URLs.
#*#Click on first result. If addresses exist, record in ADDRESS, STATE, and ZIP.
#*#If not, go to company's URL. If addresses exist, record in ADDRESS, STATE, and ZIP.
#*#If address exists, but ZIP does not, plug in address into search engine and record ZIP.
#*#Otherwise, record DNE.
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (allintext: About/Mission site: from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Specific Industry
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Given that most companies include their specialty in mission statement and difficulty to turk, we will manually check each mission statement and mark it accordingly.
#*'''CODE'''
#*#NONE
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Sponsors/Partners
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Code written, but may require additional manual work. Expected time to complete is 45 seconds due to a potential list of a lot of sponsors/partners - pay rate, therefore, recommended $.12.
#*'''CODE'''
#*#Choose first result from Search Text 1 and Search Text 2 (allintext: Sponsors/Partnerrs site:URL)
#*#Record all Sponsors from Search Text 1 into SPONSORS. If there does not exist a list or the link was for only 1 sponsor, record DNE.
#*#If any Sponsors from Search Text 1 include a University or College (will be listed in name), record them into UNIVERSITY SPONSORS
#*#Record all Partners from Search Text 2 into PARTNERS. If there does not exist a list or the link was for only 1 partner, record DNE.
#*#If any Partners from Search Text 2 include a University or College (will be listed in name), record them into UNIVERSITY PARTNERS
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/22)''': Code 1 written, code 2 need more work
#*'''CODE 1 of 2'''
#*#Go to company’s URL
#*#On the homepage, look for the section related to pricing. If pricing is not found in the homepage, look for the links ‘coworking’, ‘work space’, ‘membership’, ‘pricing’ ,‘join’ or ‘Apply for membership’ , and look for the pricing information under those links. If there is no price related section, record DNE for both ‘Flexible Desk’ and ‘Dedicated Desk’.
#*#If there is pricing information, look for the price of sharing space per month, often denoted as Shared/Flexible desk/non-dedicated desk, record the price at ‘Flexible Desk’. If the price is not found, record DNE.
#*#Look for the price of a dedicated desk per month, often denoted as Reserved/dedicated desk/private desk record the price at ‘Dedicated Desk’. If the price is not found, record DNE.
#*#If price information is not found and there is a ‘locations’ link, click on it and choose the first location of the list. Repeat step 3 -4.
#*'''CODE 2 of 2'''
#*#Keywords: 24/7 access, dedicated desk, pricing
#*#Google allintext:"keywords" site:URL
#*#TBD
#Founding Date
#*'''STATUS''': To Be Discussed Further
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Difficulties observed when figuring out how to Turk this
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size (SQFT)
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively
#Size (# Companies)
#*'''BRAINSTORM''': (7/22) Some companies don’t list all members but only selective ones. Some companies do not separate current members and alumni and goes like:"we have served more than 120 startups..."
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/22)''': Brainstorm and code updated (Capital Factory 227)
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for the link 'Members' or 'Residents', usually they are under the links 'Community', 'Membership', 'Our Space' or 'The Space'.
#*#Count the number of members
#*#If the link or section of 'Members' is not found, go the 'Community' and 'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.
#*#If number of members cannot be identified using above steps, record DNE.
#*'''CODE 2 of 2'''
#*#Search allintitle:"Members/Startups/Residents/Villagers/Ventures" site:URL in Google.
#*#If no result found, record DNE.
#*#If there are results, go to the first result which is usually in the form like"Members - Company Name".
#*#If the result direct you to a page that lists the members of the company, count the number of companies and record the number.
#*#If the result direct you to a page that does not give information on number of members, record DNE.

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text (Mentor/Mentorship) into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Code written - 2nd part, while more manual, appears to have greater range. 2nd code would only require Veeral's code. 1st code expected completion time is 30 seconds.
#*'''CODE 1 of 2'''
#*#Go to company's URL
#*#Look for the link 'Accelerators' or 'Accelerating/Accelerator/Acceleration/Accelerate Programs'
#*#If accelerators are found, count the number of accelerators/accelerating programs and record the number. **or also copy the names of the accelerators?
#*#If accelerators are not found in step 1, go to the links 'Services' , 'Benefit', 'Resources', 'For Entrepreneurs', 'Startups' and look for the section of 'Accelerator/Accelerating Programs'
#*#If accelerators are found, count the number of accelerators/accelerating programs and record the number.
#*#If accelerators are not found, record 0.
#*'''CODE 2 of 2'''
#*#Search [allintitle:"accelerator"/"accelerate" site:URL] in Google
#*#Copy the titles of the results. **We have to scrutinize the titles ourselves to determine whether they are distinct onsite accelerators and record the number manually.
#*#If no result appears, record 0.

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Cultivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
**'''Search Text''': Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
*'''TBD points'''
*'''Potential Turks'''
**'''Search Text 1''': website design, coding, web development, software, bootcamp
**'''Search Text 2''': General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite OH Investors v. mentors====
Thoughts (Ariel, 07/20):
The names listed on 'mentor' page/sections must all be mentors, and the same applies for investors/OH investors although few companies list their investors. So here the only thing we are trying to differentiate is whether the mentor is a investor. maybe via checking whether they are from a VC firm?? But even they are from VC companies doesn't mean they are going to invest on the startups of the Hubs they are mentoring on. Or another way to think about it is differentiating between mentors/OH mentors. Mentors tend to give the particular startups long term support and available when needed while OH mentors only gives advice on the spot.

'''Mentors'''

*'''Desc''':

*'''Characteristics''':
**Focus on improving entrepreneurial community through ongoing, recurring support
**Help and guide the startups on: business plans and models, management, development, execution, technology innovation, marketing, sales
**Common fields/occupations: founder/CEO of another company, business development, serial entrepreneur, marketing, sales, management consulting, technology and innovation, research professor etc.
**Some companies offer mentor office hours

*'''TBD Points''':

'''Investors'''

*'''Desc''':

*'''Characteristics''':
**Focus on investing on early stage or growth stage startups
**Usually from VC firms
**Common fields/ occupations: VC firm manager, VC firm partner, fund manager

*'''TBD Points''':

*'''Potential Turks''':
#Search allintext:"office hours" site:URL
#Mark ''office hours'' as 1 if there is a result, otherwise mark as 0.
#Click on the first five results
#On each of the five pages, search for two items:
##search for 'mentor'. (Ctrl + F) If 'mentor' appears in the description paragraph of office hours on any of the five pages, mark ''mentor OH'' as 1. Otherwise mark as DNE and copy the description paragraph of office hours of all five pages.
##search for 'fund'. (Ctrl + F) If 'fund' appears in the description paragraph of office hours on any of the five pages, mark ''investor OH'' as 1. Otherwise mark as DNE and copy the description paragraph of office hours of all five pages.

====Onsite temporary workshops v. networking events====
'''Temporary Workshops'''

*'''Desc''':

*'''Characteristics''':
**The purpose is learning and discussing
**Often have a specific topic: business issue (e.g. online marketing) or techniques learning (e.g. intro to Java script)
**In the forms of: workshop, class, panel, project, XX session, seminar, series, intro to XX
**Exception: tech meetup is usually a workshop(e.g. C++ programmer meetup, http://techranchaustin.com/events/)

*'''TBD Points''':
**Do we care about what particular workshops (e.g. coding, leadership, etc.)?
**Summits/major events

*'''Potential Turks''':
**See Turk for Both Below

'''Networking Events'''

*'''Desc''':

*'''Characteristics''':
**The purpose is to meet fellow entrepreneurs and experts and networking with them
**Focus on experience sharing or communication as opposed to discussing a specific topic or technical subject
**In the forms of: meetup, networking, happy hour, info session?, luncheon, XX night, socials, talks??, community XX

*'''TBD Points''':

*'''Potential Turks''':
**See Turk for Both Below

*'''Turk for Both 1 of 2''':
*#Search the Search Text 1 (allintext: events site: URL) and choose link to "Events", "Calendar", or related. Record 'url' on SOURCE If this does not exist, go to Step 7
*#For all events that have dates, copy the events from today's date to the following month into ALL EVENTS
*#For all events that have Office Hours in the name, record the events in OFFICE HOURS. For all events that have summit, record the events in SUMMITS.
*#For all events that are related to teaching or learning (e.g. contain "Training," "Seminar," "Class," "Learn," "Bootcamp," "Workshop," "Pitch Event", copy the name of the events into WORKSHOPS
*#For all events that are related to scoial activities and networking (e.g. "Social," "Meet Up," "Breakfast"/"Lunch"/"Happy Hour", "Movie Night"/"Bowling"), copy the name of the events into NETWORKING. For all events that are unclear or did not fit into these descriptions
*#If a message explicity says there are no events, mark as 0 for ALL EVENTS, OFFICE HOURS, SUMMITS, WORKSHOPS, and NETWORKING
*#If this does not exist, search Search Text 2 (allintext: Company Name site: meetup.com) and click on the meetup.com for the company if it exists. If it does exist, record meetup on SOURCE. If not, go to step 9.
*#Repeat Steps 2-6.
*#If this does not exist, search Search Text 3 (allintext: Company Name site: eventbrite.com) and click on the eventbrite.com for the company if it exists. If it does exist, record eventbrite on SOURCE. If not, mark DNE for all variables.
*#Repeat Steps 2-6.

*'''Turk for Both 2 of 2''':
#Go to Company URL
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events from today's date to next months and record it in ALL EVENTS. If there is no information of events or dates of the events on the website, record DNE for all variables.
#For all events that have Office Hours in the name, count the number of events in OFFICE HOURS. For all events that have summit, count the number of the events in SUMMITS.
#For all events that are related to teaching or learning (e.g. contain "Training," "Seminar," "Class," "Learn," "Bootcamp," "Workshop," "Pitch Event", count the number of the events into WORKSHOPS
#For all events that are related to scoial activities and networking (e.g. "Social," "Meet Up," "Breakfast"/"Lunch"/"Happy Hour", "Movie Night"/"Bowling"), count the number of the events into NETWORKING

====Onsite VC v. Angel Investors====
*Notes: Few companies have a section for their onsite VCs or angel investors. Even the company(Innovation Pavilion) that has Angel programs and VC programs does not conduct the programs by itself, but cooperate with external angel investors or VCs. Some companies have mentors or board members who are from VCs, but it does not mean they will invest in the member startups in those companies.

===Group 5===
#Multiple Locations
#*Addresses are included in Group 1, but still needs to be discussed
#*Getting

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=
See Section 3 of [[Hubs (Academic Paper)]]

Hubs: Hubs Data

2016-07-22T20:45:59Z

ArielSun: /* Group 2 */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Twitter Activity
#URL
#Address
#Mission Statement
#Specific Industry
#Nonprofit
#Sponsors/Partners
#Price for a space + office
#Founding Date

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/21): G/Y: Founding date, size (members) issues
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/21): G/Y: much progress has been made, but issues with onsite venture capitalists/angel investors
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Have a comprehensive list of potential hubs
#*Status (7/21): Hannah working on this
#Test processes and audit
#*Status (7/21): NS
#*Begin Date: TBD
#*Reach Goal: TBD
#Fill in Remaining Data Manually
#*Status (7/21): NS
#*Begin Date: TBD
#*Reach Goal: TBD

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/20)''': Gunny has created a tool to do this process
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Address
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/22)''': Code written. Difficulties occur with very large companies (e.g. Impact Hub). Will require Veeral's program, expected time for each assignment is 10-20 seconds - pay rate, therefore, recommended $.05
#*'''CODE'''
#*#Using Veeral's code, crossproduct allintext: (Group A) and site: (Group B), where '''Group A'''=Contact (high coverage), About Us, Find Us, Locations, Address, '''Group B'''= Company URLs.
#*Click on first result. If addresses exist, record in ADDRESS, STATE, and ZIP.
#*#If not, go to company's URL. If addresses exist, record in ADDRESS, STATE, and ZIP.
#*#If address exists, but ZIP does not, plug in address into search engine and record ZIP.
#*#Otherwise, record DNE.
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Specific Industry
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Given that most companies include their specialty in mission statement and difficulty to turk, we will manually check each mission statement and mark it accordingly.
#*'''CODE'''
#*#NONE
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Sponsors/Partners
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Code written, but may require additional manual work. Expected time to complete is 45 seconds due to a potential list of a lot of sponsors/partners - pay rate, therefore, recommended $.12.
#*'''CODE'''
#*#Choose first result from Search Text 1 and Search Text 2 (allintext: Sponsors/Partnerrs site:URL)
#*#Record all Sponsors from Search Text 1 into SPONSORS. If there does not exist a list or the link was for only 1 sponsor, record DNE.
#*#If any Sponsors from Search Text 1 include a University or College (will be listed in name), record them into UNIVERSITY SPONSORS
#*#Record all Partners from Search Text 2 into PARTNERS. If there does not exist a list or the link was for only 1 partner, record DNE.
#*#If any Partners from Search Text 2 include a University or College (will be listed in name), record them into UNIVERSITY PARTNERS
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/22)''': Code 1 written, code 2 need more work
#*'''CODE 1 of 2'''
#*#Go to company’s URL
#*#On the homepage, look for the section related to pricing. If pricing is not found in the homepage, look for the links ‘coworking’, ‘work space’, ‘membership’, ‘pricing’ ,‘join’ or ‘Apply for membership’ , and look for the pricing information under those links. If there is no price related section, record DNE for both ‘Flexible Desk’ and ‘Dedicated Desk’.
#*#If there is pricing information, look for the price of sharing space per month, often denoted as Shared/Flexible desk/non-dedicated desk, record the price at ‘Flexible Desk’. If the price is not found, record DNE.
#*#Look for the price of a dedicated desk per month, often denoted as Reserved/dedicated desk/private desk record the price at ‘Dedicated Desk’. If the price is not found, record DNE.
#*#If price information is not found and there is a ‘locations’ link, click on it and choose the first location of the list. Repeat step 3 -4.
#*'''CODE 2 of 2'''
#*#Keywords: 24/7 access, dedicated desk, pricing
#*#Google allintext:"keywords" site:URL
#*#TBD
#Founding Date
#*'''STATUS''': To Be Discussed Further
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Difficulties observed when figuring out how to Turk this
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size (SQFT)
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively
#Size (# Companies)
#*'''BRAINSTORM''': (7/22) Some companies don’t list all members but only selective ones. Some companies do not separate current members and alumni and goes like:"we have served more than 120 startups..."
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/22)''': Brainstorm and code updated (Capital Factory 227)
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for the link 'Members' or 'Residents', usually they are under the links 'Community', 'Membership', 'Our Space' or 'The Space'.
#*#Count the number of members
#*#If the link or section of 'Members' is not found, go the 'Community' and 'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.
#*#If number of members cannot be identified using above steps, record DNE.
#*'''CODE 2 of 2'''
#*#Search allintitle:"Members/Startups/Residents/Villagers/Ventures" site:URL in Google.
#*#If no result found, record DNE.
#*#If there are results, go to the first result which is usually in the form like"Members - Company Name".
#*#If the result direct you to a page that lists the members of the company, count the number of companies and record the number.
#*#If the result direct you to a page that does not give information on number of members, record DNE.

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Code written - 2nd part, while more manual, appears to have greater range. 2nd code would only require Veeral's code. 1st code expected completion time is 30 seconds.
#*'''CODE 1 of 2'''
#*#Go to company's URL
#*#Look for the link 'Accelerators' or 'Accelerating/Accelerator/Acceleration/Accelerate Programs'
#*#If accelerators are found, count the number of accelerators/accelerating programs and record the number. **or also copy the names of the accelerators?
#*#If accelerators are not found in step 1, go to the links 'Services' , 'Benefit', 'Resources', 'For Entrepreneurs', 'Startups' and look for the section of 'Accelerator/Accelerating Programs'
#*#If accelerators are found, count the number of accelerators/accelerating programs and record the number.
#*#If accelerators are not found, record 0.
#*'''CODE 2 of 2'''
#*#Search [allintitle:"accelerator"/"accelerate" site:URL] in Google
#*#Copy the titles of the results. **We have to scrutinize the titles ourselves to determine whether they are distinct onsite accelerators and record the number manually.
#*#If no result appears, record 0.

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Cultivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
**'''Search Text''': Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
*'''TBD points'''
*'''Potential Turks'''
**'''Search Text 1''': website design, coding, web development, software, bootcamp
**'''Search Text 2''': General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite OH Investors v. mentors====
Thoughts (Ariel, 07/20):
The names listed on 'mentor' page/sections must all be mentors, and the same applies for investors/OH investors although few companies list their investors. So here the only thing we are trying to differentiate is whether the mentor is a investor. maybe via checking whether they are from a VC firm?? But even they are from VC companies doesn't mean they are going to invest on the startups of the Hubs they are mentoring on. Or another way to think about it is differentiating between mentors/OH mentors. Mentors tend to give the particular startups long term support and available when needed while OH mentors only gives advice on the spot.

'''Mentors'''

*'''Desc''':

*'''Characteristics''':
**Focus on improving entrepreneurial community through ongoing, recurring support
**Help and guide the startups on: business plans and models, management, development, execution, technology innovation, marketing, sales
**Common fields/occupations: founder/CEO of another company, business development, serial entrepreneur, marketing, sales, management consulting, technology and innovation, research professor etc.
**Some companies offer mentor office hours

*'''TBD Points''':

'''Investors'''

*'''Desc''':

*'''Characteristics''':
**Focus on investing on early stage or growth stage startups
**Usually from VC firms
**Common fields/ occupations: VC firm manager, VC firm partner, fund manager

*'''TBD Points''':

*'''Potential Turks''':
#Search allintext:"office hours" site:URL
#Mark ''office hours'' as 1 if there is a result, otherwise mark as 0.
#Click on the first five results
#On each of the five pages, search for two items:
##search for 'mentor'. (Ctrl + F) If 'mentor' appears in the description paragraph of office hours on any of the five pages, mark ''mentor OH'' as 1. Otherwise mark as DNE and copy the description paragraph of office hours of all five pages.
##search for 'fund'. (Ctrl + F) If 'fund' appears in the description paragraph of office hours on any of the five pages, mark ''investor OH'' as 1. Otherwise mark as DNE and copy the description paragraph of office hours of all five pages.

====Onsite temporary workshops v. networking events====
'''Temporary Workshops'''

*'''Desc''':

*'''Characteristics''':
**The purpose is learning and discussing
**Often have a specific topic: business issue (e.g. online marketing) or techniques learning (e.g. intro to Java script)
**In the forms of: workshop, class, panel, project, XX session, seminar, series, intro to XX
**Exception: tech meetup is usually a workshop(e.g. C++ programmer meetup, http://techranchaustin.com/events/)

*'''TBD Points''':
**Do we care about what particular workshops (e.g. coding, leadership, etc.)?
**Summits/major events

*'''Potential Turks''':
**See Turk for Both Below

'''Networking Events'''

*'''Desc''':

*'''Characteristics''':
**The purpose is to meet fellow entrepreneurs and experts and networking with them
**Focus on experience sharing or communication as opposed to discussing a specific topic or technical subject
**In the forms of: meetup, networking, happy hour, info session?, luncheon, XX night, socials, talks??, community XX

*'''TBD Points''':

*'''Potential Turks''':
**See Turk for Both Below

*'''Turk for Both 1 of 2''':
*#Search the Search Text 1 (allintext: events site: URL) and choose link to "Events", "Calendar", or related. Record 'url' on SOURCE If this does not exist, go to Step 7
*#For all events that have dates, copy the events from today's date to the following month into ALL EVENTS
*#For all events that have Office Hours in the name, record the events in OFFICE HOURS. For all events that have summit, record the events in SUMMITS.
*#For all events that are related to teaching or learning (e.g. contain "Training," "Seminar," "Class," "Learn," "Bootcamp," "Workshop," "Pitch Event", copy the name of the events into WORKSHOPS
*#For all events that are related to scoial activities and networking (e.g. "Social," "Meet Up," "Breakfast"/"Lunch"/"Happy Hour", "Movie Night"/"Bowling"), copy the name of the events into NETWORKING. For all events that are unclear or did not fit into these descriptions
*#If a message explicity says there are no events, mark as 0 for ALL EVENTS, OFFICE HOURS, SUMMITS, WORKSHOPS, and NETWORKING
*#If this does not exist, search Search Text 2 (allintext: Company Name site: meetup.com) and click on the meetup.com for the company if it exists. If it does exist, record meetup on SOURCE. If not, go to step 9.
*#Repeat Steps 2-6.
*#If this does not exist, search Search Text 3 (allintext: Company Name site: eventbrite.com) and click on the eventbrite.com for the company if it exists. If it does exist, record eventbrite on SOURCE. If not, mark DNE for all variables.
*#Repeat Steps 2-6.

*'''Turk for Both 2 of 2''':
#Go to Company URL
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events from today's date to next months and record it in ALL EVENTS. If there is no information of events or dates of the events on the website, record DNE for all variables.
#For all events that have Office Hours in the name, count the number of events in OFFICE HOURS. For all events that have summit, count the number of the events in SUMMITS.
#For all events that are related to teaching or learning (e.g. contain "Training," "Seminar," "Class," "Learn," "Bootcamp," "Workshop," "Pitch Event", count the number of the events into WORKSHOPS
#For all events that are related to scoial activities and networking (e.g. "Social," "Meet Up," "Breakfast"/"Lunch"/"Happy Hour", "Movie Night"/"Bowling"), count the number of the events into NETWORKING

====Onsite VC v. Angel Investors====

===Group 5===
#Multiple Locations
#*Addresses are included in Group 1, but still needs to be discussed
#*Getting

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=
See Section 3 of [[Hubs (Academic Paper)]]

Hubs: Hubs Data

2016-07-22T16:56:08Z

ArielSun: /* Group 1 */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Twitter Activity
#URL
#Address
#Mission Statement
#Specific Industry
#Nonprofit
#Sponsors/Partners
#Price for a space + office
#Founding Date

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/21): G/Y: Founding date issues
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/21): Green: much progress has been made
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Have a comprehensive list of potential hubs
#*Status (7/21): Hannah working on this
#Test processes and audit
#*Status (7/21): NS
#*Begin Date: TBD
#*Reach Goal: TBD
#Fill in Remaining Data Manually
#*Status (7/21): NS
#*Begin Date: TBD
#*Reach Goal: TBD

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/20)''': Gunny has created a tool to do this process
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Address
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/22)''': Code written. Difficulties occur with very large companies (e.g. Impact Hub). Will require Veeral's program, expected time for each assignment is 10-20 seconds - pay rate, therefore, recommended $.05
#*'''CODE'''
#*#Using Veeral's code, crossproduct allintext: (Group A) and site: (Group B), where '''Group A'''=Contact (high coverage), About Us, Find Us, Locations, Address, '''Group B'''= Company URLs.
#*Click on first result. If addresses exist, record in ADDRESS, STATE, and ZIP.
#*#If not, go to company's URL. If addresses exist, record in ADDRESS, STATE, and ZIP.
#*#If address exists, but ZIP does not, plug in address into search engine and record ZIP.
#*#Otherwise, record DNE.
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Specific Industry
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Given that most companies include their specialty in mission statement and difficulty to turk, we will manually check each mission statement and mark it accordingly.
#*'''CODE'''
#*#NONE
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Sponsors/Partners
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Code written, but may require additional manual work. Expected time to complete is 45 seconds due to a potential list of a lot of sponsors/partners - pay rate, therefore, recommended $.12.
#*'''CODE'''
#*#Choose first result from Search Text 1 and Search Text 2 (allintext: Sponsors/Partnerrs site:URL)
#*#Record all Sponsors from Search Text 1 into SPONSORS. If there does not exist a list or the link was for only 1 sponsor, record DNE.
#*#If any Sponsors from Search Text 1 include a University or College (will be listed in name), record them into UNIVERSITY SPONSORS
#*#Record all Partners from Search Text 2 into PARTNERS. If there does not exist a list or the link was for only 1 partner, record DNE.
#*#If any Partners from Search Text 2 include a University or College (will be listed in name), record them into UNIVERSITY PARTNERS
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/22)''': Code 1 written, code 2 need more work
#*'''CODE 1 of 2'''
#*#Go to company’s URL
#*#On the homepage, look for the section related to pricing. If pricing is not found in the homepage, look for the links ‘coworking’, ‘work space’, ‘membership’, ‘pricing’ ,‘join’ or ‘Apply for membership’ , and look for the pricing information under those links. If there is no price related section, record DNE for both ‘Flexible Desk’ and ‘Dedicated Desk’.
#*#If there is pricing information, look for the price of sharing space per month, often denoted as Shared/Flexible desk/non-dedicated desk, record the price at ‘Flexible Desk’. If the price is not found, record DNE.
#*#Look for the price of a dedicated desk per month, often denoted as Reserved/dedicated desk/private desk record the price at ‘Dedicated Desk’. If the price is not found, record DNE.
#*#If price information is not found and there is a ‘locations’ link, click on it and choose the first location of the list. Repeat step 3 -4.
#*'''CODE 2 of 2'''
#*#Keywords: 24/7 access, dedicated desk, pricing
#*#Google allintext:"keywords" site:URL
#*#TBD
#Founding Date
#*'''STATUS''': To Be Discussed Further
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Difficulties observed when figuring out how to Turk this
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Code written - 2nd part, while more manual, appears to have greater range. 2nd code would only require Veeral's code. 1st code expected completion time is 30 seconds.
#*'''CODE 1 of 2'''
#*#Go to company's URL
#*#Look for the link 'Accelerators' or 'Accelerating/Accelerator/Acceleration/Accelerate Programs'
#*#If accelerators are found, count the number of accelerators/accelerating programs and record the number. **or also copy the names of the accelerators?
#*#If accelerators are not found in step 1, go to the links 'Services' , 'Benefit', 'Resources', 'For Entrepreneurs', 'Startups' and look for the section of 'Accelerator/Accelerating Programs'
#*#If accelerators are found, count the number of accelerators/accelerating programs and record the number.
#*#If accelerators are not found, record 0.
#*'''CODE 2 of 2'''
#*#Search [allintitle:"accelerator" site:URL] in Google
#*#Copy the titles of the results. **We have to scrutinize the titles ourselves to determine whether they are distinct onsite accelerators and record the number manually.
#*#If no result appears, record 0.

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Cultivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
**'''Search Text''': Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
*'''TBD points'''
*'''Potential Turks'''
**'''Search Text 1''': website design, coding, web development, software, bootcamp
**'''Search Text 2''': General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite OH Investors v. mentors====
Thoughts (Ariel, 07/20):
The names listed on 'mentor' page/sections must all be mentors, and the same applies for investors/OH investors although few companies list their investors. So here the only thing we are trying to differentiate is whether the mentor is a investor. maybe via checking whether they are from a VC firm?? But even they are from VC companies doesn't mean they are going to invest on the startups of the Hubs they are mentoring on. Or another way to think about it is differentiating between mentors/OH mentors. Mentors tend to give the particular startups long term support and available when needed while OH mentors only gives advice on the spot.

'''Mentors'''

*'''Desc''':

*'''Characteristics''':
**Focus on improving entrepreneurial community through ongoing, recurring support
**Help and guide the startups on: business plans and models, management, development, execution, technology innovation, marketing, sales
**Common fields/occupations: founder/CEO of another company, business development, serial entrepreneur, marketing, sales, management consulting, technology and innovation, research professor etc.
**Some companies offer mentor office hours

*'''TBD Points''':

'''Investors'''

*'''Desc''':

*'''Characteristics''':
**Focus on investing on early stage or growth stage startups
**Usually from VC firms
**Common fields/ occupations: VC firm manager, VC firm partner, fund manager

*'''TBD Points''':

*'''Potential Turks''':
#Search allintext:"office hours" site:URL
#Mark ''office hours'' as 1 if there is a result, otherwise mark as 0.
#Click on the first five results
#On each of the five pages, search for two items:
##search for 'mentor'. (Ctrl + F) If 'mentor' appears in the description paragraph of office hours on any of the five pages, mark ''mentor OH'' as 1. Otherwise mark as DNE and copy the description paragraph of office hours of all five pages.
##search for 'fund'. (Ctrl + F) If 'fund' appears in the description paragraph of office hours on any of the five pages, mark ''investor OH'' as 1. Otherwise mark as DNE and copy the description paragraph of office hours of all five pages.

====Onsite temporary workshops v. networking events====
'''Temporary Workshops'''

*'''Desc''':

*'''Characteristics''':
**The purpose is learning and discussing
**Often have a specific topic: business issue (e.g. online marketing) or techniques learning (e.g. intro to Java script)
**In the forms of: workshop, class, panel, project, XX session, seminar, series, intro to XX
**Exception: tech meetup is usually a workshop(e.g. C++ programmer meetup, http://techranchaustin.com/events/)

*'''TBD Points''':
**Do we care about what particular workshops (e.g. coding, leadership, etc.)?
**Summits/major events

*'''Potential Turks''':
**See Turk for Both Below

'''Networking Events'''

*'''Desc''':

*'''Characteristics''':
**The purpose is to meet fellow entrepreneurs and experts and networking with them
**Focus on experience sharing or communication as opposed to discussing a specific topic or technical subject
**In the forms of: meetup, networking, happy hour, info session?, luncheon, XX night, socials, talks??, community XX

*'''TBD Points''':

*'''Potential Turks''':
**See Turk for Both Below

*'''Turk for Both 1 of 2''':
*#Search the Search Text 1 (allintext: events site: URL) and choose link to "Events", "Calendar", or related. Record 'url' on SOURCE If this does not exist, go to Step 7
*#For all events that have dates, copy the events from today's date to the following month into ALL EVENTS
*#For all events that have Office Hours in the name, record the events in OFFICE HOURS. For all events that have summit, record the events in SUMMITS.
*#For all events that are related to teaching or learning (e.g. contain "Training," "Seminar," "Class," "Learn," "Bootcamp," "Workshop," "Pitch Event", copy the name of the events into WORKSHOPS
*#For all events that are related to scoial activities and networking (e.g. "Social," "Meet Up," "Breakfast"/"Lunch"/"Happy Hour", "Movie Night"/"Bowling"), copy the name of the events into NETWORKING. For all events that are unclear or did not fit into these descriptions
*#If a message explicity says there are no events, mark as 0 for ALL EVENTS, OFFICE HOURS, SUMMITS, WORKSHOPS, and NETWORKING
*#If this does not exist, search Search Text 2 (allintext: Company Name site: meetup.com) and click on the meetup.com for the company if it exists. If it does exist, record meetup on SOURCE. If not, go to step 9.
*#Repeat Steps 2-6.
*#If this does not exist, search Search Text 3 (allintext: Company Name site: eventbrite.com) and click on the eventbrite.com for the company if it exists. If it does exist, record eventbrite on SOURCE. If not, mark DNE for all variables.
*#Repeat Steps 2-6.

*'''Turk for Both 2 of 2''':
#Go to Company URL
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events from today's date to next months and record it in ALL EVENTS. If there is no information of events or dates of the events on the website, record DNE for all variables.
#For all events that have Office Hours in the name, count the number of events in OFFICE HOURS. For all events that have summit, count the number of the events in SUMMITS.
#For all events that are related to teaching or learning (e.g. contain "Training," "Seminar," "Class," "Learn," "Bootcamp," "Workshop," "Pitch Event", count the number of the events into WORKSHOPS
#For all events that are related to scoial activities and networking (e.g. "Social," "Meet Up," "Breakfast"/"Lunch"/"Happy Hour", "Movie Night"/"Bowling"), count the number of the events into NETWORKING

====Onsite VC v. Angel Investors====

===Group 5===
#Multiple Locations
#*Addresses are included in Group 1, but still needs to be discussed
#*Getting

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=
See Section 3 of [[Hubs (Academic Paper)]]

Hubs: Hubs Data

2016-07-22T16:53:42Z

ArielSun: /* Group 1 */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Twitter Activity
#URL
#Address
#Mission Statement
#Specific Industry
#Nonprofit
#Sponsors/Partners
#Price for a space + office
#Founding Date

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/21): G/Y: Founding date issues
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/21): Green: much progress has been made
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Have a comprehensive list of potential hubs
#*Status (7/21): Hannah working on this
#Test processes and audit
#*Status (7/21): NS
#*Begin Date: TBD
#*Reach Goal: TBD
#Fill in Remaining Data Manually
#*Status (7/21): NS
#*Begin Date: TBD
#*Reach Goal: TBD

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/20)''': Gunny has created a tool to do this process
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Address
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/22)''': Code written. Difficulties occur with very large companies (e.g. Impact Hub). Will require Veeral's program, expected time for each assignment is 10-20 seconds - pay rate, therefore, recommended $.05
#*'''CODE'''
#*#Using Veeral's code, crossproduct allintext: (Group A) and site: (Group B), where '''Group A'''=Contact (high coverage), About Us, Find Us, Locations, Address, '''Group B'''= Company URLs.
#*Click on first result. If addresses exist, record in ADDRESS, STATE, and ZIP.
#*#If not, go to company's URL. If addresses exist, record in ADDRESS, STATE, and ZIP.
#*#If address exists, but ZIP does not, plug in address into search engine and record ZIP.
#*#Otherwise, record DNE.
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Specific Industry
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Given that most companies include their specialty in mission statement and difficulty to turk, we will manually check each mission statement and mark it accordingly.
#*'''CODE'''
#*#NONE
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Sponsors/Partners
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Code written, but may require additional manual work. Expected time to complete is 45 seconds due to a potential list of a lot of sponsors/partners - pay rate, therefore, recommended $.12.
#*'''CODE'''
#*#Choose first result from Search Text 1 and Search Text 2 (allintext: Sponsors/Partnerrs site:URL)
#*#Record all Sponsors from Search Text 1 into SPONSORS. If there does not exist a list or the link was for only 1 sponsor, record DNE.
#*#If any Sponsors from Search Text 1 include a University or College (will be listed in name), record them into UNIVERSITY SPONSORS
#*#Record all Partners from Search Text 2 into PARTNERS. If there does not exist a list or the link was for only 1 partner, record DNE.
#*#If any Partners from Search Text 2 include a University or College (will be listed in name), record them into UNIVERSITY PARTNERS
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/22)''': Code 1 written, code 2 need more work
#*'''CODE 1 of 2'''
#*#Go to company’s URL
#*#On the homepage, look for the section related to pricing. If pricing is not found in the homepage, look for the links ‘coworking’, ‘work space’, ‘membership’, ‘pricing’ ,‘join’ or ‘Apply for membership’ , and look for the pricing information under those links. If there is no price related section, record DNE for both ‘Flexible Desk’ and ‘Dedicated Desk’.
#*#If there is pricing information, look for the price of sharing space per month, often denoted as Shared/Flexible desk/non-dedicated desk, record the price at ‘Flexible Desk’. If the price is not found, record DNE.
#*#Look for the price of a dedicated desk per month, often denoted as Reserved/dedicated desk/private desk record the price at ‘Dedicated Desk’. If the price is not found, record DNE.
#*#If price information is not found and there is a ‘locations’ link, click on it and choose the first location of the list. Repeat step 3 -4.

#*'''CODE 2 of 2'''
#*#Keywords: 24/7 access, dedicated desk, pricing
#*#Google allintext:"keywords" site:URL
#*#TBD

#Founding Date
#*'''STATUS''': To Be Discussed Further
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Difficulties observed when figuring out how to Turk this
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Code written - 2nd part, while more manual, appears to have greater range. 2nd code would only require Veeral's code. 1st code expected completion time is 30 seconds.
#*'''CODE 1 of 2'''
#*#Go to company's URL
#*#Look for the link 'Accelerators' or 'Accelerating/Accelerator/Acceleration/Accelerate Programs'
#*#If accelerators are found, count the number of accelerators/accelerating programs and record the number. **or also copy the names of the accelerators?
#*#If accelerators are not found in step 1, go to the links 'Services' , 'Benefit', 'Resources', 'For Entrepreneurs', 'Startups' and look for the section of 'Accelerator/Accelerating Programs'
#*#If accelerators are found, count the number of accelerators/accelerating programs and record the number.
#*#If accelerators are not found, record 0.
#*'''CODE 2 of 2'''
#*#Search [allintitle:"accelerator" site:URL] in Google
#*#Copy the titles of the results. **We have to scrutinize the titles ourselves to determine whether they are distinct onsite accelerators and record the number manually.
#*#If no result appears, record 0.

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Cultivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
**'''Search Text''': Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
*'''TBD points'''
*'''Potential Turks'''
**'''Search Text 1''': website design, coding, web development, software, bootcamp
**'''Search Text 2''': General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite OH Investors v. mentors====
Thoughts (Ariel, 07/20):
The names listed on 'mentor' page/sections must all be mentors, and the same applies for investors/OH investors although few companies list their investors. So here the only thing we are trying to differentiate is whether the mentor is a investor. maybe via checking whether they are from a VC firm?? But even they are from VC companies doesn't mean they are going to invest on the startups of the Hubs they are mentoring on. Or another way to think about it is differentiating between mentors/OH mentors. Mentors tend to give the particular startups long term support and available when needed while OH mentors only gives advice on the spot.

'''Mentors'''

*'''Desc''':

*'''Characteristics''':
**Focus on improving entrepreneurial community through ongoing, recurring support
**Help and guide the startups on: business plans and models, management, development, execution, technology innovation, marketing, sales
**Common fields/occupations: founder/CEO of another company, business development, serial entrepreneur, marketing, sales, management consulting, technology and innovation, research professor etc.
**Some companies offer mentor office hours

*'''TBD Points''':

'''Investors'''

*'''Desc''':

*'''Characteristics''':
**Focus on investing on early stage or growth stage startups
**Usually from VC firms
**Common fields/ occupations: VC firm manager, VC firm partner, fund manager

*'''TBD Points''':

*'''Potential Turks''':
#Search allintext:"office hours" site:URL
#Mark ''office hours'' as 1 if there is a result, otherwise mark as 0.
#Click on the first five results
#On each of the five pages, search for two items:
##search for 'mentor'. (Ctrl + F) If 'mentor' appears in the description paragraph of office hours on any of the five pages, mark ''mentor OH'' as 1. Otherwise mark as DNE and copy the description paragraph of office hours of all five pages.
##search for 'fund'. (Ctrl + F) If 'fund' appears in the description paragraph of office hours on any of the five pages, mark ''investor OH'' as 1. Otherwise mark as DNE and copy the description paragraph of office hours of all five pages.

====Onsite temporary workshops v. networking events====
'''Temporary Workshops'''

*'''Desc''':

*'''Characteristics''':
**The purpose is learning and discussing
**Often have a specific topic: business issue (e.g. online marketing) or techniques learning (e.g. intro to Java script)
**In the forms of: workshop, class, panel, project, XX session, seminar, series, intro to XX
**Exception: tech meetup is usually a workshop(e.g. C++ programmer meetup, http://techranchaustin.com/events/)

*'''TBD Points''':
**Do we care about what particular workshops (e.g. coding, leadership, etc.)?
**Summits/major events

*'''Potential Turks''':
**See Turk for Both Below

'''Networking Events'''

*'''Desc''':

*'''Characteristics''':
**The purpose is to meet fellow entrepreneurs and experts and networking with them
**Focus on experience sharing or communication as opposed to discussing a specific topic or technical subject
**In the forms of: meetup, networking, happy hour, info session?, luncheon, XX night, socials, talks??, community XX

*'''TBD Points''':

*'''Potential Turks''':
**See Turk for Both Below

*'''Turk for Both 1 of 2''':
*#Search the Search Text 1 (allintext: events site: URL) and choose link to "Events", "Calendar", or related. Record 'url' on SOURCE If this does not exist, go to Step 7
*#For all events that have dates, copy the events from today's date to the following month into ALL EVENTS
*#For all events that have Office Hours in the name, record the events in OFFICE HOURS. For all events that have summit, record the events in SUMMITS.
*#For all events that are related to teaching or learning (e.g. contain "Training," "Seminar," "Class," "Learn," "Bootcamp," "Workshop," "Pitch Event", copy the name of the events into WORKSHOPS
*#For all events that are related to scoial activities and networking (e.g. "Social," "Meet Up," "Breakfast"/"Lunch"/"Happy Hour", "Movie Night"/"Bowling"), copy the name of the events into NETWORKING. For all events that are unclear or did not fit into these descriptions
*#If a message explicity says there are no events, mark as 0 for ALL EVENTS, OFFICE HOURS, SUMMITS, WORKSHOPS, and NETWORKING
*#If this does not exist, search Search Text 2 (allintext: Company Name site: meetup.com) and click on the meetup.com for the company if it exists. If it does exist, record meetup on SOURCE. If not, go to step 9.
*#Repeat Steps 2-6.
*#If this does not exist, search Search Text 3 (allintext: Company Name site: eventbrite.com) and click on the eventbrite.com for the company if it exists. If it does exist, record eventbrite on SOURCE. If not, mark DNE for all variables.
*#Repeat Steps 2-6.

*'''Turk for Both 2 of 2''':
#Go to Company URL
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events from today's date to next months and record it in ALL EVENTS. If there is no information of events or dates of the events on the website, record DNE for all variables.
#For all events that have Office Hours in the name, count the number of events in OFFICE HOURS. For all events that have summit, count the number of the events in SUMMITS.
#For all events that are related to teaching or learning (e.g. contain "Training," "Seminar," "Class," "Learn," "Bootcamp," "Workshop," "Pitch Event", count the number of the events into WORKSHOPS
#For all events that are related to scoial activities and networking (e.g. "Social," "Meet Up," "Breakfast"/"Lunch"/"Happy Hour", "Movie Night"/"Bowling"), count the number of the events into NETWORKING

====Onsite VC v. Angel Investors====

===Group 5===
#Multiple Locations
#*Addresses are included in Group 1, but still needs to be discussed
#*Getting

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=
See Section 3 of [[Hubs (Academic Paper)]]

Hubs: Hubs Data

2016-07-21T21:10:20Z

ArielSun: /* Group 3 */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/21): G/Y: Founding date issues
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/21): Green: much progress has been made
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Have a comprehensive list of potential hubs
#*Status (7/21): Hannah working on this
#Test processes and audit
#*Status (7/21): NS
#*Begin Date: TBD
#*Reach Goal: TBD
#Fill in Remaining Data Manually
#*Status (7/21): NS
#*Begin Date: TBD
#*Reach Goal: TBD

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/20)''': Gunny has created a tool to do this process
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Specific Industry
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Given that most companies include their specialty in mission statement and difficulty to turk, we will manually check each mission statement and mark it accordingly.
#*'''CODE'''
#*#NONE
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Sponsors/Partners
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Code written, but may require additional manual work. Expected time to complete is 45 seconds due to a potential list of a lot of sponsors/partners - pay rate, therefore, recommended $.12.
#*'''CODE'''
#*#Choose first result from Search Text 1 and Search Text 2 (allintext: Sponsors/Partnerrs site:URL)
#*#Record all Sponsors from Search Text 1 into SPONSORS. If there does not exist a list or the link was for only 1 sponsor, record DNE.
#*#If any Sponsors from Search Text 1 include a University or College (will be listed in name), record them into UNIVERSITY SPONSORS
#*#Record all Partners from Search Text 2 into PARTNERS. If there does not exist a list or the link was for only 1 partner, record DNE.
#*#If any Partners from Search Text 2 include a University or College (will be listed in name), record them into UNIVERSITY PARTNERS
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE 1 of 2'''
#*#Go to company's URL
#*#Look for the link 'Accelerators' or 'Accelerating/Accelerator/Acceleration/Accelerate Programs'
#*#If accelerators are found, count the number of accelerators/accelerating programs and record the number. **or also copy the names of the accelerators?
#*#If accelerators are not found in step 1, go to the links 'Services' , 'Benefit', 'Resources', 'For Entrepreneurs', 'Startups' and look for the section of 'Accelerator/Accelerating Programs'
#*#If accelerators are found, count the number of accelerators/accelerating programs and record the number.
#*#If accelerators are not found, record 0.
#*'''CODE 2 of 2'''
#*#Search [allintitle:"accelerator" site:URL] in Google
#*#Copy the titles of the results. **We have to scrutinize the titles ourselves to determine whether they are distinct onsite accelerators and record the number manually.
#*#If no result appears, record 0.

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Cultivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
**'''Search Text''': Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
*'''TBD points'''
*'''Potential Turks'''
**'''Search Text 1''': website design, coding, web development, software, bootcamp
**'''Search Text 2''': General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite VC v. Angel Investors====

====Onsite OH Investors v. mentors====
Thoughts (Ariel, 07/20):
The names listed on 'mentor' page/sections must all be mentors, and the same applies for investors/OH investors although few companies list their investors. So here the only thing we are trying to differentiate is whether the mentor is a investor. maybe via checking whether they are from a VC firm?? But even they are from VC companies doesn't mean they are going to invest on the startups of the Hubs they are mentoring on. Or another way to think about it is differentiating between mentors/OH mentors. Mentors tend to give the particular startups long term support and available when needed while OH mentors only gives advice on the spot.

'''Mentors'''

*'''Desc''':

*'''Characteristics''':
**Focus on improving entrepreneurial community through ongoing, recurring support
**Help and guide the startups on: business plans and models, management, development, execution, technology innovation, marketing, sales
**Common fields/occupations: founder/CEO of another company, business development, serial entrepreneur, marketing, sales, management consulting, technology and innovation, research professor etc.
**Some companies offer mentor office hours

*'''TBD Points''':

'''Investors'''

*'''Desc''':

*'''Characteristics''':
**Focus on investing on early stage or growth stage startups
**Usually from VC firms
**Common fields/ occupations: VC firm manager, VC firm partner, fund manager

*'''TBD Points''':

*'''Potential Turks''':
#Search allintext:"office hours" site:URL
#Mark ''office hours'' as 1 if there is a result, otherwise mark as 0.
#Click on the first five results
#On each of the five pages, search for two items:
##search for 'mentor'. (Ctrl + F) If 'mentor' appears in the description paragraph of office hours on any of the five pages, mark ''mentor OH'' as 1. Otherwise mark as DNE and copy the description paragraph of office hours of all five pages.
##search for 'fund'. (Ctrl + F) If 'fund' appears in the description paragraph of office hours on any of the five pages, mark ''investor OH'' as 1. Otherwise mark as DNE and copy the description paragraph of office hours of all five pages.

====Onsite temporary workshops v. networking events====
'''Temporary Workshops'''

*'''Desc''':

*'''Characteristics''':
**The purpose is learning and discussing
**Often have a specific topic: business issue (e.g. online marketing) or techniques learning (e.g. intro to Java script)
**In the forms of: workshop, class, panel, project, XX session, seminar, series, intro to XX
**Exception: tech meetup is usually a workshop(e.g. C++ programmer meetup, http://techranchaustin.com/events/)

*'''TBD Points''':
**Do we care about what particular workshops (e.g. coding, leadership, etc.)?
**Summits/major events

*'''Potential Turks''':
**See Turk for Both Below

'''Networking Events'''

*'''Desc''':

*'''Characteristics''':
**The purpose is to meet fellow entrepreneurs and experts and networking with them
**Focus on experience sharing or communication as opposed to discussing a specific topic or technical subject
**In the forms of: meetup, networking, happy hour, info session?, luncheon, XX night, socials, talks??, community XX

*'''TBD Points''':

*'''Potential Turks''':
**See Turk for Both Below

*'''Turk for Both 1 of 2''':
*#Search the Search Text 1 (allintext: events site: URL) and choose link to "Events", "Calendar", or related. Record 'url' on SOURCE If this does not exist, go to Step 7
*#For all events that have dates, copy the events from today's date to the following month into ALL EVENTS
*#For all events that have Office Hours in the name, record the events in OFFICE HOURS. For all events that have summit, record the events in SUMMITS.
*#For all events that are related to teaching or learning (e.g. contain "Training," "Seminar," "Class," "Learn," "Bootcamp," "Workshop," "Pitch Event", copy the name of the events into WORKSHOPS
*#For all events that are related to scoial activities and networking (e.g. "Social," "Meet Up," "Breakfast"/"Lunch"/"Happy Hour", "Movie Night"/"Bowling"), copy the name of the events into NETWORKING. For all events that are unclear or did not fit into these descriptions
*#If a message explicity says there are no events, mark as 0 for ALL EVENTS, OFFICE HOURS, SUMMITS, WORKSHOPS, and NETWORKING
*#If this does not exist, search Search Text 2 (allintext: Company Name site: meetup.com) and click on the meetup.com for the company if it exists. If it does exist, record meetup on SOURCE. If not, go to step 9.
*#Repeat Steps 2-6.
*#If this does not exist, search Search Text 3 (allintext: Company Name site: eventbrite.com) and click on the eventbrite.com for the company if it exists. If it does exist, record eventbrite on SOURCE. If not, mark DNE for all variables.
*#Repeat Steps 2-6.

*'''Turk for Both 2 of 2''':
#Go to Company URL
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events from today's date to next months and record it in ALL EVENTS. If there is no information of events or dates of the events on the website, record DNE for all variables.
#For all events that have Office Hours in the name, count the number of events in OFFICE HOURS. For all events that have summit, count the number of the events in SUMMITS.
#For all events that are related to teaching or learning (e.g. contain "Training," "Seminar," "Class," "Learn," "Bootcamp," "Workshop," "Pitch Event", count the number of the events into WORKSHOPS
#For all events that are related to scoial activities and networking (e.g. "Social," "Meet Up," "Breakfast"/"Lunch"/"Happy Hour", "Movie Night"/"Bowling"), count the number of the events into NETWORKING

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

Hubs: Hubs Data

2016-07-21T21:09:24Z

ArielSun: /* Group 3 */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/21): G/Y: Founding date issues
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/21): Green: much progress has been made
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Have a comprehensive list of potential hubs
#*Status (7/21): Hannah working on this
#Test processes and audit
#*Status (7/21): NS
#*Begin Date: TBD
#*Reach Goal: TBD
#Fill in Remaining Data Manually
#*Status (7/21): NS
#*Begin Date: TBD
#*Reach Goal: TBD

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/20)''': Gunny has created a tool to do this process
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Specific Industry
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Given that most companies include their specialty in mission statement and difficulty to turk, we will manually check each mission statement and mark it accordingly.
#*'''CODE'''
#*#NONE
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Sponsors/Partners
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Code written, but may require additional manual work. Expected time to complete is 45 seconds due to a potential list of a lot of sponsors/partners - pay rate, therefore, recommended $.12.
#*'''CODE'''
#*#Choose first result from Search Text 1 and Search Text 2 (allintext: Sponsors/Partnerrs site:URL)
#*#Record all Sponsors from Search Text 1 into SPONSORS. If there does not exist a list or the link was for only 1 sponsor, record DNE.
#*#If any Sponsors from Search Text 1 include a University or College (will be listed in name), record them into UNIVERSITY SPONSORS
#*#Record all Partners from Search Text 2 into PARTNERS. If there does not exist a list or the link was for only 1 partner, record DNE.
#*#If any Partners from Search Text 2 include a University or College (will be listed in name), record them into UNIVERSITY PARTNERS
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE 1 of 2'''
#*#Go to company's URL
#*#Look for the link 'Accelerators' or 'Accelerating/Accelerator/Acceleration/Accelerate Programs'
#*#If accelerators are found, count the number of accelerators/accelerating programs and record the number. **or also copy the names of the accelerator?
#*#If accelerators are not found in step 1, go to the links 'Services' , 'Benefit', 'Resources', 'For Entrepreneurs', 'Startups' and look for the section of 'Accelerator/Accelerating Programs'
#*#If accelerators are found, count the number of accelerators/accelerating programs and record the number.
#*#If accelerators are not found, record 0.
#*'''CODE 2 of 2'''
#*#Search allintitle:"accelerator" site:URL in Google
#*#Copy the titles of the results. **We have to scrutinize the titles ourselves to determine whether they are distinct onsite accelerators and record the number manually.
#*#If no result appears, record 0.

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Cultivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
**'''Search Text''': Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
*'''TBD points'''
*'''Potential Turks'''
**'''Search Text 1''': website design, coding, web development, software, bootcamp
**'''Search Text 2''': General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite VC v. Angel Investors====

====Onsite OH Investors v. mentors====
Thoughts (Ariel, 07/20):
The names listed on 'mentor' page/sections must all be mentors, and the same applies for investors/OH investors although few companies list their investors. So here the only thing we are trying to differentiate is whether the mentor is a investor. maybe via checking whether they are from a VC firm?? But even they are from VC companies doesn't mean they are going to invest on the startups of the Hubs they are mentoring on. Or another way to think about it is differentiating between mentors/OH mentors. Mentors tend to give the particular startups long term support and available when needed while OH mentors only gives advice on the spot.

'''Mentors'''

*'''Desc''':

*'''Characteristics''':
**Focus on improving entrepreneurial community through ongoing, recurring support
**Help and guide the startups on: business plans and models, management, development, execution, technology innovation, marketing, sales
**Common fields/occupations: founder/CEO of another company, business development, serial entrepreneur, marketing, sales, management consulting, technology and innovation, research professor etc.
**Some companies offer mentor office hours

*'''TBD Points''':

'''Investors'''

*'''Desc''':

*'''Characteristics''':
**Focus on investing on early stage or growth stage startups
**Usually from VC firms
**Common fields/ occupations: VC firm manager, VC firm partner, fund manager

*'''TBD Points''':

*'''Potential Turks''':
#Search allintext:"office hours" site:URL
#Mark ''office hours'' as 1 if there is a result, otherwise mark as 0.
#Click on the first five results
#On each of the five pages, search for two items:
##search for 'mentor'. (Ctrl + F) If 'mentor' appears in the description paragraph of office hours on any of the five pages, mark ''mentor OH'' as 1. Otherwise mark as DNE and copy the description paragraph of office hours of all five pages.
##search for 'fund'. (Ctrl + F) If 'fund' appears in the description paragraph of office hours on any of the five pages, mark ''investor OH'' as 1. Otherwise mark as DNE and copy the description paragraph of office hours of all five pages.

====Onsite temporary workshops v. networking events====
'''Temporary Workshops'''

*'''Desc''':

*'''Characteristics''':
**The purpose is learning and discussing
**Often have a specific topic: business issue (e.g. online marketing) or techniques learning (e.g. intro to Java script)
**In the forms of: workshop, class, panel, project, XX session, seminar, series, intro to XX
**Exception: tech meetup is usually a workshop(e.g. C++ programmer meetup, http://techranchaustin.com/events/)

*'''TBD Points''':
**Do we care about what particular workshops (e.g. coding, leadership, etc.)?
**Summits/major events

*'''Potential Turks''':
**See Turk for Both Below

'''Networking Events'''

*'''Desc''':

*'''Characteristics''':
**The purpose is to meet fellow entrepreneurs and experts and networking with them
**Focus on experience sharing or communication as opposed to discussing a specific topic or technical subject
**In the forms of: meetup, networking, happy hour, info session?, luncheon, XX night, socials, talks??, community XX

*'''TBD Points''':

*'''Potential Turks''':
**See Turk for Both Below

*'''Turk for Both 1 of 2''':
*#Search the Search Text 1 (allintext: events site: URL) and choose link to "Events", "Calendar", or related. Record 'url' on SOURCE If this does not exist, go to Step 7
*#For all events that have dates, copy the events from today's date to the following month into ALL EVENTS
*#For all events that have Office Hours in the name, record the events in OFFICE HOURS. For all events that have summit, record the events in SUMMITS.
*#For all events that are related to teaching or learning (e.g. contain "Training," "Seminar," "Class," "Learn," "Bootcamp," "Workshop," "Pitch Event", copy the name of the events into WORKSHOPS
*#For all events that are related to scoial activities and networking (e.g. "Social," "Meet Up," "Breakfast"/"Lunch"/"Happy Hour", "Movie Night"/"Bowling"), copy the name of the events into NETWORKING. For all events that are unclear or did not fit into these descriptions
*#If a message explicity says there are no events, mark as 0 for ALL EVENTS, OFFICE HOURS, SUMMITS, WORKSHOPS, and NETWORKING
*#If this does not exist, search Search Text 2 (allintext: Company Name site: meetup.com) and click on the meetup.com for the company if it exists. If it does exist, record meetup on SOURCE. If not, go to step 9.
*#Repeat Steps 2-6.
*#If this does not exist, search Search Text 3 (allintext: Company Name site: eventbrite.com) and click on the eventbrite.com for the company if it exists. If it does exist, record eventbrite on SOURCE. If not, mark DNE for all variables.
*#Repeat Steps 2-6.

*'''Turk for Both 2 of 2''':
#Go to Company URL
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events from today's date to next months and record it in ALL EVENTS. If there is no information of events or dates of the events on the website, record DNE for all variables.
#For all events that have Office Hours in the name, count the number of events in OFFICE HOURS. For all events that have summit, count the number of the events in SUMMITS.
#For all events that are related to teaching or learning (e.g. contain "Training," "Seminar," "Class," "Learn," "Bootcamp," "Workshop," "Pitch Event", count the number of the events into WORKSHOPS
#For all events that are related to scoial activities and networking (e.g. "Social," "Meet Up," "Breakfast"/"Lunch"/"Happy Hour", "Movie Night"/"Bowling"), count the number of the events into NETWORKING

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

Hubs: Hubs Data

2016-07-21T17:09:14Z

ArielSun: /* Onsite OH Investors v. mentors */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Test processes and audit
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Friday 7/28
#Have a comprehensive list of potential hubs
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Tuesday 7/26
#Fill in Remaining Data Manually
#*Status: NS
#*Begin Date: Monday 7/25
#*Reach Goal: Complete by Friday 7/29

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Specific Industry
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Given that most companies include their specialty in mission statement and difficulty to turk, we will manually check each mission statement and mark it accordingly.
#*'''CODE'''
#*#NONE
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Sponsors/Partners
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Code written, but may require additional manual work. Expected time to complete is 45 seconds due to a potential list of a lot of sponsors/partners - pay rate, therefore, recommended $.12.
#*'''CODE'''
#*#Choose first result from Search Text 1 and Search Text 2 (allintext: Sponsors/Partnerrs site:URL)
#*#Record all Sponsors from Search Text 1 into SPONSORS. If there does not exist a list or the link was for only 1 sponsor, record DNE.
#*#If any Sponsors from Search Text 1 include a University or College (will be listed in name), record them into UNIVERSITY SPONSORS
#*#Record all Partners from Search Text 2 into PARTNERS. If there does not exist a list or the link was for only 1 partner, record DNE.
#*#If any Partners from Search Text 2 include a University or College (will be listed in name), record them into UNIVERSITY PARTNERS
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Cultivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
**'''Search Text''': Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
*'''TBD points'''
*'''Potential Turks'''
**'''Search Text 1''': website design, coding, web development, software, bootcamp
**'''Search Text 2''': General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite VC v. Angel Investors====

====Onsite OH Investors v. mentors====
Thoughts (Ariel, 07/20):
The names listed on 'mentor' page/sections must all be mentors, and the same applies for investors/OH investors although few companies list their investors. So here the only thing we are trying to differentiate is whether the mentor is a investor. maybe via checking whether they are from a VC firm?? But even they are from VC companies doesn't mean they are going to invest on the startups of the Hubs they are mentoring on. Or another way to think about it is differentiating between mentors/OH mentors. Mentors tend to give the particular startups long term support and available when needed while OH mentors only gives advice on the spot.

'''Mentors'''

*'''Desc''':

*'''Characteristics''':
**Focus on improving entrepreneurial community through ongoing, recurring support
**Help and guide the startups on: business plans and models, management, development, execution, technology innovation, marketing, sales
**Common fields/occupations: founder/CEO of another company, business development, serial entrepreneur, marketing, sales, management consulting, technology and innovation, research professor etc.
**Some companies offer mentor office hours

*'''TBD Points''':

'''Investors'''

*'''Desc''':

*'''Characteristics''':
**Focus on investing on early stage or growth stage startups
**Usually from VC firms
**Common fields/ occupations: VC firm manager, VC firm partner, fund manager

*'''TBD Points''':

*'''Potential Turks''':
#Search allintext:"office hours" site:URL
#Mark ''office hours'' as 1 if there is a result, otherwise mark as 0.
#Click on the first five results
#On each of the five pages, search for two items:
##search for 'mentor'. (Ctrl + F) If 'mentor' appears in the description paragraph of office hours on any of the five pages, mark ''mentor OH'' as 1. Otherwise mark as DNE and copy the description paragraph of office hours of all five pages.
##search for 'fund'. (Ctrl + F) If 'fund' appears in the description paragraph of office hours on any of the five pages, mark ''investor OH'' as 1. Otherwise mark as DNE and copy the description paragraph of office hours of all five pages.

====Onsite temporary workshops v. networking events====
'''Temporary Workshops'''

*'''Desc''':

*'''Characteristics''':
**The purpose is learning and discussing
**Often have a specific topic: business issue (e.g. online marketing) or techniques learning (e.g. intro to Java script)
**In the forms of: workshop, class, panel, project, XX session, seminar, series, intro to XX
**Exception: tech meetup is usually a workshop(e.g. C++ programmer meetup, http://techranchaustin.com/events/)

*'''TBD Points''':

*'''Potential Turks''':

'''Networking Events'''

*'''Desc''':

*'''Characteristics''':
**The purpose is to meet fellow entrepreneurs and experts and networking with them
**Focus on experience sharing or communication as opposed to discussing a specific topic or technical subject
**In the forms of: meetup, networking, happy hour, info session?, luncheon, XX night, socials, talks??, community XX

*'''TBD Points''':

*'''Potential Turks''':

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

Hubs: Hubs Data

2016-07-21T16:48:39Z

ArielSun: /* Onsite OH Investors v. mentors */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Test processes and audit
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Friday 7/28
#Have a comprehensive list of potential hubs
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Tuesday 7/26
#Fill in Remaining Data Manually
#*Status: NS
#*Begin Date: Monday 7/25
#*Reach Goal: Complete by Friday 7/29

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Specific Industry
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Given that most companies include their specialty in mission statement and difficulty to turk, we will manually check each mission statement and mark it accordingly.
#*'''CODE'''
#*#NONE
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Sponsors/Partners
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/21)''': Code written, but may require additional manual work. Expected time to complete is 45 seconds due to a potential list of a lot of sponsors/partners - pay rate, therefore, recommended $.12.
#*'''CODE'''
#*#Choose first result from Search Text 1 and Search Text 2 (allintext: Sponsors/Partnerrs site:URL)
#*#Record all Sponsors from Search Text 1 into SPONSORS. If there does not exist a list or the link was for only 1 sponsor, record DNE.
#*#If any Sponsors from Search Text 1 include a University or College (will be listed in name), record them into UNIVERSITY SPONSORS
#*#Record all Partners from Search Text 2 into PARTNERS. If there does not exist a list or the link was for only 1 partner, record DNE.
#*#If any Partners from Search Text 2 include a University or College (will be listed in name), record them into UNIVERSITY PARTNERS
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Cultivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
**'''Search Text''': Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
*'''TBD points'''
*'''Potential Turks'''
**'''Search Text 1''': website design, coding, web development, software, bootcamp
**'''Search Text 2''': General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite VC v. Angel Investors====

====Onsite OH Investors v. mentors====
Thoughts (Ariel, 07/20):
The names listed on 'mentor' page/sections must all be mentors, and the same applies for investors/OH investors although few companies list their investors. So here the only thing we are trying to differentiate is whether the mentor is a investor. maybe via checking whether they are from a VC firm?? But even they are from VC companies doesn't mean they are going to invest on the startups of the Hubs they are mentoring on. Or another way to think about it is differentiating between mentors/OH mentors. Mentors tend to give the particular startups long term support and available when needed while OH mentors only gives advice on the spot.

'''Mentors'''

*'''Desc''':

*'''Characteristics''':
**Focus on improving entrepreneurial community through ongoing, recurring support
**Help and guide the startups on: business plans and models, management, development, execution, technology innovation, marketing, sales
**Common fields/occupations: founder/CEO of another company, business development, serial entrepreneur, marketing, sales, management consulting, technology and innovation, research professor etc.
**Some companies offer mentor office hours

*'''TBD Points''':

'''Investors'''

*'''Desc''':

*'''Characteristics''':
**Focus on investing on early stage or growth stage startups
**Usually from VC firms
**Common fields/ occupations: VC firm manager, VC firm partner, fund manager

*'''TBD Points''':

*'''Potential Turks''':
#Search allintext:"office hours" site:URL
#Mark office hours as 1 if

====Onsite temporary workshops v. networking events====
'''Temporary Workshops'''

*'''Desc''':

*'''Characteristics''':
**The purpose is learning and discussing
**Often have a specific topic: business issue (e.g. online marketing) or techniques learning (e.g. intro to Java script)
**In the forms of: workshop, class, panel, project, XX session, seminar, series, intro to XX
**Exception: tech meetup is usually a workshop(e.g. C++ programmer meetup, http://techranchaustin.com/events/)

*'''TBD Points''':

*'''Potential Turks''':

'''Networking Events'''

*'''Desc''':

*'''Characteristics''':
**The purpose is to meet fellow entrepreneurs and experts and networking with them
**Focus on experience sharing or communication as opposed to discussing a specific topic or technical subject
**In the forms of: meetup, networking, happy hour, info session?, luncheon, XX night, socials, talks??, community XX

*'''TBD Points''':

*'''Potential Turks''':

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

Ariel Sun (Work Log)

2016-07-20T21:55:18Z

ArielSun:

Ariel Sun (Work Log)

2016-07-20T21:54:10Z

ArielSun:

[[Category:Work Log]]
[[Ariel Sun]] [[Work Logs]] [[Ariel Sun (Work Log)|(log page)]]

06/01/2016 - Introduction/Wiki Building

06/02/2016 - Refined Wiki Organization and Content

06/03/2016 - Organized Topic Areas and Worked on Public Wiki Page

06/06/2016 - Continued Organizing Public Wiki Page

06/07/2016 - Draft of Women in Entrepreneurship blog post

06/08/2016 - Work on Challenges Women Entrepreneurs Face wiki page

06/09/2016 - Clean up content of patent trolls and put on the public page

06/10/2016 - Put up resources for business dynamism in high tech issue brief page

06/13/2016 - Clean up venture one data and LBO data

06/14/2016 - Match venture one and LBO data to patent data

06/15/2016 - Create tables that match patent information to each LBO/venture company

06/16/2016 - Create and Finalize LBO/venture company and patent summary table

06/17/2016 - Familiarize with Hubs datasets

06/20/2016 - Analyze existing SQL code of Hubs datasets

06/21/2016 - Clean up and rebuild Hubs datasets

06/22/2016 - First draft of complete SQL script for Hubs datasets

07/15/2016 - Help Ed send out VentureOne data, add grouping, considerations of Hubs scorecard variables

07/18/2016 - Work on differentiating curriculum v. code school, redo Matching VentureOne

07/19/2016 - Finish Marching Venture One, update on Wiki, work on differentiating curriculum v. code school

07/20/2016 - Work on differentiating OH investor v. mentor, temporary workshop v. networking meetup

Ariel Sun (Work Log)

2016-07-20T21:53:53Z

ArielSun:

[[Category:Work Log]]
[[Ariel Sun]] [[Work Logs]] [[Ariel Sun (Work Log)|(log page)]]

06/01/2016 - Introduction/Wiki Building

06/02/2016 - Refined Wiki Organization and Content

06/03/2016 - Organized Topic Areas and Worked on Public Wiki Page

06/06/2016 - Continued Organizing Public Wiki Page

06/07/2016 - Draft of Women in Entrepreneurship blog post

06/08/2016 - Work on Challenges Women Entrepreneurs Face wiki page

06/09/2016 - Clean up content of patent trolls and put on the public page

06/10/2016 - Put up resources for business dynamism in high tech issue brief page

06/13/2016 - Clean up venture one data and LBO data

06/14/2016 - Match venture one and LBO data to patent data

06/15/2016 - Create tables that match patent information to each LBO/venture company

06/16/2016 - Create and Finalize LBO/venture company and patent summary table

06/17/2016 - Familiarize with Hubs datasets

06/20/2016 - Analyze existing SQL code of Hubs datasets

06/21/2016 - Clean up and rebuild Hubs datasets

06/22/2016 - First draft of complete SQL script for Hubs datasets

07/15/2016 - Help Ed send out VentureOne data, add grouping, considerations of Hubs scorecard variables
07/18/2016 - Work on differentiating curriculum v. code school, redo Matching VentureOne
07/19/2016 - Finish Marching Venture One, update on Wiki, work on differentiating curriculum v. code school
07/20/2016 - Work on differentiating OH investor v. mentor, temporary workshop v. networking meetup

Hubs: Hubs Data

2016-07-20T21:49:02Z

ArielSun: /* Onsite temporary workshops v. networking events */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Test processes and audit
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Friday 7/28
#Have a comprehensive list of potential hubs
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Tuesday 7/26
#Fill in Remaining Data Manually
#*Status: NS
#*Begin Date: Monday 7/25
#*Reach Goal: Complete by Friday 7/29

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Sponsors/Partners
#*'''STATUS''': Not Started
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Specific Industry
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Cultivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
**'''Search Text''': Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
*'''TBD points'''
*'''Potential Turks'''
**'''Search Text 1''': website design, coding, web development, software, bootcamp
**'''Search Text 2''': General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite VC v. Angel Investors====

====Onsite OH Investors v. mentors====
Thoughts (Ariel, 07/20):
The names listed on 'mentor' page/sections must all be mentors, and the same applies for investors/OH investors although few companies list their investors. So here the only thing we are trying to differentiate is whether the mentor is a investor. maybe via checking whether they are from a VC firm?? But even they are from VC companies doesn't mean they are going to invest on the startups of the Hubs they are mentoring on. Or another way to think about it is differentiating between mentors/OH mentors. Mentors tend to give the particular startups long term support and available when needed while OH mentors only gives advice on the spot.

'''Mentors'''

*'''Desc''':

*'''Characteristics''':
**Focus on improving entrepreneurial community through ongoing, recurring support
**Help and guide the startups on: business plans and models, management, development, execution, technology innovation, marketing, sales
**Common fields/occupations: founder/CEO of another company, business development, serial entrepreneur, marketing, sales, management consulting, technology and innovation, research professor etc.
**Some companies offer mentor office hours

*'''TBD Points''':

*'''Potential Turks''':

'''Investors'''

*'''Desc''':

*'''Characteristics''':
**Focus on investing on early stage or growth stage startups
**Usually from VC firms
**Common fields/ occupations: VC firm manager, VC firm partner, fund manager

*'''TBD Points''':

*'''Potential Turks''':

====Onsite temporary workshops v. networking events====
'''Temporary Workshops'''

*'''Desc''':

*'''Characteristics''':
**The purpose is learning and discussing
**Often have a specific topic: business issue (e.g. online marketing) or techniques learning (e.g. intro to Java script)
**In the forms of: workshop, class, panel, project, XX session, seminar, series, intro to XX
**Exception: tech meetup is usually a workshop(e.g. C++ programmer meetup, http://techranchaustin.com/events/)

*'''TBD Points''':

*'''Potential Turks''':

'''Networking Events'''

*'''Desc''':

*'''Characteristics''':
**The purpose is to meet fellow entrepreneurs and experts and networking with them
**Focus on experience sharing or communication as opposed to discussing a specific topic or technical subject
**In the forms of: meetup, networking, happy hour, info session?, luncheon, XX night, socials, talks??, community XX

*'''TBD Points''':

*'''Potential Turks''':

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

=OLD1=
We will be creating a "Hubs scorecard" to determine how hub-like potential spaces are. In order to do so, we will evaluate the places based on certain variables. Previous variables for potential hubs were collected. Below, we list those as well as other variables we think might be helpful to build out the scorecard.

Ideally, we would have the following variables (not collected previously):
#Onsite VC/Angel/Investors (Count or binary)
##Comments:
##Mechanical Turk Comments:
#Onsite Mentors (binary) --- ''Are these the same as advisers?''
##Comments:
##Mechanical Turk Comments:
#"Office hours" with investors or mentors (binary)
##Comments: Previously collected included number of events, but did not separate them into categories (e.g. networking events, workshops, etc.). We view this separation as important, BUT very difficult to collect
##Mechanical Turk Comments:
#Onsite temporary workshops (binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Networking Meetups (Binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Sponsors and Partners (binary and list) --- a''re these the same?''
##Comments:
##Mechanical Turk Comments:
#Alumni Network (binary) --- ''not all potential hubslist this and the fact that some do might indicate its importance''
##Comments:
##Mechanical Turk Comments:
#Num of Companies --- ''to help determine size as getting physical sqfootage is difficult''
##Comments:
##Mechanical Turk Comments:
#Nonprofit (binary) --- ''helpful in determining goals of potential hubs''
##Comments:
##Mechanical Turk Comments:
#Mission Includes Key Buzzwords (e.g. "ecosystem", "community") --- ''help separate simple coworking spaces form hubs''

Example of Prior Variables Collected:
*Specific Industry -- ''defined as LinkedIN Self Identifier, no categories just plain text. We think what we really want is to see if they have a specialty (e.g. healthcare)''
*Num of Events --- ''relatively complete inputs, but from March 2016 (see above as well)''
*Price for Single Space --- ''defined as price for flexible desk, relatively complete inputs''
*Price for Office --- ''no inputs''
*Twitter Activity (Multinomial or Count) --- ''High=2/Moderate=1/No=0, no explanations on how to categorize the activity. Also no handles''
*Size (sqft) --- ''no records for majority of the companies''
*Num Conference Rooms --- ''no records for majority of the companies''
*Onsite accelerator (binary) --- ''relatively complete inputs''
*Onsite code school (binary) --- ''relatively complete inputs''
*Community Membership (binary) --- ''relatively complete inputs''

=OLD2=
*'''Twitter activity''': ''
'''UPDATE (7/14)''': Updated turk to reflect our desired formats
'''UPDATE (7/12)''': '''AUDIT RESULTS''': We noticed

'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#Copy the text in the Search Text into a search engine.
#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#Record the company's Twitter Handle into Twitter Handle
#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.

*'''NUMBER OF EVENTS''': ''UPDATE: written, not published, on amazon's mechanical turk site''
'''Considerations'''
*Difficulties Encountered:
*Expected Time to Complete:
*Expectation of Results (accuracy of turk, comprehensiveness):
*Other Comments:

'''Procedure'''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events in July 2016 and record it. If there is no information of events on the website, record DNE.

Note***: ''Events include meetups, workshops, info sessions etc. We do not want to count them separately since it is difficult to do so. Most companies put all the events on the same section and do not put event types in the titles of the events. We have to look into the details of the events to find out the type and even we do so some events descriptions do not allow us to determine the type easily. Differentiating the types of the events demands more time and effort and therefore is not suitable to be a mechanical turk project.''

*'''Onsite Mentors''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'
#If the key words can be identified, mark as 1
#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., look for a subsection or mention of mentor/mentorship/mentoring
#If these exist, mark as 1.
#If not, go to links related to membership 'benefits,' 'perks,' or related.
#Do same process as end of 4 and 5
#If there is no mention of mentorship in these sections, type the company, city, and 'mentoring' into a search engine. If a link to a reliable website (such as Desktime) appears and mentorship can be found in the description, mark as 1.
#If none of these steps result in a mark of 1, mark as 0

*'''Nonprofit''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Go to links that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'
#Look for the key word 'nonprofit'/'non-profit'
#If 'nonprofit' is identified, mark as 1, otherwise 0.

*'''Number of Members''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link 'Members' or 'Residents', usually they are under the links 'Community', 'Membership', 'Our Space' or 'The Space'.
#Count the number of members
#If the link or section of 'Members' is not found, go the 'Community' and 'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.
#If number of members cannot be identified using above steps, record DNE.

*'''Sponsors and Partners''':''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link or mention of 'Sponsors' or 'Partners', many times of which is often under the section of 'About', 'Community', or related sections
#If sponsors or partners can be found mark as 1 and list them, otherwise mark as 0.

Hubs: Hubs Data

2016-07-20T21:48:16Z

ArielSun: /* Onsite temporary workshops v. networking events */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Test processes and audit
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Friday 7/28
#Have a comprehensive list of potential hubs
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Tuesday 7/26
#Fill in Remaining Data Manually
#*Status: NS
#*Begin Date: Monday 7/25
#*Reach Goal: Complete by Friday 7/29

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Sponsors/Partners
#*'''STATUS''': Not Started
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Specific Industry
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Cultivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
**'''Search Text''': Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
*'''TBD points'''
*'''Potential Turks'''
**'''Search Text 1''': website design, coding, web development, software, bootcamp
**'''Search Text 2''': General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite VC v. Angel Investors====

====Onsite OH Investors v. mentors====
Thoughts (Ariel, 07/20):
The names listed on 'mentor' page/sections must all be mentors, and the same applies for investors/OH investors although few companies list their investors. So here the only thing we are trying to differentiate is whether the mentor is a investor. maybe via checking whether they are from a VC firm?? But even they are from VC companies doesn't mean they are going to invest on the startups of the Hubs they are mentoring on. Or another way to think about it is differentiating between mentors/OH mentors. Mentors tend to give the particular startups long term support and available when needed while OH mentors only gives advice on the spot.

'''Mentors'''

*'''Desc''':

*'''Characteristics''':
**Focus on improving entrepreneurial community through ongoing, recurring support
**Help and guide the startups on: business plans and models, management, development, execution, technology innovation, marketing, sales
**Common fields/occupations: founder/CEO of another company, business development, serial entrepreneur, marketing, sales, management consulting, technology and innovation, research professor etc.
**Some companies offer mentor office hours

*'''TBD Points''':

*'''Potential Turks''':

'''Investors'''

*'''Desc''':

*'''Characteristics''':
**Focus on investing on early stage or growth stage startups
**Usually from VC firms
**Common fields/ occupations: VC firm manager, VC firm partner, fund manager

*'''TBD Points''':

*'''Potential Turks''':

====Onsite temporary workshops v. networking events====
'''Temporary Workshops'''

*'''Desc''':

*'''Characteristics''':
**The purpose is learning and discussing
**Often have a specific topic: business issue (e.g. online marketing) or techniques learning (e.g. intro to Java script)
**In the forms of: workshop, class, panel, project, XX session, seminar, series, intro to XX
**Exception: tech meetup is usually a workshop(e.g. C++ programmer meetup, http://techranchaustin.com/events/)

*'''TBD Points''':

*'''Potential Turks''':

'''Networking Events'''

*'''Desc''':

*'''Characteristics''':
**The purpose is to meet fellow entrepreneurs and experts and networking with them
**Focus on experience sharing or communication as opposed to discussing a specific topic or technical subject
**In the forms of: meetup, networking, happy hour, info session?, luncheon, XX night, socials, talks??, community XX

*'''TBD Points''':

*'''Potential Turks''':

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

=OLD1=
We will be creating a "Hubs scorecard" to determine how hub-like potential spaces are. In order to do so, we will evaluate the places based on certain variables. Previous variables for potential hubs were collected. Below, we list those as well as other variables we think might be helpful to build out the scorecard.

Ideally, we would have the following variables (not collected previously):
#Onsite VC/Angel/Investors (Count or binary)
##Comments:
##Mechanical Turk Comments:
#Onsite Mentors (binary) --- ''Are these the same as advisers?''
##Comments:
##Mechanical Turk Comments:
#"Office hours" with investors or mentors (binary)
##Comments: Previously collected included number of events, but did not separate them into categories (e.g. networking events, workshops, etc.). We view this separation as important, BUT very difficult to collect
##Mechanical Turk Comments:
#Onsite temporary workshops (binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Networking Meetups (Binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Sponsors and Partners (binary and list) --- a''re these the same?''
##Comments:
##Mechanical Turk Comments:
#Alumni Network (binary) --- ''not all potential hubslist this and the fact that some do might indicate its importance''
##Comments:
##Mechanical Turk Comments:
#Num of Companies --- ''to help determine size as getting physical sqfootage is difficult''
##Comments:
##Mechanical Turk Comments:
#Nonprofit (binary) --- ''helpful in determining goals of potential hubs''
##Comments:
##Mechanical Turk Comments:
#Mission Includes Key Buzzwords (e.g. "ecosystem", "community") --- ''help separate simple coworking spaces form hubs''

Example of Prior Variables Collected:
*Specific Industry -- ''defined as LinkedIN Self Identifier, no categories just plain text. We think what we really want is to see if they have a specialty (e.g. healthcare)''
*Num of Events --- ''relatively complete inputs, but from March 2016 (see above as well)''
*Price for Single Space --- ''defined as price for flexible desk, relatively complete inputs''
*Price for Office --- ''no inputs''
*Twitter Activity (Multinomial or Count) --- ''High=2/Moderate=1/No=0, no explanations on how to categorize the activity. Also no handles''
*Size (sqft) --- ''no records for majority of the companies''
*Num Conference Rooms --- ''no records for majority of the companies''
*Onsite accelerator (binary) --- ''relatively complete inputs''
*Onsite code school (binary) --- ''relatively complete inputs''
*Community Membership (binary) --- ''relatively complete inputs''

=OLD2=
*'''Twitter activity''': ''
'''UPDATE (7/14)''': Updated turk to reflect our desired formats
'''UPDATE (7/12)''': '''AUDIT RESULTS''': We noticed

'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#Copy the text in the Search Text into a search engine.
#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#Record the company's Twitter Handle into Twitter Handle
#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.

*'''NUMBER OF EVENTS''': ''UPDATE: written, not published, on amazon's mechanical turk site''
'''Considerations'''
*Difficulties Encountered:
*Expected Time to Complete:
*Expectation of Results (accuracy of turk, comprehensiveness):
*Other Comments:

'''Procedure'''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events in July 2016 and record it. If there is no information of events on the website, record DNE.

Note***: ''Events include meetups, workshops, info sessions etc. We do not want to count them separately since it is difficult to do so. Most companies put all the events on the same section and do not put event types in the titles of the events. We have to look into the details of the events to find out the type and even we do so some events descriptions do not allow us to determine the type easily. Differentiating the types of the events demands more time and effort and therefore is not suitable to be a mechanical turk project.''

*'''Onsite Mentors''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'
#If the key words can be identified, mark as 1
#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., look for a subsection or mention of mentor/mentorship/mentoring
#If these exist, mark as 1.
#If not, go to links related to membership 'benefits,' 'perks,' or related.
#Do same process as end of 4 and 5
#If there is no mention of mentorship in these sections, type the company, city, and 'mentoring' into a search engine. If a link to a reliable website (such as Desktime) appears and mentorship can be found in the description, mark as 1.
#If none of these steps result in a mark of 1, mark as 0

*'''Nonprofit''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Go to links that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'
#Look for the key word 'nonprofit'/'non-profit'
#If 'nonprofit' is identified, mark as 1, otherwise 0.

*'''Number of Members''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link 'Members' or 'Residents', usually they are under the links 'Community', 'Membership', 'Our Space' or 'The Space'.
#Count the number of members
#If the link or section of 'Members' is not found, go the 'Community' and 'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.
#If number of members cannot be identified using above steps, record DNE.

*'''Sponsors and Partners''':''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link or mention of 'Sponsors' or 'Partners', many times of which is often under the section of 'About', 'Community', or related sections
#If sponsors or partners can be found mark as 1 and list them, otherwise mark as 0.

Hubs: Hubs Data

2016-07-20T21:12:06Z

ArielSun: /* Onsite temporary workshops v. networking events */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Test processes and audit
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Friday 7/28
#Have a comprehensive list of potential hubs
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Tuesday 7/26
#Fill in Remaining Data Manually
#*Status: NS
#*Begin Date: Monday 7/25
#*Reach Goal: Complete by Friday 7/29

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Sponsors/Partners
#*'''STATUS''': Not Started
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Specific Industry
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Cultivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
**'''Search Text''': Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
*'''TBD points'''
*'''Potential Turks'''
**'''Search Text 1''': website design, coding, web development, software, bootcamp
**'''Search Text 2''': General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite VC v. Angel Investors====

====Onsite OH Investors v. mentors====
Thoughts (Ariel, 07/20):
The names listed on 'mentor' page/sections must all be mentors, and the same applies for investors/OH investors although few companies list their investors. So here the only thing we are trying to differentiate is whether the mentor is a investor. maybe via checking whether they are from a VC firm?? But even they are from VC companies doesn't mean they are going to invest on the startups of the Hubs they are mentoring on. Or another way to think about it is differentiating between mentors/OH mentors. Mentors tend to give the particular startups long term support and available when needed while OH mentors only gives advice on the spot.

'''Mentors'''

*'''Desc''':

*'''Characteristics''':
**Focus on improving entrepreneurial community through ongoing, recurring support
**Help and guide the startups on: business plans and models, management, development, execution, technology innovation, marketing, sales
**Common fields/occupations: founder/CEO of another company, business development, serial entrepreneur, marketing, sales, management consulting, technology and innovation, research professor etc.
**Some companies offer mentor office hours

*'''TBD Points''':

*'''Potential Turks''':

'''Investors'''

*'''Desc''':

*'''Characteristics''':
**Focus on investing on early stage or growth stage startups
**Usually from VC firms
**Common fields/ occupations: VC firm manager, VC firm partner, fund manager

*'''TBD Points''':

*'''Potential Turks''':

====Onsite temporary workshops v. networking events====
'''Temporary Workshops'''

*'''Desc''':

*'''Characteristics''':

*'''TBD Points''':

*'''Potential Turks''':

'''Networking Events'''

*'''Desc''':

*'''Characteristics''':

*'''TBD Points''':

*'''Potential Turks''':

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

=OLD1=
We will be creating a "Hubs scorecard" to determine how hub-like potential spaces are. In order to do so, we will evaluate the places based on certain variables. Previous variables for potential hubs were collected. Below, we list those as well as other variables we think might be helpful to build out the scorecard.

Ideally, we would have the following variables (not collected previously):
#Onsite VC/Angel/Investors (Count or binary)
##Comments:
##Mechanical Turk Comments:
#Onsite Mentors (binary) --- ''Are these the same as advisers?''
##Comments:
##Mechanical Turk Comments:
#"Office hours" with investors or mentors (binary)
##Comments: Previously collected included number of events, but did not separate them into categories (e.g. networking events, workshops, etc.). We view this separation as important, BUT very difficult to collect
##Mechanical Turk Comments:
#Onsite temporary workshops (binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Networking Meetups (Binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Sponsors and Partners (binary and list) --- a''re these the same?''
##Comments:
##Mechanical Turk Comments:
#Alumni Network (binary) --- ''not all potential hubslist this and the fact that some do might indicate its importance''
##Comments:
##Mechanical Turk Comments:
#Num of Companies --- ''to help determine size as getting physical sqfootage is difficult''
##Comments:
##Mechanical Turk Comments:
#Nonprofit (binary) --- ''helpful in determining goals of potential hubs''
##Comments:
##Mechanical Turk Comments:
#Mission Includes Key Buzzwords (e.g. "ecosystem", "community") --- ''help separate simple coworking spaces form hubs''

Example of Prior Variables Collected:
*Specific Industry -- ''defined as LinkedIN Self Identifier, no categories just plain text. We think what we really want is to see if they have a specialty (e.g. healthcare)''
*Num of Events --- ''relatively complete inputs, but from March 2016 (see above as well)''
*Price for Single Space --- ''defined as price for flexible desk, relatively complete inputs''
*Price for Office --- ''no inputs''
*Twitter Activity (Multinomial or Count) --- ''High=2/Moderate=1/No=0, no explanations on how to categorize the activity. Also no handles''
*Size (sqft) --- ''no records for majority of the companies''
*Num Conference Rooms --- ''no records for majority of the companies''
*Onsite accelerator (binary) --- ''relatively complete inputs''
*Onsite code school (binary) --- ''relatively complete inputs''
*Community Membership (binary) --- ''relatively complete inputs''

=OLD2=
*'''Twitter activity''': ''
'''UPDATE (7/14)''': Updated turk to reflect our desired formats
'''UPDATE (7/12)''': '''AUDIT RESULTS''': We noticed

'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#Copy the text in the Search Text into a search engine.
#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#Record the company's Twitter Handle into Twitter Handle
#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.

*'''NUMBER OF EVENTS''': ''UPDATE: written, not published, on amazon's mechanical turk site''
'''Considerations'''
*Difficulties Encountered:
*Expected Time to Complete:
*Expectation of Results (accuracy of turk, comprehensiveness):
*Other Comments:

'''Procedure'''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events in July 2016 and record it. If there is no information of events on the website, record DNE.

Note***: ''Events include meetups, workshops, info sessions etc. We do not want to count them separately since it is difficult to do so. Most companies put all the events on the same section and do not put event types in the titles of the events. We have to look into the details of the events to find out the type and even we do so some events descriptions do not allow us to determine the type easily. Differentiating the types of the events demands more time and effort and therefore is not suitable to be a mechanical turk project.''

*'''Onsite Mentors''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'
#If the key words can be identified, mark as 1
#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., look for a subsection or mention of mentor/mentorship/mentoring
#If these exist, mark as 1.
#If not, go to links related to membership 'benefits,' 'perks,' or related.
#Do same process as end of 4 and 5
#If there is no mention of mentorship in these sections, type the company, city, and 'mentoring' into a search engine. If a link to a reliable website (such as Desktime) appears and mentorship can be found in the description, mark as 1.
#If none of these steps result in a mark of 1, mark as 0

*'''Nonprofit''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Go to links that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'
#Look for the key word 'nonprofit'/'non-profit'
#If 'nonprofit' is identified, mark as 1, otherwise 0.

*'''Number of Members''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link 'Members' or 'Residents', usually they are under the links 'Community', 'Membership', 'Our Space' or 'The Space'.
#Count the number of members
#If the link or section of 'Members' is not found, go the 'Community' and 'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.
#If number of members cannot be identified using above steps, record DNE.

*'''Sponsors and Partners''':''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link or mention of 'Sponsors' or 'Partners', many times of which is often under the section of 'About', 'Community', or related sections
#If sponsors or partners can be found mark as 1 and list them, otherwise mark as 0.

Hubs: Hubs Data

2016-07-20T21:09:27Z

ArielSun: /* Onsite OH Investors v. mentors */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Test processes and audit
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Friday 7/28
#Have a comprehensive list of potential hubs
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Tuesday 7/26
#Fill in Remaining Data Manually
#*Status: NS
#*Begin Date: Monday 7/25
#*Reach Goal: Complete by Friday 7/29

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Sponsors/Partners
#*'''STATUS''': Not Started
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Specific Industry
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Cultivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
**'''Search Text''': Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
*'''TBD points'''
*'''Potential Turks'''
**'''Search Text 1''': website design, coding, web development, software, bootcamp
**'''Search Text 2''': General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite VC v. Angel Investors====

====Onsite OH Investors v. mentors====
Thoughts (Ariel, 07/20):
The names listed on 'mentor' page/sections must all be mentors, and the same applies for investors/OH investors although few companies list their investors. So here the only thing we are trying to differentiate is whether the mentor is a investor. maybe via checking whether they are from a VC firm?? But even they are from VC companies doesn't mean they are going to invest on the startups of the Hubs they are mentoring on. Or another way to think about it is differentiating between mentors/OH mentors. Mentors tend to give the particular startups long term support and available when needed while OH mentors only gives advice on the spot.

'''Mentors'''

*'''Desc''':

*'''Characteristics''':
**Focus on improving entrepreneurial community through ongoing, recurring support
**Help and guide the startups on: business plans and models, management, development, execution, technology innovation, marketing, sales
**Common fields/occupations: founder/CEO of another company, business development, serial entrepreneur, marketing, sales, management consulting, technology and innovation, research professor etc.
**Some companies offer mentor office hours

*'''TBD Points''':

*'''Potential Turks''':

'''Investors'''

*'''Desc''':

*'''Characteristics''':
**Focus on investing on early stage or growth stage startups
**Usually from VC firms
**Common fields/ occupations: VC firm manager, VC firm partner, fund manager

*'''TBD Points''':

*'''Potential Turks''':

====Onsite temporary workshops v. networking events====

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

=OLD1=
We will be creating a "Hubs scorecard" to determine how hub-like potential spaces are. In order to do so, we will evaluate the places based on certain variables. Previous variables for potential hubs were collected. Below, we list those as well as other variables we think might be helpful to build out the scorecard.

Ideally, we would have the following variables (not collected previously):
#Onsite VC/Angel/Investors (Count or binary)
##Comments:
##Mechanical Turk Comments:
#Onsite Mentors (binary) --- ''Are these the same as advisers?''
##Comments:
##Mechanical Turk Comments:
#"Office hours" with investors or mentors (binary)
##Comments: Previously collected included number of events, but did not separate them into categories (e.g. networking events, workshops, etc.). We view this separation as important, BUT very difficult to collect
##Mechanical Turk Comments:
#Onsite temporary workshops (binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Networking Meetups (Binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Sponsors and Partners (binary and list) --- a''re these the same?''
##Comments:
##Mechanical Turk Comments:
#Alumni Network (binary) --- ''not all potential hubslist this and the fact that some do might indicate its importance''
##Comments:
##Mechanical Turk Comments:
#Num of Companies --- ''to help determine size as getting physical sqfootage is difficult''
##Comments:
##Mechanical Turk Comments:
#Nonprofit (binary) --- ''helpful in determining goals of potential hubs''
##Comments:
##Mechanical Turk Comments:
#Mission Includes Key Buzzwords (e.g. "ecosystem", "community") --- ''help separate simple coworking spaces form hubs''

Example of Prior Variables Collected:
*Specific Industry -- ''defined as LinkedIN Self Identifier, no categories just plain text. We think what we really want is to see if they have a specialty (e.g. healthcare)''
*Num of Events --- ''relatively complete inputs, but from March 2016 (see above as well)''
*Price for Single Space --- ''defined as price for flexible desk, relatively complete inputs''
*Price for Office --- ''no inputs''
*Twitter Activity (Multinomial or Count) --- ''High=2/Moderate=1/No=0, no explanations on how to categorize the activity. Also no handles''
*Size (sqft) --- ''no records for majority of the companies''
*Num Conference Rooms --- ''no records for majority of the companies''
*Onsite accelerator (binary) --- ''relatively complete inputs''
*Onsite code school (binary) --- ''relatively complete inputs''
*Community Membership (binary) --- ''relatively complete inputs''

=OLD2=
*'''Twitter activity''': ''
'''UPDATE (7/14)''': Updated turk to reflect our desired formats
'''UPDATE (7/12)''': '''AUDIT RESULTS''': We noticed

'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#Copy the text in the Search Text into a search engine.
#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#Record the company's Twitter Handle into Twitter Handle
#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.

*'''NUMBER OF EVENTS''': ''UPDATE: written, not published, on amazon's mechanical turk site''
'''Considerations'''
*Difficulties Encountered:
*Expected Time to Complete:
*Expectation of Results (accuracy of turk, comprehensiveness):
*Other Comments:

'''Procedure'''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events in July 2016 and record it. If there is no information of events on the website, record DNE.

Note***: ''Events include meetups, workshops, info sessions etc. We do not want to count them separately since it is difficult to do so. Most companies put all the events on the same section and do not put event types in the titles of the events. We have to look into the details of the events to find out the type and even we do so some events descriptions do not allow us to determine the type easily. Differentiating the types of the events demands more time and effort and therefore is not suitable to be a mechanical turk project.''

*'''Onsite Mentors''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'
#If the key words can be identified, mark as 1
#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., look for a subsection or mention of mentor/mentorship/mentoring
#If these exist, mark as 1.
#If not, go to links related to membership 'benefits,' 'perks,' or related.
#Do same process as end of 4 and 5
#If there is no mention of mentorship in these sections, type the company, city, and 'mentoring' into a search engine. If a link to a reliable website (such as Desktime) appears and mentorship can be found in the description, mark as 1.
#If none of these steps result in a mark of 1, mark as 0

*'''Nonprofit''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Go to links that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'
#Look for the key word 'nonprofit'/'non-profit'
#If 'nonprofit' is identified, mark as 1, otherwise 0.

*'''Number of Members''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link 'Members' or 'Residents', usually they are under the links 'Community', 'Membership', 'Our Space' or 'The Space'.
#Count the number of members
#If the link or section of 'Members' is not found, go the 'Community' and 'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.
#If number of members cannot be identified using above steps, record DNE.

*'''Sponsors and Partners''':''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link or mention of 'Sponsors' or 'Partners', many times of which is often under the section of 'About', 'Community', or related sections
#If sponsors or partners can be found mark as 1 and list them, otherwise mark as 0.

Hubs: Hubs Data

2016-07-20T21:08:54Z

ArielSun: /* Group 4 */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Test processes and audit
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Friday 7/28
#Have a comprehensive list of potential hubs
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Tuesday 7/26
#Fill in Remaining Data Manually
#*Status: NS
#*Begin Date: Monday 7/25
#*Reach Goal: Complete by Friday 7/29

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Sponsors/Partners
#*'''STATUS''': Not Started
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Specific Industry
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Cultivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
**'''Search Text''': Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
*'''TBD points'''
*'''Potential Turks'''
**'''Search Text 1''': website design, coding, web development, software, bootcamp
**'''Search Text 2''': General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite VC v. Angel Investors====

====Onsite OH Investors v. mentors====
Thoughts (Ariel, 07/20):
The name listed on 'mentor' page/sections must all be mentors, and the same applies for investors/OH investors although few companies list their investors. So here the only thing we are trying to differentiate is whether the mentor is a investor. maybe via checking whether they are from a VC firm?? But even they are from VC companies doesn't mean they are going to invest on the startups of the Hubs they are mentoring on. Or another way to think about it is differentiating between mentors/OH mentors. Mentors tend to give the particular startups long term support and available when needed while OH mentors only gives advice on the spot.

'''Mentors'''

*'''Desc''':

*'''Characteristics''':
**Focus on improving entrepreneurial community through ongoing, recurring support
**Help and guide the startups on: business plans and models, management, development, execution, technology innovation, marketing, sales
**Common fields/occupations: founder/CEO of another company, business development, serial entrepreneur, marketing, sales, management consulting, technology and innovation, research professor etc.
**Some companies offer mentor office hours

*'''TBD Points''':

*'''Potential Turks''':

'''Investors'''

*'''Desc''':

*'''Characteristics''':
**Focus on investing on early stage or growth stage startups
**Usually from VC firms
**Common fields/ occupations: VC firm manager, VC firm partner, fund manager

*'''TBD Points''':

*'''Potential Turks''':

====Onsite temporary workshops v. networking events====

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

=OLD1=
We will be creating a "Hubs scorecard" to determine how hub-like potential spaces are. In order to do so, we will evaluate the places based on certain variables. Previous variables for potential hubs were collected. Below, we list those as well as other variables we think might be helpful to build out the scorecard.

Ideally, we would have the following variables (not collected previously):
#Onsite VC/Angel/Investors (Count or binary)
##Comments:
##Mechanical Turk Comments:
#Onsite Mentors (binary) --- ''Are these the same as advisers?''
##Comments:
##Mechanical Turk Comments:
#"Office hours" with investors or mentors (binary)
##Comments: Previously collected included number of events, but did not separate them into categories (e.g. networking events, workshops, etc.). We view this separation as important, BUT very difficult to collect
##Mechanical Turk Comments:
#Onsite temporary workshops (binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Networking Meetups (Binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Sponsors and Partners (binary and list) --- a''re these the same?''
##Comments:
##Mechanical Turk Comments:
#Alumni Network (binary) --- ''not all potential hubslist this and the fact that some do might indicate its importance''
##Comments:
##Mechanical Turk Comments:
#Num of Companies --- ''to help determine size as getting physical sqfootage is difficult''
##Comments:
##Mechanical Turk Comments:
#Nonprofit (binary) --- ''helpful in determining goals of potential hubs''
##Comments:
##Mechanical Turk Comments:
#Mission Includes Key Buzzwords (e.g. "ecosystem", "community") --- ''help separate simple coworking spaces form hubs''

Example of Prior Variables Collected:
*Specific Industry -- ''defined as LinkedIN Self Identifier, no categories just plain text. We think what we really want is to see if they have a specialty (e.g. healthcare)''
*Num of Events --- ''relatively complete inputs, but from March 2016 (see above as well)''
*Price for Single Space --- ''defined as price for flexible desk, relatively complete inputs''
*Price for Office --- ''no inputs''
*Twitter Activity (Multinomial or Count) --- ''High=2/Moderate=1/No=0, no explanations on how to categorize the activity. Also no handles''
*Size (sqft) --- ''no records for majority of the companies''
*Num Conference Rooms --- ''no records for majority of the companies''
*Onsite accelerator (binary) --- ''relatively complete inputs''
*Onsite code school (binary) --- ''relatively complete inputs''
*Community Membership (binary) --- ''relatively complete inputs''

=OLD2=
*'''Twitter activity''': ''
'''UPDATE (7/14)''': Updated turk to reflect our desired formats
'''UPDATE (7/12)''': '''AUDIT RESULTS''': We noticed

'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#Copy the text in the Search Text into a search engine.
#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#Record the company's Twitter Handle into Twitter Handle
#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.

*'''NUMBER OF EVENTS''': ''UPDATE: written, not published, on amazon's mechanical turk site''
'''Considerations'''
*Difficulties Encountered:
*Expected Time to Complete:
*Expectation of Results (accuracy of turk, comprehensiveness):
*Other Comments:

'''Procedure'''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events in July 2016 and record it. If there is no information of events on the website, record DNE.

Note***: ''Events include meetups, workshops, info sessions etc. We do not want to count them separately since it is difficult to do so. Most companies put all the events on the same section and do not put event types in the titles of the events. We have to look into the details of the events to find out the type and even we do so some events descriptions do not allow us to determine the type easily. Differentiating the types of the events demands more time and effort and therefore is not suitable to be a mechanical turk project.''

*'''Onsite Mentors''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'
#If the key words can be identified, mark as 1
#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., look for a subsection or mention of mentor/mentorship/mentoring
#If these exist, mark as 1.
#If not, go to links related to membership 'benefits,' 'perks,' or related.
#Do same process as end of 4 and 5
#If there is no mention of mentorship in these sections, type the company, city, and 'mentoring' into a search engine. If a link to a reliable website (such as Desktime) appears and mentorship can be found in the description, mark as 1.
#If none of these steps result in a mark of 1, mark as 0

*'''Nonprofit''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Go to links that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'
#Look for the key word 'nonprofit'/'non-profit'
#If 'nonprofit' is identified, mark as 1, otherwise 0.

*'''Number of Members''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link 'Members' or 'Residents', usually they are under the links 'Community', 'Membership', 'Our Space' or 'The Space'.
#Count the number of members
#If the link or section of 'Members' is not found, go the 'Community' and 'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.
#If number of members cannot be identified using above steps, record DNE.

*'''Sponsors and Partners''':''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link or mention of 'Sponsors' or 'Partners', many times of which is often under the section of 'About', 'Community', or related sections
#If sponsors or partners can be found mark as 1 and list them, otherwise mark as 0.

Hubs: Hubs Data

2016-07-20T21:06:06Z

ArielSun: /* Onsite OH Investors v. mentors */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Test processes and audit
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Friday 7/28
#Have a comprehensive list of potential hubs
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Tuesday 7/26
#Fill in Remaining Data Manually
#*Status: NS
#*Begin Date: Monday 7/25
#*Reach Goal: Complete by Friday 7/29

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Sponsors/Partners
#*'''STATUS''': Not Started
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Specific Industry
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Cultivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
**'''Search Text''': Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
*'''TBD points'''
*'''Potential Turks'''
**'''Search Text 1''': website design, coding, web development, software, bootcamp
**'''Search Text 2''': General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite VC v. Angel Investors====
====Onsite OH Investors v. mentors====
Thoughts (Ariel, 07/20):
The name listed on 'mentor' page/sections must all be mentors, and the same applies for investors/OH investors although few companies list their investors. So here the only thing we are trying to differentiate is whether the mentor is a investor. maybe via checking whether they are from a VC firm?? But even they are from VC companies doesn't mean they are going to invest on the startups of the Hubs they are mentoring on. Or another way to think about it is differentiating between mentors/OH mentors. Mentors tend to give the particular startups long term support and available when needed while OH mentors only gives advice on the spot.

'''Mentors'''

*'''Desc''':

*'''Characteristics''':
**Focus on improving entrepreneurial community through ongoing, recurring support
**Help and guide the startups on: business plans and models, management, development, execution, technology innovation, marketing, sales
**Common fields/occupations: founder/CEO of another company, business development, serial entrepreneur, marketing, sales, management consulting, technology and innovation, research professor etc.
**Some companies offer mentor office hours

*'''TBD Points''':

*'''Potential Turks''':

'''Investors'''

*'''Desc''':

*'''Characteristics''':
**Focus on investing on early stage or growth stage startups
**Usually from VC firms
**Common fields/ occupations: VC firm manager, VC firm partner, fund manager

*'''TBD Points''':

*'''Potential Turks''':

====Onsite temporary workshops v. networking events====

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

=OLD1=
We will be creating a "Hubs scorecard" to determine how hub-like potential spaces are. In order to do so, we will evaluate the places based on certain variables. Previous variables for potential hubs were collected. Below, we list those as well as other variables we think might be helpful to build out the scorecard.

Ideally, we would have the following variables (not collected previously):
#Onsite VC/Angel/Investors (Count or binary)
##Comments:
##Mechanical Turk Comments:
#Onsite Mentors (binary) --- ''Are these the same as advisers?''
##Comments:
##Mechanical Turk Comments:
#"Office hours" with investors or mentors (binary)
##Comments: Previously collected included number of events, but did not separate them into categories (e.g. networking events, workshops, etc.). We view this separation as important, BUT very difficult to collect
##Mechanical Turk Comments:
#Onsite temporary workshops (binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Networking Meetups (Binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Sponsors and Partners (binary and list) --- a''re these the same?''
##Comments:
##Mechanical Turk Comments:
#Alumni Network (binary) --- ''not all potential hubslist this and the fact that some do might indicate its importance''
##Comments:
##Mechanical Turk Comments:
#Num of Companies --- ''to help determine size as getting physical sqfootage is difficult''
##Comments:
##Mechanical Turk Comments:
#Nonprofit (binary) --- ''helpful in determining goals of potential hubs''
##Comments:
##Mechanical Turk Comments:
#Mission Includes Key Buzzwords (e.g. "ecosystem", "community") --- ''help separate simple coworking spaces form hubs''

Example of Prior Variables Collected:
*Specific Industry -- ''defined as LinkedIN Self Identifier, no categories just plain text. We think what we really want is to see if they have a specialty (e.g. healthcare)''
*Num of Events --- ''relatively complete inputs, but from March 2016 (see above as well)''
*Price for Single Space --- ''defined as price for flexible desk, relatively complete inputs''
*Price for Office --- ''no inputs''
*Twitter Activity (Multinomial or Count) --- ''High=2/Moderate=1/No=0, no explanations on how to categorize the activity. Also no handles''
*Size (sqft) --- ''no records for majority of the companies''
*Num Conference Rooms --- ''no records for majority of the companies''
*Onsite accelerator (binary) --- ''relatively complete inputs''
*Onsite code school (binary) --- ''relatively complete inputs''
*Community Membership (binary) --- ''relatively complete inputs''

=OLD2=
*'''Twitter activity''': ''
'''UPDATE (7/14)''': Updated turk to reflect our desired formats
'''UPDATE (7/12)''': '''AUDIT RESULTS''': We noticed

'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#Copy the text in the Search Text into a search engine.
#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#Record the company's Twitter Handle into Twitter Handle
#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.

*'''NUMBER OF EVENTS''': ''UPDATE: written, not published, on amazon's mechanical turk site''
'''Considerations'''
*Difficulties Encountered:
*Expected Time to Complete:
*Expectation of Results (accuracy of turk, comprehensiveness):
*Other Comments:

'''Procedure'''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events in July 2016 and record it. If there is no information of events on the website, record DNE.

Note***: ''Events include meetups, workshops, info sessions etc. We do not want to count them separately since it is difficult to do so. Most companies put all the events on the same section and do not put event types in the titles of the events. We have to look into the details of the events to find out the type and even we do so some events descriptions do not allow us to determine the type easily. Differentiating the types of the events demands more time and effort and therefore is not suitable to be a mechanical turk project.''

*'''Onsite Mentors''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'
#If the key words can be identified, mark as 1
#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., look for a subsection or mention of mentor/mentorship/mentoring
#If these exist, mark as 1.
#If not, go to links related to membership 'benefits,' 'perks,' or related.
#Do same process as end of 4 and 5
#If there is no mention of mentorship in these sections, type the company, city, and 'mentoring' into a search engine. If a link to a reliable website (such as Desktime) appears and mentorship can be found in the description, mark as 1.
#If none of these steps result in a mark of 1, mark as 0

*'''Nonprofit''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Go to links that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'
#Look for the key word 'nonprofit'/'non-profit'
#If 'nonprofit' is identified, mark as 1, otherwise 0.

*'''Number of Members''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link 'Members' or 'Residents', usually they are under the links 'Community', 'Membership', 'Our Space' or 'The Space'.
#Count the number of members
#If the link or section of 'Members' is not found, go the 'Community' and 'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.
#If number of members cannot be identified using above steps, record DNE.

*'''Sponsors and Partners''':''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link or mention of 'Sponsors' or 'Partners', many times of which is often under the section of 'About', 'Community', or related sections
#If sponsors or partners can be found mark as 1 and list them, otherwise mark as 0.

Hubs: Hubs Data

2016-07-20T21:05:36Z

ArielSun: /* Onsite OH Investors v. mentors */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Test processes and audit
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Friday 7/28
#Have a comprehensive list of potential hubs
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Tuesday 7/26
#Fill in Remaining Data Manually
#*Status: NS
#*Begin Date: Monday 7/25
#*Reach Goal: Complete by Friday 7/29

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Sponsors/Partners
#*'''STATUS''': Not Started
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Specific Industry
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Cultivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
**'''Search Text''': Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
*'''TBD points'''
*'''Potential Turks'''
**'''Search Text 1''': website design, coding, web development, software, bootcamp
**'''Search Text 2''': General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite VC v. Angel Investors====
====Onsite OH Investors v. mentors====
Thoughts (Ariel, 07/20):
The name listed on 'mentor' page/sections must all be mentors, and the same applies for investors/OH investors although few companies list their investors. So here the only thing we are trying to differentiate is whether the mentor is a investor. maybe via checking whether they are from a VC firm?? But even they are from VC companies doesn't mean they are going to invest on the startups of the Hubs they are mentoring on. Or another way to think about it is differentiating between mentors/OH mentors. Mentors tend to give the particular startups long term support and available when needed while OH mentors only gives advice on the spot.

'''Mentors'''

*'''Desc''':

*'''Characteristics''':
**Focus on improving entrepreneurial community through ongoing, recurring support
**Help and guide the startups on: business plans and models, management, development, execution, technology innovation, marketing, sales
**Common fields/occupations: founder/CEO of another company, business development, serial entrepreneur, marketing, sales, management consulting, technology and innovation, research professor etc.
**Some companies offer mentor hours

*'''TBD Points''':

*'''Potential Turks''':

'''Investors'''

*'''Desc''':

*'''Characteristics''':
**Focus on investing on early stage or growth stage startups
**Usually from VC firms
**Common fields/ occupations: VC firm manager, VC firm partner, fund manager

*'''TBD Points''':

*'''Potential Turks''':

====Onsite temporary workshops v. networking events====

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

=OLD1=
We will be creating a "Hubs scorecard" to determine how hub-like potential spaces are. In order to do so, we will evaluate the places based on certain variables. Previous variables for potential hubs were collected. Below, we list those as well as other variables we think might be helpful to build out the scorecard.

Ideally, we would have the following variables (not collected previously):
#Onsite VC/Angel/Investors (Count or binary)
##Comments:
##Mechanical Turk Comments:
#Onsite Mentors (binary) --- ''Are these the same as advisers?''
##Comments:
##Mechanical Turk Comments:
#"Office hours" with investors or mentors (binary)
##Comments: Previously collected included number of events, but did not separate them into categories (e.g. networking events, workshops, etc.). We view this separation as important, BUT very difficult to collect
##Mechanical Turk Comments:
#Onsite temporary workshops (binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Networking Meetups (Binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Sponsors and Partners (binary and list) --- a''re these the same?''
##Comments:
##Mechanical Turk Comments:
#Alumni Network (binary) --- ''not all potential hubslist this and the fact that some do might indicate its importance''
##Comments:
##Mechanical Turk Comments:
#Num of Companies --- ''to help determine size as getting physical sqfootage is difficult''
##Comments:
##Mechanical Turk Comments:
#Nonprofit (binary) --- ''helpful in determining goals of potential hubs''
##Comments:
##Mechanical Turk Comments:
#Mission Includes Key Buzzwords (e.g. "ecosystem", "community") --- ''help separate simple coworking spaces form hubs''

Example of Prior Variables Collected:
*Specific Industry -- ''defined as LinkedIN Self Identifier, no categories just plain text. We think what we really want is to see if they have a specialty (e.g. healthcare)''
*Num of Events --- ''relatively complete inputs, but from March 2016 (see above as well)''
*Price for Single Space --- ''defined as price for flexible desk, relatively complete inputs''
*Price for Office --- ''no inputs''
*Twitter Activity (Multinomial or Count) --- ''High=2/Moderate=1/No=0, no explanations on how to categorize the activity. Also no handles''
*Size (sqft) --- ''no records for majority of the companies''
*Num Conference Rooms --- ''no records for majority of the companies''
*Onsite accelerator (binary) --- ''relatively complete inputs''
*Onsite code school (binary) --- ''relatively complete inputs''
*Community Membership (binary) --- ''relatively complete inputs''

=OLD2=
*'''Twitter activity''': ''
'''UPDATE (7/14)''': Updated turk to reflect our desired formats
'''UPDATE (7/12)''': '''AUDIT RESULTS''': We noticed

'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#Copy the text in the Search Text into a search engine.
#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#Record the company's Twitter Handle into Twitter Handle
#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.

*'''NUMBER OF EVENTS''': ''UPDATE: written, not published, on amazon's mechanical turk site''
'''Considerations'''
*Difficulties Encountered:
*Expected Time to Complete:
*Expectation of Results (accuracy of turk, comprehensiveness):
*Other Comments:

'''Procedure'''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events in July 2016 and record it. If there is no information of events on the website, record DNE.

Note***: ''Events include meetups, workshops, info sessions etc. We do not want to count them separately since it is difficult to do so. Most companies put all the events on the same section and do not put event types in the titles of the events. We have to look into the details of the events to find out the type and even we do so some events descriptions do not allow us to determine the type easily. Differentiating the types of the events demands more time and effort and therefore is not suitable to be a mechanical turk project.''

*'''Onsite Mentors''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'
#If the key words can be identified, mark as 1
#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., look for a subsection or mention of mentor/mentorship/mentoring
#If these exist, mark as 1.
#If not, go to links related to membership 'benefits,' 'perks,' or related.
#Do same process as end of 4 and 5
#If there is no mention of mentorship in these sections, type the company, city, and 'mentoring' into a search engine. If a link to a reliable website (such as Desktime) appears and mentorship can be found in the description, mark as 1.
#If none of these steps result in a mark of 1, mark as 0

*'''Nonprofit''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Go to links that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'
#Look for the key word 'nonprofit'/'non-profit'
#If 'nonprofit' is identified, mark as 1, otherwise 0.

*'''Number of Members''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link 'Members' or 'Residents', usually they are under the links 'Community', 'Membership', 'Our Space' or 'The Space'.
#Count the number of members
#If the link or section of 'Members' is not found, go the 'Community' and 'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.
#If number of members cannot be identified using above steps, record DNE.

*'''Sponsors and Partners''':''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link or mention of 'Sponsors' or 'Partners', many times of which is often under the section of 'About', 'Community', or related sections
#If sponsors or partners can be found mark as 1 and list them, otherwise mark as 0.

Hubs: Hubs Data

2016-07-20T21:04:43Z

ArielSun: /* Onsite OH Investors v. mentors */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Test processes and audit
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Friday 7/28
#Have a comprehensive list of potential hubs
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Tuesday 7/26
#Fill in Remaining Data Manually
#*Status: NS
#*Begin Date: Monday 7/25
#*Reach Goal: Complete by Friday 7/29

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Sponsors/Partners
#*'''STATUS''': Not Started
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Specific Industry
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Cultivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
**'''Search Text''': Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
*'''TBD points'''
*'''Potential Turks'''
**'''Search Text 1''': website design, coding, web development, software, bootcamp
**'''Search Text 2''': General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite VC v. Angel Investors====
====Onsite OH Investors v. mentors====
Thoughts (Ariel, 07/20): The name listed on 'mentor' page/sections must all be mentors, and the same applies for investors/OH investors although few companies list their investors. So here the only thing we are trying to differentiate is whether the mentor is a investor. maybe via checking whether they are from a VC firm?? But even they are from VC companies doesn't mean they are going to invest on the startups of the Hubs they are mentoring on. Or another way to think about it is differentiating between mentors/OH mentors. Mentors tend to give the particular startups long term support and available when needed while OH mentors only gives advice on the spot.

'''Mentors'''

*'''Desc''':

*'''Characteristics''':
**Focus on improving entrepreneurial community through ongoing, recurring support
**Help and guide the startups on: business plans and models, management, development, execution, technology innovation, marketing, sales
*Common fields/occupations: founder/CEO of another company, business development, serial entrepreneur, marketing, sales, management consulting, technology and innovation, research professor etc.
**Some companies offer mentor hours

*'''TBD Points''':

*'''Potential Turks''':

'''Investors'''

*'''Desc''':

*'''Characteristics''':
**Focus on investing on early stage or growth stage startups
**Usually from VC firms
**Common fields/ occupations: VC firm manager, VC firm partner, fund manager

*'''TBD Points''':

*'''Potential Turks''':

====Onsite temporary workshops v. networking events====

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

=OLD1=
We will be creating a "Hubs scorecard" to determine how hub-like potential spaces are. In order to do so, we will evaluate the places based on certain variables. Previous variables for potential hubs were collected. Below, we list those as well as other variables we think might be helpful to build out the scorecard.

Ideally, we would have the following variables (not collected previously):
#Onsite VC/Angel/Investors (Count or binary)
##Comments:
##Mechanical Turk Comments:
#Onsite Mentors (binary) --- ''Are these the same as advisers?''
##Comments:
##Mechanical Turk Comments:
#"Office hours" with investors or mentors (binary)
##Comments: Previously collected included number of events, but did not separate them into categories (e.g. networking events, workshops, etc.). We view this separation as important, BUT very difficult to collect
##Mechanical Turk Comments:
#Onsite temporary workshops (binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Networking Meetups (Binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Sponsors and Partners (binary and list) --- a''re these the same?''
##Comments:
##Mechanical Turk Comments:
#Alumni Network (binary) --- ''not all potential hubslist this and the fact that some do might indicate its importance''
##Comments:
##Mechanical Turk Comments:
#Num of Companies --- ''to help determine size as getting physical sqfootage is difficult''
##Comments:
##Mechanical Turk Comments:
#Nonprofit (binary) --- ''helpful in determining goals of potential hubs''
##Comments:
##Mechanical Turk Comments:
#Mission Includes Key Buzzwords (e.g. "ecosystem", "community") --- ''help separate simple coworking spaces form hubs''

Example of Prior Variables Collected:
*Specific Industry -- ''defined as LinkedIN Self Identifier, no categories just plain text. We think what we really want is to see if they have a specialty (e.g. healthcare)''
*Num of Events --- ''relatively complete inputs, but from March 2016 (see above as well)''
*Price for Single Space --- ''defined as price for flexible desk, relatively complete inputs''
*Price for Office --- ''no inputs''
*Twitter Activity (Multinomial or Count) --- ''High=2/Moderate=1/No=0, no explanations on how to categorize the activity. Also no handles''
*Size (sqft) --- ''no records for majority of the companies''
*Num Conference Rooms --- ''no records for majority of the companies''
*Onsite accelerator (binary) --- ''relatively complete inputs''
*Onsite code school (binary) --- ''relatively complete inputs''
*Community Membership (binary) --- ''relatively complete inputs''

=OLD2=
*'''Twitter activity''': ''
'''UPDATE (7/14)''': Updated turk to reflect our desired formats
'''UPDATE (7/12)''': '''AUDIT RESULTS''': We noticed

'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#Copy the text in the Search Text into a search engine.
#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#Record the company's Twitter Handle into Twitter Handle
#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.

*'''NUMBER OF EVENTS''': ''UPDATE: written, not published, on amazon's mechanical turk site''
'''Considerations'''
*Difficulties Encountered:
*Expected Time to Complete:
*Expectation of Results (accuracy of turk, comprehensiveness):
*Other Comments:

'''Procedure'''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events in July 2016 and record it. If there is no information of events on the website, record DNE.

Note***: ''Events include meetups, workshops, info sessions etc. We do not want to count them separately since it is difficult to do so. Most companies put all the events on the same section and do not put event types in the titles of the events. We have to look into the details of the events to find out the type and even we do so some events descriptions do not allow us to determine the type easily. Differentiating the types of the events demands more time and effort and therefore is not suitable to be a mechanical turk project.''

*'''Onsite Mentors''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'
#If the key words can be identified, mark as 1
#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., look for a subsection or mention of mentor/mentorship/mentoring
#If these exist, mark as 1.
#If not, go to links related to membership 'benefits,' 'perks,' or related.
#Do same process as end of 4 and 5
#If there is no mention of mentorship in these sections, type the company, city, and 'mentoring' into a search engine. If a link to a reliable website (such as Desktime) appears and mentorship can be found in the description, mark as 1.
#If none of these steps result in a mark of 1, mark as 0

*'''Nonprofit''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Go to links that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'
#Look for the key word 'nonprofit'/'non-profit'
#If 'nonprofit' is identified, mark as 1, otherwise 0.

*'''Number of Members''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link 'Members' or 'Residents', usually they are under the links 'Community', 'Membership', 'Our Space' or 'The Space'.
#Count the number of members
#If the link or section of 'Members' is not found, go the 'Community' and 'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.
#If number of members cannot be identified using above steps, record DNE.

*'''Sponsors and Partners''':''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link or mention of 'Sponsors' or 'Partners', many times of which is often under the section of 'About', 'Community', or related sections
#If sponsors or partners can be found mark as 1 and list them, otherwise mark as 0.

Hubs: Hubs Data

2016-07-20T21:03:32Z

ArielSun: /* Onsite OH Investors v. mentors */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Test processes and audit
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Friday 7/28
#Have a comprehensive list of potential hubs
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Tuesday 7/26
#Fill in Remaining Data Manually
#*Status: NS
#*Begin Date: Monday 7/25
#*Reach Goal: Complete by Friday 7/29

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Sponsors/Partners
#*'''STATUS''': Not Started
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Specific Industry
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Cultivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
**'''Search Text''': Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
*'''TBD points'''
*'''Potential Turks'''
**'''Search Text 1''': website design, coding, web development, software, bootcamp
**'''Search Text 2''': General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite VC v. Angel Investors====
====Onsite OH Investors v. mentors====
**Thoughts (Ariel, 07/20): The name listed on 'mentor' page/sections must all be mentors, and the same applies for investors/OH investors although few companies list their investors. So here the only thing we are trying to differentiate is whether the mentor is a investor. maybe via checking whether they are from a VC firm?? But even they are from VC companies doesn't mean they are going to invest on the startups of the Hubs they are mentoring on. Or another way to think about it is differentiating between mentors/OH mentors. Mentors tend to give the particular startups long term support and available when needed while OH mentors only gives advice on the spot.

'''Mentors'''

*'''Desc''':

*'''Characteristics''':
*Focus on improving entrepreneurial community through ongoing, recurring support
*Help and guide the startups on: business plans and models, management, development, execution, technology innovation, marketing, sales
*Common fields/occupations: founder/CEO of another company, business development, serial entrepreneur, marketing, sales, management consulting, technology and innovation, research professor etc.
*Some companies offer mentor hours

*'''TBD Points''':

*'''Potential Turks''':

'''Investors'''

*'''Desc''':

*'''Characteristics''':
*Focus on investing on early stage or growth stage startups
*Usually from VC firms
*Common fields/ occupations: VC firm manager, VC firm partner, fund manager

*'''TBD Points''':

*'''Potential Turks''':

====Onsite temporary workshops v. networking events====

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

=OLD1=
We will be creating a "Hubs scorecard" to determine how hub-like potential spaces are. In order to do so, we will evaluate the places based on certain variables. Previous variables for potential hubs were collected. Below, we list those as well as other variables we think might be helpful to build out the scorecard.

Ideally, we would have the following variables (not collected previously):
#Onsite VC/Angel/Investors (Count or binary)
##Comments:
##Mechanical Turk Comments:
#Onsite Mentors (binary) --- ''Are these the same as advisers?''
##Comments:
##Mechanical Turk Comments:
#"Office hours" with investors or mentors (binary)
##Comments: Previously collected included number of events, but did not separate them into categories (e.g. networking events, workshops, etc.). We view this separation as important, BUT very difficult to collect
##Mechanical Turk Comments:
#Onsite temporary workshops (binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Networking Meetups (Binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Sponsors and Partners (binary and list) --- a''re these the same?''
##Comments:
##Mechanical Turk Comments:
#Alumni Network (binary) --- ''not all potential hubslist this and the fact that some do might indicate its importance''
##Comments:
##Mechanical Turk Comments:
#Num of Companies --- ''to help determine size as getting physical sqfootage is difficult''
##Comments:
##Mechanical Turk Comments:
#Nonprofit (binary) --- ''helpful in determining goals of potential hubs''
##Comments:
##Mechanical Turk Comments:
#Mission Includes Key Buzzwords (e.g. "ecosystem", "community") --- ''help separate simple coworking spaces form hubs''

Example of Prior Variables Collected:
*Specific Industry -- ''defined as LinkedIN Self Identifier, no categories just plain text. We think what we really want is to see if they have a specialty (e.g. healthcare)''
*Num of Events --- ''relatively complete inputs, but from March 2016 (see above as well)''
*Price for Single Space --- ''defined as price for flexible desk, relatively complete inputs''
*Price for Office --- ''no inputs''
*Twitter Activity (Multinomial or Count) --- ''High=2/Moderate=1/No=0, no explanations on how to categorize the activity. Also no handles''
*Size (sqft) --- ''no records for majority of the companies''
*Num Conference Rooms --- ''no records for majority of the companies''
*Onsite accelerator (binary) --- ''relatively complete inputs''
*Onsite code school (binary) --- ''relatively complete inputs''
*Community Membership (binary) --- ''relatively complete inputs''

=OLD2=
*'''Twitter activity''': ''
'''UPDATE (7/14)''': Updated turk to reflect our desired formats
'''UPDATE (7/12)''': '''AUDIT RESULTS''': We noticed

'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#Copy the text in the Search Text into a search engine.
#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#Record the company's Twitter Handle into Twitter Handle
#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.

*'''NUMBER OF EVENTS''': ''UPDATE: written, not published, on amazon's mechanical turk site''
'''Considerations'''
*Difficulties Encountered:
*Expected Time to Complete:
*Expectation of Results (accuracy of turk, comprehensiveness):
*Other Comments:

'''Procedure'''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events in July 2016 and record it. If there is no information of events on the website, record DNE.

Note***: ''Events include meetups, workshops, info sessions etc. We do not want to count them separately since it is difficult to do so. Most companies put all the events on the same section and do not put event types in the titles of the events. We have to look into the details of the events to find out the type and even we do so some events descriptions do not allow us to determine the type easily. Differentiating the types of the events demands more time and effort and therefore is not suitable to be a mechanical turk project.''

*'''Onsite Mentors''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'
#If the key words can be identified, mark as 1
#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., look for a subsection or mention of mentor/mentorship/mentoring
#If these exist, mark as 1.
#If not, go to links related to membership 'benefits,' 'perks,' or related.
#Do same process as end of 4 and 5
#If there is no mention of mentorship in these sections, type the company, city, and 'mentoring' into a search engine. If a link to a reliable website (such as Desktime) appears and mentorship can be found in the description, mark as 1.
#If none of these steps result in a mark of 1, mark as 0

*'''Nonprofit''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Go to links that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'
#Look for the key word 'nonprofit'/'non-profit'
#If 'nonprofit' is identified, mark as 1, otherwise 0.

*'''Number of Members''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link 'Members' or 'Residents', usually they are under the links 'Community', 'Membership', 'Our Space' or 'The Space'.
#Count the number of members
#If the link or section of 'Members' is not found, go the 'Community' and 'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.
#If number of members cannot be identified using above steps, record DNE.

*'''Sponsors and Partners''':''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link or mention of 'Sponsors' or 'Partners', many times of which is often under the section of 'About', 'Community', or related sections
#If sponsors or partners can be found mark as 1 and list them, otherwise mark as 0.

Hubs: Hubs Data

2016-07-20T16:12:05Z

ArielSun: /* Onsite OH Investors v. mentors */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Test processes and audit
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Friday 7/28
#Have a comprehensive list of potential hubs
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Tuesday 7/26
#Fill in Remaining Data Manually
#*Status: NS
#*Begin Date: Monday 7/25
#*Reach Goal: Complete by Friday 7/29

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Sponsors/Partners
#*'''STATUS''': Not Started
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Specific Industry
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Caltivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
**Search Text: Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
**Search Text 1: website design, coding, web development, software, bootcamp
**Search Text 2: General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
*'''TBD points'''
*'''Potential Turks'''
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite VC v. Angel Investors====
====Onsite OH Investors v. mentors====
*'''Desc''':

*'''Characteristics''':

*'''TBD Points''':

*'''Potential Turks''':

====Onsite temporary workshops v. networking events====

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

=OLD1=
We will be creating a "Hubs scorecard" to determine how hub-like potential spaces are. In order to do so, we will evaluate the places based on certain variables. Previous variables for potential hubs were collected. Below, we list those as well as other variables we think might be helpful to build out the scorecard.

Ideally, we would have the following variables (not collected previously):
#Onsite VC/Angel/Investors (Count or binary)
##Comments:
##Mechanical Turk Comments:
#Onsite Mentors (binary) --- ''Are these the same as advisers?''
##Comments:
##Mechanical Turk Comments:
#"Office hours" with investors or mentors (binary)
##Comments: Previously collected included number of events, but did not separate them into categories (e.g. networking events, workshops, etc.). We view this separation as important, BUT very difficult to collect
##Mechanical Turk Comments:
#Onsite temporary workshops (binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Networking Meetups (Binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Sponsors and Partners (binary and list) --- a''re these the same?''
##Comments:
##Mechanical Turk Comments:
#Alumni Network (binary) --- ''not all potential hubslist this and the fact that some do might indicate its importance''
##Comments:
##Mechanical Turk Comments:
#Num of Companies --- ''to help determine size as getting physical sqfootage is difficult''
##Comments:
##Mechanical Turk Comments:
#Nonprofit (binary) --- ''helpful in determining goals of potential hubs''
##Comments:
##Mechanical Turk Comments:
#Mission Includes Key Buzzwords (e.g. "ecosystem", "community") --- ''help separate simple coworking spaces form hubs''

Example of Prior Variables Collected:
*Specific Industry -- ''defined as LinkedIN Self Identifier, no categories just plain text. We think what we really want is to see if they have a specialty (e.g. healthcare)''
*Num of Events --- ''relatively complete inputs, but from March 2016 (see above as well)''
*Price for Single Space --- ''defined as price for flexible desk, relatively complete inputs''
*Price for Office --- ''no inputs''
*Twitter Activity (Multinomial or Count) --- ''High=2/Moderate=1/No=0, no explanations on how to categorize the activity. Also no handles''
*Size (sqft) --- ''no records for majority of the companies''
*Num Conference Rooms --- ''no records for majority of the companies''
*Onsite accelerator (binary) --- ''relatively complete inputs''
*Onsite code school (binary) --- ''relatively complete inputs''
*Community Membership (binary) --- ''relatively complete inputs''

=OLD2=
*'''Twitter activity''': ''
'''UPDATE (7/14)''': Updated turk to reflect our desired formats
'''UPDATE (7/12)''': '''AUDIT RESULTS''': We noticed

'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#Copy the text in the Search Text into a search engine.
#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#Record the company's Twitter Handle into Twitter Handle
#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.

*'''NUMBER OF EVENTS''': ''UPDATE: written, not published, on amazon's mechanical turk site''
'''Considerations'''
*Difficulties Encountered:
*Expected Time to Complete:
*Expectation of Results (accuracy of turk, comprehensiveness):
*Other Comments:

'''Procedure'''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events in July 2016 and record it. If there is no information of events on the website, record DNE.

Note***: ''Events include meetups, workshops, info sessions etc. We do not want to count them separately since it is difficult to do so. Most companies put all the events on the same section and do not put event types in the titles of the events. We have to look into the details of the events to find out the type and even we do so some events descriptions do not allow us to determine the type easily. Differentiating the types of the events demands more time and effort and therefore is not suitable to be a mechanical turk project.''

*'''Onsite Mentors''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'
#If the key words can be identified, mark as 1
#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., look for a subsection or mention of mentor/mentorship/mentoring
#If these exist, mark as 1.
#If not, go to links related to membership 'benefits,' 'perks,' or related.
#Do same process as end of 4 and 5
#If there is no mention of mentorship in these sections, type the company, city, and 'mentoring' into a search engine. If a link to a reliable website (such as Desktime) appears and mentorship can be found in the description, mark as 1.
#If none of these steps result in a mark of 1, mark as 0

*'''Nonprofit''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Go to links that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'
#Look for the key word 'nonprofit'/'non-profit'
#If 'nonprofit' is identified, mark as 1, otherwise 0.

*'''Number of Members''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link 'Members' or 'Residents', usually they are under the links 'Community', 'Membership', 'Our Space' or 'The Space'.
#Count the number of members
#If the link or section of 'Members' is not found, go the 'Community' and 'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.
#If number of members cannot be identified using above steps, record DNE.

*'''Sponsors and Partners''':''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link or mention of 'Sponsors' or 'Partners', many times of which is often under the section of 'About', 'Community', or related sections
#If sponsors or partners can be found mark as 1 and list them, otherwise mark as 0.

Hubs: Hubs Data

2016-07-20T16:11:14Z

ArielSun: /* Onsite OH Investors v. mentors */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Test processes and audit
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Friday 7/28
#Have a comprehensive list of potential hubs
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Tuesday 7/26
#Fill in Remaining Data Manually
#*Status: NS
#*Begin Date: Monday 7/25
#*Reach Goal: Complete by Friday 7/29

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Sponsors/Partners
#*'''STATUS''': Not Started
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Specific Industry
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Caltivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
**Search Text: Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
**Search Text 1: website design, coding, web development, software, bootcamp
**Search Text 2: General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
*'''TBD points'''
*'''Potential Turks'''
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite VC v. Angel Investors====
====Onsite OH Investors v. mentors====
'''Desc''':

'''Characteristics''':

'''TBD Points''':

'''Potential Turks''':

====Onsite temporary workshops v. networking events====

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

=OLD1=
We will be creating a "Hubs scorecard" to determine how hub-like potential spaces are. In order to do so, we will evaluate the places based on certain variables. Previous variables for potential hubs were collected. Below, we list those as well as other variables we think might be helpful to build out the scorecard.

Ideally, we would have the following variables (not collected previously):
#Onsite VC/Angel/Investors (Count or binary)
##Comments:
##Mechanical Turk Comments:
#Onsite Mentors (binary) --- ''Are these the same as advisers?''
##Comments:
##Mechanical Turk Comments:
#"Office hours" with investors or mentors (binary)
##Comments: Previously collected included number of events, but did not separate them into categories (e.g. networking events, workshops, etc.). We view this separation as important, BUT very difficult to collect
##Mechanical Turk Comments:
#Onsite temporary workshops (binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Networking Meetups (Binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Sponsors and Partners (binary and list) --- a''re these the same?''
##Comments:
##Mechanical Turk Comments:
#Alumni Network (binary) --- ''not all potential hubslist this and the fact that some do might indicate its importance''
##Comments:
##Mechanical Turk Comments:
#Num of Companies --- ''to help determine size as getting physical sqfootage is difficult''
##Comments:
##Mechanical Turk Comments:
#Nonprofit (binary) --- ''helpful in determining goals of potential hubs''
##Comments:
##Mechanical Turk Comments:
#Mission Includes Key Buzzwords (e.g. "ecosystem", "community") --- ''help separate simple coworking spaces form hubs''

Example of Prior Variables Collected:
*Specific Industry -- ''defined as LinkedIN Self Identifier, no categories just plain text. We think what we really want is to see if they have a specialty (e.g. healthcare)''
*Num of Events --- ''relatively complete inputs, but from March 2016 (see above as well)''
*Price for Single Space --- ''defined as price for flexible desk, relatively complete inputs''
*Price for Office --- ''no inputs''
*Twitter Activity (Multinomial or Count) --- ''High=2/Moderate=1/No=0, no explanations on how to categorize the activity. Also no handles''
*Size (sqft) --- ''no records for majority of the companies''
*Num Conference Rooms --- ''no records for majority of the companies''
*Onsite accelerator (binary) --- ''relatively complete inputs''
*Onsite code school (binary) --- ''relatively complete inputs''
*Community Membership (binary) --- ''relatively complete inputs''

=OLD2=
*'''Twitter activity''': ''
'''UPDATE (7/14)''': Updated turk to reflect our desired formats
'''UPDATE (7/12)''': '''AUDIT RESULTS''': We noticed

'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#Copy the text in the Search Text into a search engine.
#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#Record the company's Twitter Handle into Twitter Handle
#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.

*'''NUMBER OF EVENTS''': ''UPDATE: written, not published, on amazon's mechanical turk site''
'''Considerations'''
*Difficulties Encountered:
*Expected Time to Complete:
*Expectation of Results (accuracy of turk, comprehensiveness):
*Other Comments:

'''Procedure'''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events in July 2016 and record it. If there is no information of events on the website, record DNE.

Note***: ''Events include meetups, workshops, info sessions etc. We do not want to count them separately since it is difficult to do so. Most companies put all the events on the same section and do not put event types in the titles of the events. We have to look into the details of the events to find out the type and even we do so some events descriptions do not allow us to determine the type easily. Differentiating the types of the events demands more time and effort and therefore is not suitable to be a mechanical turk project.''

*'''Onsite Mentors''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'
#If the key words can be identified, mark as 1
#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., look for a subsection or mention of mentor/mentorship/mentoring
#If these exist, mark as 1.
#If not, go to links related to membership 'benefits,' 'perks,' or related.
#Do same process as end of 4 and 5
#If there is no mention of mentorship in these sections, type the company, city, and 'mentoring' into a search engine. If a link to a reliable website (such as Desktime) appears and mentorship can be found in the description, mark as 1.
#If none of these steps result in a mark of 1, mark as 0

*'''Nonprofit''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Go to links that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'
#Look for the key word 'nonprofit'/'non-profit'
#If 'nonprofit' is identified, mark as 1, otherwise 0.

*'''Number of Members''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link 'Members' or 'Residents', usually they are under the links 'Community', 'Membership', 'Our Space' or 'The Space'.
#Count the number of members
#If the link or section of 'Members' is not found, go the 'Community' and 'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.
#If number of members cannot be identified using above steps, record DNE.

*'''Sponsors and Partners''':''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link or mention of 'Sponsors' or 'Partners', many times of which is often under the section of 'About', 'Community', or related sections
#If sponsors or partners can be found mark as 1 and list them, otherwise mark as 0.

Hubs: Hubs Data

2016-07-20T16:10:50Z

ArielSun: /* Onsite OH Investors v. mentors */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Test processes and audit
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Friday 7/28
#Have a comprehensive list of potential hubs
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Tuesday 7/26
#Fill in Remaining Data Manually
#*Status: NS
#*Begin Date: Monday 7/25
#*Reach Goal: Complete by Friday 7/29

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Sponsors/Partners
#*'''STATUS''': Not Started
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Specific Industry
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Caltivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
**Search Text: Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
**Search Text 1: website design, coding, web development, software, bootcamp
**Search Text 2: General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
*'''TBD points'''
*'''Potential Turks'''
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite VC v. Angel Investors====
====Onsite OH Investors v. mentors====
'''Desc''':
'''Characteristics''':
'''TBD Points''':
'''Potential Turks''':

====Onsite temporary workshops v. networking events====

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

=OLD1=
We will be creating a "Hubs scorecard" to determine how hub-like potential spaces are. In order to do so, we will evaluate the places based on certain variables. Previous variables for potential hubs were collected. Below, we list those as well as other variables we think might be helpful to build out the scorecard.

Ideally, we would have the following variables (not collected previously):
#Onsite VC/Angel/Investors (Count or binary)
##Comments:
##Mechanical Turk Comments:
#Onsite Mentors (binary) --- ''Are these the same as advisers?''
##Comments:
##Mechanical Turk Comments:
#"Office hours" with investors or mentors (binary)
##Comments: Previously collected included number of events, but did not separate them into categories (e.g. networking events, workshops, etc.). We view this separation as important, BUT very difficult to collect
##Mechanical Turk Comments:
#Onsite temporary workshops (binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Networking Meetups (Binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Sponsors and Partners (binary and list) --- a''re these the same?''
##Comments:
##Mechanical Turk Comments:
#Alumni Network (binary) --- ''not all potential hubslist this and the fact that some do might indicate its importance''
##Comments:
##Mechanical Turk Comments:
#Num of Companies --- ''to help determine size as getting physical sqfootage is difficult''
##Comments:
##Mechanical Turk Comments:
#Nonprofit (binary) --- ''helpful in determining goals of potential hubs''
##Comments:
##Mechanical Turk Comments:
#Mission Includes Key Buzzwords (e.g. "ecosystem", "community") --- ''help separate simple coworking spaces form hubs''

Example of Prior Variables Collected:
*Specific Industry -- ''defined as LinkedIN Self Identifier, no categories just plain text. We think what we really want is to see if they have a specialty (e.g. healthcare)''
*Num of Events --- ''relatively complete inputs, but from March 2016 (see above as well)''
*Price for Single Space --- ''defined as price for flexible desk, relatively complete inputs''
*Price for Office --- ''no inputs''
*Twitter Activity (Multinomial or Count) --- ''High=2/Moderate=1/No=0, no explanations on how to categorize the activity. Also no handles''
*Size (sqft) --- ''no records for majority of the companies''
*Num Conference Rooms --- ''no records for majority of the companies''
*Onsite accelerator (binary) --- ''relatively complete inputs''
*Onsite code school (binary) --- ''relatively complete inputs''
*Community Membership (binary) --- ''relatively complete inputs''

=OLD2=
*'''Twitter activity''': ''
'''UPDATE (7/14)''': Updated turk to reflect our desired formats
'''UPDATE (7/12)''': '''AUDIT RESULTS''': We noticed

'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#Copy the text in the Search Text into a search engine.
#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#Record the company's Twitter Handle into Twitter Handle
#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.

*'''NUMBER OF EVENTS''': ''UPDATE: written, not published, on amazon's mechanical turk site''
'''Considerations'''
*Difficulties Encountered:
*Expected Time to Complete:
*Expectation of Results (accuracy of turk, comprehensiveness):
*Other Comments:

'''Procedure'''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events in July 2016 and record it. If there is no information of events on the website, record DNE.

Note***: ''Events include meetups, workshops, info sessions etc. We do not want to count them separately since it is difficult to do so. Most companies put all the events on the same section and do not put event types in the titles of the events. We have to look into the details of the events to find out the type and even we do so some events descriptions do not allow us to determine the type easily. Differentiating the types of the events demands more time and effort and therefore is not suitable to be a mechanical turk project.''

*'''Onsite Mentors''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'
#If the key words can be identified, mark as 1
#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., look for a subsection or mention of mentor/mentorship/mentoring
#If these exist, mark as 1.
#If not, go to links related to membership 'benefits,' 'perks,' or related.
#Do same process as end of 4 and 5
#If there is no mention of mentorship in these sections, type the company, city, and 'mentoring' into a search engine. If a link to a reliable website (such as Desktime) appears and mentorship can be found in the description, mark as 1.
#If none of these steps result in a mark of 1, mark as 0

*'''Nonprofit''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Go to links that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'
#Look for the key word 'nonprofit'/'non-profit'
#If 'nonprofit' is identified, mark as 1, otherwise 0.

*'''Number of Members''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link 'Members' or 'Residents', usually they are under the links 'Community', 'Membership', 'Our Space' or 'The Space'.
#Count the number of members
#If the link or section of 'Members' is not found, go the 'Community' and 'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.
#If number of members cannot be identified using above steps, record DNE.

*'''Sponsors and Partners''':''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link or mention of 'Sponsors' or 'Partners', many times of which is often under the section of 'About', 'Community', or related sections
#If sponsors or partners can be found mark as 1 and list them, otherwise mark as 0.

Hubs: Hubs Data

2016-07-20T16:08:49Z

ArielSun: /* Curriculum and Code School */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Test processes and audit
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Friday 7/28
#Have a comprehensive list of potential hubs
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Tuesday 7/26
#Fill in Remaining Data Manually
#*Status: NS
#*Begin Date: Monday 7/25
#*Reach Goal: Complete by Friday 7/29

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Sponsors/Partners
#*'''STATUS''': Not Started
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Specific Industry
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Caltivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
**Search Text: Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
**Search Text 1: website design, coding, web development, software, bootcamp
**Search Text 2: General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
*'''TBD points'''
*'''Potential Turks'''
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite VC v. Angel Investors====
====Onsite OH Investors v. mentors====
====Onsite temporary workshops v. networking events====

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

=OLD1=
We will be creating a "Hubs scorecard" to determine how hub-like potential spaces are. In order to do so, we will evaluate the places based on certain variables. Previous variables for potential hubs were collected. Below, we list those as well as other variables we think might be helpful to build out the scorecard.

Ideally, we would have the following variables (not collected previously):
#Onsite VC/Angel/Investors (Count or binary)
##Comments:
##Mechanical Turk Comments:
#Onsite Mentors (binary) --- ''Are these the same as advisers?''
##Comments:
##Mechanical Turk Comments:
#"Office hours" with investors or mentors (binary)
##Comments: Previously collected included number of events, but did not separate them into categories (e.g. networking events, workshops, etc.). We view this separation as important, BUT very difficult to collect
##Mechanical Turk Comments:
#Onsite temporary workshops (binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Networking Meetups (Binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Sponsors and Partners (binary and list) --- a''re these the same?''
##Comments:
##Mechanical Turk Comments:
#Alumni Network (binary) --- ''not all potential hubslist this and the fact that some do might indicate its importance''
##Comments:
##Mechanical Turk Comments:
#Num of Companies --- ''to help determine size as getting physical sqfootage is difficult''
##Comments:
##Mechanical Turk Comments:
#Nonprofit (binary) --- ''helpful in determining goals of potential hubs''
##Comments:
##Mechanical Turk Comments:
#Mission Includes Key Buzzwords (e.g. "ecosystem", "community") --- ''help separate simple coworking spaces form hubs''

Example of Prior Variables Collected:
*Specific Industry -- ''defined as LinkedIN Self Identifier, no categories just plain text. We think what we really want is to see if they have a specialty (e.g. healthcare)''
*Num of Events --- ''relatively complete inputs, but from March 2016 (see above as well)''
*Price for Single Space --- ''defined as price for flexible desk, relatively complete inputs''
*Price for Office --- ''no inputs''
*Twitter Activity (Multinomial or Count) --- ''High=2/Moderate=1/No=0, no explanations on how to categorize the activity. Also no handles''
*Size (sqft) --- ''no records for majority of the companies''
*Num Conference Rooms --- ''no records for majority of the companies''
*Onsite accelerator (binary) --- ''relatively complete inputs''
*Onsite code school (binary) --- ''relatively complete inputs''
*Community Membership (binary) --- ''relatively complete inputs''

=OLD2=
*'''Twitter activity''': ''
'''UPDATE (7/14)''': Updated turk to reflect our desired formats
'''UPDATE (7/12)''': '''AUDIT RESULTS''': We noticed

'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#Copy the text in the Search Text into a search engine.
#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#Record the company's Twitter Handle into Twitter Handle
#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.

*'''NUMBER OF EVENTS''': ''UPDATE: written, not published, on amazon's mechanical turk site''
'''Considerations'''
*Difficulties Encountered:
*Expected Time to Complete:
*Expectation of Results (accuracy of turk, comprehensiveness):
*Other Comments:

'''Procedure'''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events in July 2016 and record it. If there is no information of events on the website, record DNE.

Note***: ''Events include meetups, workshops, info sessions etc. We do not want to count them separately since it is difficult to do so. Most companies put all the events on the same section and do not put event types in the titles of the events. We have to look into the details of the events to find out the type and even we do so some events descriptions do not allow us to determine the type easily. Differentiating the types of the events demands more time and effort and therefore is not suitable to be a mechanical turk project.''

*'''Onsite Mentors''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'
#If the key words can be identified, mark as 1
#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., look for a subsection or mention of mentor/mentorship/mentoring
#If these exist, mark as 1.
#If not, go to links related to membership 'benefits,' 'perks,' or related.
#Do same process as end of 4 and 5
#If there is no mention of mentorship in these sections, type the company, city, and 'mentoring' into a search engine. If a link to a reliable website (such as Desktime) appears and mentorship can be found in the description, mark as 1.
#If none of these steps result in a mark of 1, mark as 0

*'''Nonprofit''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Go to links that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'
#Look for the key word 'nonprofit'/'non-profit'
#If 'nonprofit' is identified, mark as 1, otherwise 0.

*'''Number of Members''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link 'Members' or 'Residents', usually they are under the links 'Community', 'Membership', 'Our Space' or 'The Space'.
#Count the number of members
#If the link or section of 'Members' is not found, go the 'Community' and 'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.
#If number of members cannot be identified using above steps, record DNE.

*'''Sponsors and Partners''':''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link or mention of 'Sponsors' or 'Partners', many times of which is often under the section of 'About', 'Community', or related sections
#If sponsors or partners can be found mark as 1 and list them, otherwise mark as 0.

Hubs: Hubs Data

2016-07-20T15:55:42Z

ArielSun: /* Curriculum and Code School */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Test processes and audit
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Friday 7/28
#Have a comprehensive list of potential hubs
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Tuesday 7/26
#Fill in Remaining Data Manually
#*Status: NS
#*Begin Date: Monday 7/25
#*Reach Goal: Complete by Friday 7/29

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Sponsors/Partners
#*'''STATUS''': Not Started
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Specific Industry
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Caltivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
**Search Text: Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
**Search Text 1: website design, coding, web development, software
**Search Text 2: General Assembly, Anyone Can Learn to Code, Umbraco, Designation, Boise CodeWorks, Grand Circus, DevMountain, Silicon Valley Data Academy, Academy Pittsburgh
*'''TBD points'''
*'''Potential Turks'''
#Google: "Search Text" site:URL
#Record 0 if no result returns.
#If there is a result, click first link in which result search text appears and record the sentence in which the text appears.

====Onsite VC v. Angel Investors====
====Onsite OH Investors v. mentors====
====Onsite temporary workshops v. networking events====

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

=OLD1=
We will be creating a "Hubs scorecard" to determine how hub-like potential spaces are. In order to do so, we will evaluate the places based on certain variables. Previous variables for potential hubs were collected. Below, we list those as well as other variables we think might be helpful to build out the scorecard.

Ideally, we would have the following variables (not collected previously):
#Onsite VC/Angel/Investors (Count or binary)
##Comments:
##Mechanical Turk Comments:
#Onsite Mentors (binary) --- ''Are these the same as advisers?''
##Comments:
##Mechanical Turk Comments:
#"Office hours" with investors or mentors (binary)
##Comments: Previously collected included number of events, but did not separate them into categories (e.g. networking events, workshops, etc.). We view this separation as important, BUT very difficult to collect
##Mechanical Turk Comments:
#Onsite temporary workshops (binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Networking Meetups (Binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Sponsors and Partners (binary and list) --- a''re these the same?''
##Comments:
##Mechanical Turk Comments:
#Alumni Network (binary) --- ''not all potential hubslist this and the fact that some do might indicate its importance''
##Comments:
##Mechanical Turk Comments:
#Num of Companies --- ''to help determine size as getting physical sqfootage is difficult''
##Comments:
##Mechanical Turk Comments:
#Nonprofit (binary) --- ''helpful in determining goals of potential hubs''
##Comments:
##Mechanical Turk Comments:
#Mission Includes Key Buzzwords (e.g. "ecosystem", "community") --- ''help separate simple coworking spaces form hubs''

Example of Prior Variables Collected:
*Specific Industry -- ''defined as LinkedIN Self Identifier, no categories just plain text. We think what we really want is to see if they have a specialty (e.g. healthcare)''
*Num of Events --- ''relatively complete inputs, but from March 2016 (see above as well)''
*Price for Single Space --- ''defined as price for flexible desk, relatively complete inputs''
*Price for Office --- ''no inputs''
*Twitter Activity (Multinomial or Count) --- ''High=2/Moderate=1/No=0, no explanations on how to categorize the activity. Also no handles''
*Size (sqft) --- ''no records for majority of the companies''
*Num Conference Rooms --- ''no records for majority of the companies''
*Onsite accelerator (binary) --- ''relatively complete inputs''
*Onsite code school (binary) --- ''relatively complete inputs''
*Community Membership (binary) --- ''relatively complete inputs''

=OLD2=
*'''Twitter activity''': ''
'''UPDATE (7/14)''': Updated turk to reflect our desired formats
'''UPDATE (7/12)''': '''AUDIT RESULTS''': We noticed

'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#Copy the text in the Search Text into a search engine.
#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#Record the company's Twitter Handle into Twitter Handle
#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.

*'''NUMBER OF EVENTS''': ''UPDATE: written, not published, on amazon's mechanical turk site''
'''Considerations'''
*Difficulties Encountered:
*Expected Time to Complete:
*Expectation of Results (accuracy of turk, comprehensiveness):
*Other Comments:

'''Procedure'''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events in July 2016 and record it. If there is no information of events on the website, record DNE.

Note***: ''Events include meetups, workshops, info sessions etc. We do not want to count them separately since it is difficult to do so. Most companies put all the events on the same section and do not put event types in the titles of the events. We have to look into the details of the events to find out the type and even we do so some events descriptions do not allow us to determine the type easily. Differentiating the types of the events demands more time and effort and therefore is not suitable to be a mechanical turk project.''

*'''Onsite Mentors''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'
#If the key words can be identified, mark as 1
#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., look for a subsection or mention of mentor/mentorship/mentoring
#If these exist, mark as 1.
#If not, go to links related to membership 'benefits,' 'perks,' or related.
#Do same process as end of 4 and 5
#If there is no mention of mentorship in these sections, type the company, city, and 'mentoring' into a search engine. If a link to a reliable website (such as Desktime) appears and mentorship can be found in the description, mark as 1.
#If none of these steps result in a mark of 1, mark as 0

*'''Nonprofit''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Go to links that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'
#Look for the key word 'nonprofit'/'non-profit'
#If 'nonprofit' is identified, mark as 1, otherwise 0.

*'''Number of Members''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link 'Members' or 'Residents', usually they are under the links 'Community', 'Membership', 'Our Space' or 'The Space'.
#Count the number of members
#If the link or section of 'Members' is not found, go the 'Community' and 'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.
#If number of members cannot be identified using above steps, record DNE.

*'''Sponsors and Partners''':''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link or mention of 'Sponsors' or 'Partners', many times of which is often under the section of 'About', 'Community', or related sections
#If sponsors or partners can be found mark as 1 and list them, otherwise mark as 0.

Hubs: Hubs Data

2016-07-20T15:43:09Z

ArielSun: /* Curriculum and Code School */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Test processes and audit
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Friday 7/28
#Have a comprehensive list of potential hubs
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Tuesday 7/26
#Fill in Remaining Data Manually
#*Status: NS
#*Begin Date: Monday 7/25
#*Reach Goal: Complete by Friday 7/29

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Sponsors/Partners
#*'''STATUS''': Not Started
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Specific Industry
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Caltivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
**Search Text: Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turks'''
#Google: "Search Text" site:URL
#Record 0 is no result appears

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
**Key words: website design, coding, web development, software
*'''TBD points'''
*"Potential Turks"
**Google "General Assembly" site:URL
***Anyone Can Learn to Code
***Umbraco
***Designation
***Boise CodeWorks
***Grand Circus
***DevMountain
***Silicon Valley Data Academy
***Academy Pittsburgh

====Onsite VC v. Angel Investors====
====Onsite OH Investors v. mentors====
====Onsite temporary workshops v. networking events====

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

=OLD1=
We will be creating a "Hubs scorecard" to determine how hub-like potential spaces are. In order to do so, we will evaluate the places based on certain variables. Previous variables for potential hubs were collected. Below, we list those as well as other variables we think might be helpful to build out the scorecard.

Ideally, we would have the following variables (not collected previously):
#Onsite VC/Angel/Investors (Count or binary)
##Comments:
##Mechanical Turk Comments:
#Onsite Mentors (binary) --- ''Are these the same as advisers?''
##Comments:
##Mechanical Turk Comments:
#"Office hours" with investors or mentors (binary)
##Comments: Previously collected included number of events, but did not separate them into categories (e.g. networking events, workshops, etc.). We view this separation as important, BUT very difficult to collect
##Mechanical Turk Comments:
#Onsite temporary workshops (binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Networking Meetups (Binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Sponsors and Partners (binary and list) --- a''re these the same?''
##Comments:
##Mechanical Turk Comments:
#Alumni Network (binary) --- ''not all potential hubslist this and the fact that some do might indicate its importance''
##Comments:
##Mechanical Turk Comments:
#Num of Companies --- ''to help determine size as getting physical sqfootage is difficult''
##Comments:
##Mechanical Turk Comments:
#Nonprofit (binary) --- ''helpful in determining goals of potential hubs''
##Comments:
##Mechanical Turk Comments:
#Mission Includes Key Buzzwords (e.g. "ecosystem", "community") --- ''help separate simple coworking spaces form hubs''

Example of Prior Variables Collected:
*Specific Industry -- ''defined as LinkedIN Self Identifier, no categories just plain text. We think what we really want is to see if they have a specialty (e.g. healthcare)''
*Num of Events --- ''relatively complete inputs, but from March 2016 (see above as well)''
*Price for Single Space --- ''defined as price for flexible desk, relatively complete inputs''
*Price for Office --- ''no inputs''
*Twitter Activity (Multinomial or Count) --- ''High=2/Moderate=1/No=0, no explanations on how to categorize the activity. Also no handles''
*Size (sqft) --- ''no records for majority of the companies''
*Num Conference Rooms --- ''no records for majority of the companies''
*Onsite accelerator (binary) --- ''relatively complete inputs''
*Onsite code school (binary) --- ''relatively complete inputs''
*Community Membership (binary) --- ''relatively complete inputs''

=OLD2=
*'''Twitter activity''': ''
'''UPDATE (7/14)''': Updated turk to reflect our desired formats
'''UPDATE (7/12)''': '''AUDIT RESULTS''': We noticed

'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#Copy the text in the Search Text into a search engine.
#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#Record the company's Twitter Handle into Twitter Handle
#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.

*'''NUMBER OF EVENTS''': ''UPDATE: written, not published, on amazon's mechanical turk site''
'''Considerations'''
*Difficulties Encountered:
*Expected Time to Complete:
*Expectation of Results (accuracy of turk, comprehensiveness):
*Other Comments:

'''Procedure'''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events in July 2016 and record it. If there is no information of events on the website, record DNE.

Note***: ''Events include meetups, workshops, info sessions etc. We do not want to count them separately since it is difficult to do so. Most companies put all the events on the same section and do not put event types in the titles of the events. We have to look into the details of the events to find out the type and even we do so some events descriptions do not allow us to determine the type easily. Differentiating the types of the events demands more time and effort and therefore is not suitable to be a mechanical turk project.''

*'''Onsite Mentors''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'
#If the key words can be identified, mark as 1
#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., look for a subsection or mention of mentor/mentorship/mentoring
#If these exist, mark as 1.
#If not, go to links related to membership 'benefits,' 'perks,' or related.
#Do same process as end of 4 and 5
#If there is no mention of mentorship in these sections, type the company, city, and 'mentoring' into a search engine. If a link to a reliable website (such as Desktime) appears and mentorship can be found in the description, mark as 1.
#If none of these steps result in a mark of 1, mark as 0

*'''Nonprofit''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Go to links that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'
#Look for the key word 'nonprofit'/'non-profit'
#If 'nonprofit' is identified, mark as 1, otherwise 0.

*'''Number of Members''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link 'Members' or 'Residents', usually they are under the links 'Community', 'Membership', 'Our Space' or 'The Space'.
#Count the number of members
#If the link or section of 'Members' is not found, go the 'Community' and 'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.
#If number of members cannot be identified using above steps, record DNE.

*'''Sponsors and Partners''':''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link or mention of 'Sponsors' or 'Partners', many times of which is often under the section of 'About', 'Community', or related sections
#If sponsors or partners can be found mark as 1 and list them, otherwise mark as 0.

Hubs: Hubs Data

2016-07-20T15:39:03Z

ArielSun: /* Curriculum and Code School */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Test processes and audit
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Friday 7/28
#Have a comprehensive list of potential hubs
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Tuesday 7/26
#Fill in Remaining Data Manually
#*Status: NS
#*Begin Date: Monday 7/25
#*Reach Goal: Complete by Friday 7/29

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Sponsors/Partners
#*'''STATUS''': Not Started
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Specific Industry
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm and code updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Caltivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
**Search Text: Fullbridge, leadership program, business academy, business course, aspiring entrepreneurs
*'''TBD points'''
**Do we care about outsourcing?
*"Potential Turks"
**Google "Fullbridge" site:URL

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
**Key words: website design, coding, web development, software
*'''TBD points'''
*"Potential Turks"
**Google "General Assembly" site:URL
***Anyone Can Learn to Code
***Umbraco
***Designation
***Boise CodeWorks
***Grand Circus
***DevMountain
***Silicon Valley Data Academy
***Academy Pittsburgh

====Onsite VC v. Angel Investors====
====Onsite OH Investors v. mentors====
====Onsite temporary workshops v. networking events====

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

=OLD1=
We will be creating a "Hubs scorecard" to determine how hub-like potential spaces are. In order to do so, we will evaluate the places based on certain variables. Previous variables for potential hubs were collected. Below, we list those as well as other variables we think might be helpful to build out the scorecard.

Ideally, we would have the following variables (not collected previously):
#Onsite VC/Angel/Investors (Count or binary)
##Comments:
##Mechanical Turk Comments:
#Onsite Mentors (binary) --- ''Are these the same as advisers?''
##Comments:
##Mechanical Turk Comments:
#"Office hours" with investors or mentors (binary)
##Comments: Previously collected included number of events, but did not separate them into categories (e.g. networking events, workshops, etc.). We view this separation as important, BUT very difficult to collect
##Mechanical Turk Comments:
#Onsite temporary workshops (binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Networking Meetups (Binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Sponsors and Partners (binary and list) --- a''re these the same?''
##Comments:
##Mechanical Turk Comments:
#Alumni Network (binary) --- ''not all potential hubslist this and the fact that some do might indicate its importance''
##Comments:
##Mechanical Turk Comments:
#Num of Companies --- ''to help determine size as getting physical sqfootage is difficult''
##Comments:
##Mechanical Turk Comments:
#Nonprofit (binary) --- ''helpful in determining goals of potential hubs''
##Comments:
##Mechanical Turk Comments:
#Mission Includes Key Buzzwords (e.g. "ecosystem", "community") --- ''help separate simple coworking spaces form hubs''

Example of Prior Variables Collected:
*Specific Industry -- ''defined as LinkedIN Self Identifier, no categories just plain text. We think what we really want is to see if they have a specialty (e.g. healthcare)''
*Num of Events --- ''relatively complete inputs, but from March 2016 (see above as well)''
*Price for Single Space --- ''defined as price for flexible desk, relatively complete inputs''
*Price for Office --- ''no inputs''
*Twitter Activity (Multinomial or Count) --- ''High=2/Moderate=1/No=0, no explanations on how to categorize the activity. Also no handles''
*Size (sqft) --- ''no records for majority of the companies''
*Num Conference Rooms --- ''no records for majority of the companies''
*Onsite accelerator (binary) --- ''relatively complete inputs''
*Onsite code school (binary) --- ''relatively complete inputs''
*Community Membership (binary) --- ''relatively complete inputs''

=OLD2=
*'''Twitter activity''': ''
'''UPDATE (7/14)''': Updated turk to reflect our desired formats
'''UPDATE (7/12)''': '''AUDIT RESULTS''': We noticed

'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#Copy the text in the Search Text into a search engine.
#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#Record the company's Twitter Handle into Twitter Handle
#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.

*'''NUMBER OF EVENTS''': ''UPDATE: written, not published, on amazon's mechanical turk site''
'''Considerations'''
*Difficulties Encountered:
*Expected Time to Complete:
*Expectation of Results (accuracy of turk, comprehensiveness):
*Other Comments:

'''Procedure'''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events in July 2016 and record it. If there is no information of events on the website, record DNE.

Note***: ''Events include meetups, workshops, info sessions etc. We do not want to count them separately since it is difficult to do so. Most companies put all the events on the same section and do not put event types in the titles of the events. We have to look into the details of the events to find out the type and even we do so some events descriptions do not allow us to determine the type easily. Differentiating the types of the events demands more time and effort and therefore is not suitable to be a mechanical turk project.''

*'''Onsite Mentors''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'
#If the key words can be identified, mark as 1
#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., look for a subsection or mention of mentor/mentorship/mentoring
#If these exist, mark as 1.
#If not, go to links related to membership 'benefits,' 'perks,' or related.
#Do same process as end of 4 and 5
#If there is no mention of mentorship in these sections, type the company, city, and 'mentoring' into a search engine. If a link to a reliable website (such as Desktime) appears and mentorship can be found in the description, mark as 1.
#If none of these steps result in a mark of 1, mark as 0

*'''Nonprofit''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Go to links that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'
#Look for the key word 'nonprofit'/'non-profit'
#If 'nonprofit' is identified, mark as 1, otherwise 0.

*'''Number of Members''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link 'Members' or 'Residents', usually they are under the links 'Community', 'Membership', 'Our Space' or 'The Space'.
#Count the number of members
#If the link or section of 'Members' is not found, go the 'Community' and 'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.
#If number of members cannot be identified using above steps, record DNE.

*'''Sponsors and Partners''':''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link or mention of 'Sponsors' or 'Partners', many times of which is often under the section of 'About', 'Community', or related sections
#If sponsors or partners can be found mark as 1 and list them, otherwise mark as 0.

Hubs: Hubs Data

2016-07-19T20:41:05Z

ArielSun: /* Actual WIP */

=Background=
This page represents the work used for mechanical turks for the paper: [[Hubs (Academic Paper)]]. As of Spring 2016, a list of potential Hubs with a set of characteristics was created. Many of these are not what will be defined as Hubs. We will be creating a scorecard to help subjectively define Hubs based on certain characteristics.

For more information on Mechanical Turks in general, see [[Mechanical Turk (Tool)]].

The main goal of the mechanical turk is to automate the collection of variables for potential hubs as much as possible. The key steps for the project are:
#Creating a '''comprehensive''' list of potential hubs
#Determining the best variables for the scorecard
#Building '''"filters"''' for automating the collection
#'''Running''' and '''auditing''' of the automation
#Collecting the remaining manual data

=Variables to be Used=
==Current Complete List==
'''As of Week of 7/11'''
#Onsite Venture Capital
#*Assets Under Management
#*Number
#Onsite Angel Investors
#Onsite Mentors
#Founding Date
#Site URL
#Office hours investors
#Office hours mentor/advisors
#Onsite temporary workshops
#Onsite mentors
#Networking Meetups
#Sponsors/Partners
#*University
#*Corporate
#Curriculum
#Onsite code school
#Alumni Network
#Nonprofit status
#Mission statement
#Specific Industry
#Price for a space
#Price for office
#Twitter activity
#Size (sqft)
#Size (# companies)
#Onsite accelerator
#Community membership??
#Franchise
#Multiple locations within city

==Grouping of Variables==
There are a few categories the majority of the variables fall under

'''Group 1: Low Hanging Fruit'''
Variables in this group are very easy to find and automate.
#Price for a space + office
#Twitter Activity
#Founding Date
#URL
#Mission Statement
#Nonprofit
#Sponsors/Partners
#Specific Industry

'''Group 2: The Difficult to Find'''
There are certain variables where the information is not readily available online or difficult to find.
#Size (can try to find press releases)

'''Group 3: In Between 1 and 2'''
Variables that aren't too easy or difficult to find and automate.
#Onsite accelerator
#Alumni mentor---vs. other mentors???

'''Group 4: The Hard to Differentiate'''
The key property of this group is that there are several similar variables, which would be difficult for a turk to differentiate. In order to fix this, we will need to create filters akin to the DSM5 scorecard. See the below section.
#Onsite VC v. Angel Investors
#Onsite OH Investors v. mentors
#Onsite temporary workshops v. networking events
#Curriculum v. code school

'''Group 5: The Need further Discussion Before Collection'''
Variables that need to be developed more prior to collection.
#Franchise and multiple locations within a city
#Community Membership

==Filters/Scorecard==
===General Approach===
The Scorecard will be broken down into three main parts: description, characteristics, andTBD parts. The procedure for creating these will be as follows: the description will be determined, develop the characteristics after looking over examples, the creation of possible mechanical turks that have complete accuracy even if not comprehension (e.g. a task will that always guarantees that there is an onsite mentor that covers only 40% of firms, but never misspecifies the existence of mentors), and auditing of the results.

===Example===
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*'''Potential Turk'''

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)

'''Temporary Workshops'''
*'''Desc''':a discussion/learning of a group of people on specific subjects
*'''Characteristic''':
**One time
**Have a topic/subject/goal
***e.g. learn to code workshop: Java script 101

=Additional Resources=
#[[Mechanical Turk (Tool)]]
#Veeral has created a google automating procedure for different lists

=Work in Progress=
==Goals for WIP==
#For GROUP 1, creation of mechanical turk steps:
#*'''EXAMPLE:'''
#*'''Twitter Activity'''
#**'''STATUS''': Complete/In Progress/Not Started
#**'''Previously Collected''': Yes/No
#**'''Published on Mechanical Turk''': Yes/No
#**'''Audited''': Yes/No
#**'''Updates''':
#**'''Code''':
#For GROUP 4:
##Scorecard Example
##Potential Mechanical Turk Steps (e.g. if specific organization is on website)
##Mechanical Turk Example (GROUP 1)
##Add Comments on:
###How much manual work remains/What is missing
###Any remaining difficulties
#For GROUPS 2 and 3:
##Brainstorm potential ways to find data
##Follow Steps in Group1

==Steps Needed to Complete==
#Establish automation process for Groups 1-3
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete By Friday 7/22
#Differentiate variables in Group 4
#*Status (7/19):
#*Begin Date: Started
#*Reach Goal: Complete by Wednesday 7/27
#Test processes and audit
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Friday 7/28
#Have a comprehensive list of potential hubs
#*Status (7/19): NS
#*Begin Date: Thursday 7/21
#*Reach Goal: Complete by Tuesday 7/26
#Fill in Remaining Data Manually
#*Status: NS
#*Begin Date: Monday 7/25
#*Reach Goal: Complete by Friday 7/29

==Actual WIP==
===Group 1===
#Twitter Activity
#*'''STATUS''': Complete
#*'''Previously Collected''': YES/NO - Recorded 2/1/0 to represent activity level, but not same as we are
#*'''Published on Mechanical Turk''': Yes
#*'''AUDITED''': Yes
#**'''Audit Results''': Comparing to 30 that manually done, for '''twitter handle,''' all 3 turkers agreed with our results 81% of the time, but at least 2 turkers agreed with our results 98% (the exception was a company that had several twitter handles based on location). Results were 52% and 89% respectively.
#*'''UPDATES''':
#**'''UPDATE (7/14)''': Updated turk to reflect our desired formats
#**'''UPDATE (7/12)''': Audited
#**'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#*#Record the company's Twitter Handle into Twitter Handle
#*#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.
#URL
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is <15 seconds - pay rate, therefore, recommended $.04
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#Record the URL of the first result in the following format www.___.__/ (e.g. if url is example.us/other, record www.example.us/)
#Mission Statement
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/18)''': Code written, expected time for each assignment is 20-30 seconds - pay rate, therefore, recommended $.08
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine (will include site:__ from Company's URL).
#*#Click on first link that is a subsection (e.g. "Mission", "About") from company's website (see Company's URL)
#*#If this does not exist, repeat steps 1 and 2 with Search Text 2
#*#If this does not exist, got to Company's URL
#*#Record the main text on the page up to five paragraphs (some of these will be a single line). Do NOT record subsections.
#*#If locating the main text in the prior step is unclear, record "Unclear"
#*#If no text exists, record "DNE"
#Nonprofit
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#**'''REQUIRES ADDITIONAL STEPS''': YES (need to double check results)
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Code written, code 2 of 2 is believed to be more accurate and efficient. Expected time to complete is 15 seconds - pay rate, therefore, recommended $.04
#*'''CODE 1 of 2'''
#*#Go to Company's URL.
#*#Go to links (sometimes will be sections of the URL page) that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'.
#*#If none of these exist, record DNE for PAGES
#*#Look for the word 'profit'/'nonprofit'/'non-profit'/'not-for-profit' (with or without -)
#*#If any of the key words exist is identified, record as 1, otherwise 0 for EXISTS (1/0).
#*#If it is marked as 1, record all sentences that the word is found in under SENTENCES.
#*#If the links do exist, record the name of the link under PAGES
#*#Repeat steps 4, 5, and 6 on the pages that were linked.
#*'''CODE 2 of 2'''
#*#Copy the text from Search Text into the search bar at http://www.guidestar.org/.
#*#Record all Organization Names that appear
#*#If no results appear, record DNE
#Price for a space + office
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Founding Date
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES, but only year
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Sponsors/Partners
#*'''STATUS''': Not Started
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD
#Specific Industry
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, based on LinkedIn identifier
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 2===
#Size
#*'''BRAINSTORM''': (7/19) 1), 2), 3): search allintext: sqft/square foot/square feet site: company URL. 4) Company Name, city, square feet and then choose frist result. Process might be easier (and cheaper) if Veeral runs code firstto eliminate a bunch of 0 result returned.
#*'''STATUS''': In Progress
#*'''Previously Collected''': YES/NO, many missing
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Brainstorm updated
#*'''CODE'''
#*#Copy the text in the Search Text 1 into a search engine.
#*#Record DNE if 0 results returned in SEARCH 1
#*#If there is a result, click first link in which result search text appears and record the sentence in which the text appears in SEARCH 1
#*#Repeat Steps 1-3 for Search Text 2 and 3 and record in respective SEARCH 2 and SEARCH 3 respectively

===Group 3===
#Mentors
#*'''BRAINSTORM''': Current form of this variable seems to be too general.
#*'''STATUS''': In Progress
#*'''Previously Collected''': NO
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/19)''': Two possible codes written. First one requires more manual work
#*'''CODE 1 of 2'''
#*#Go to Company URL
#*#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'.
#*#If the key words can be identified, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record urlhome in PAGE.
#*#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., and look for a subsection or mention of mentor/mentorship/mentoring.
#*#If these exist, record 1 in BINARY, copy the sentence it is included in SENTENCE, and record the link name clicked in PAGE.
#*#If not, go to links related to membership 'benefits,' 'perks,' or related and repeat Step 5.
#*#If none of these steps result in a mark of 1, mark as 0.
#*'''CODE 2 of 2'''
#*#Copy Search Text into search engine
#*#Mark as 1 if reliable site is populated, 0 otherwise
#Onsite Accelerator
#*'''BRAINSTORM''': Need a count.
#*'''STATUS''': Not Started
#*'''Previously Collected''': YES/NO, only a binary variable
#*'''Published on Mechanical Turk''': NO
#*'''AUDITED''': NO
#**'''Audit Results''': TBD
#*'''UPDATES''':
#**'''UPDATE (7/_)''': TBD
#*'''CODE'''
#*#Copy the text in the Search Text into a search engine.
#*#TBD

===Group 4===
====Curriculum and Code School====
'''Curriculum'''
*'''Desc''': The potential hub provides training programs for the founders of startups that might have human capital deficits that will lead to them not being about to adequately implement their ideas.
*'''Characteristics''':
**Education that is for a founder (as opposed to code schools which can be for people who just want to join a startup)
***Code schools are for startup labor supply
**Active input into a current entrepreneurial endeavor
***e.g. " The program is designed to augment and support the real-life business experiences that the students are facing every day in their entrepreneurial endeavors"
**Not an ad hoc session, not a one time meeting but a full "course", evidence of this could be
**Has evidence of a integrated curriculum leading to a new compentance
**Has evidence of a set fixed start and end dates that last XXX long
**Caltivate leadership for entrepreneurs
**Tagged "Business" as opposed to 'Tech' or 'Design'
**Is a session linked to others that regularly occurs
*'''TBD points'''
**Do we care about outsourcing?
*"Potential Turks"
**Google "Fullbridge" site:URL
***"leadership programs"
***"aspiring entrepreneurs"
***"business academy"

'''Code School'''
*'''Desc''': training programs that teach coding, data processing, webpage building and other technical skills.
*'''Characteristics''':
**Bootcamps
**Target group are the developers or people who want to join the startups but not the founders themselves
**Scheduled classes, not a one time meeting (as opposed to workshops)
**Key words: website design, coding, web development, software
*'''TBD points'''
*"Potential Turks"
**Google "General Assembly" site:URL
***Anyone Can Learn to Code
***Umbraco
***Designation
***Boise CodeWorks
***Grand Circus
***DevMountain
***Silicon Valley Data Academy
***Academy Pittsburgh

====Onsite VC v. Angel Investors====
====Onsite OH Investors v. mentors====
====Onsite temporary workshops v. networking events====

==Companies Used for Auditing/etc.==
Capital Factory, Austin
1871, Chicago
Rocket Space, San Francisco
1776, Washington D.C.
Betamore, Baltimore
Packard Place, Charlotte
The venture Center, Little Rock
GSV Labs, San Francisco
The Hive, Palo Alto
Innovation Pavilion, Denver
OSC Tech Lab, Akron
Speakeasy, Indianapolis
Riverside.io, Riverside
The Salt Mines, Columbus
InNEVation, Las Vegas
804 RVA
Impact Hub, Salt Lake
Awesome Inc, Louisville
Geekdom, San Antonio
Alloy26, Pittsburg
ReSET, Hartford
Ansir Innovation Center, San Diego
Domistation, Tallahassee
Atlanta Tech Village, Atlanta
Spark Labs, New York

=Completed Work=

=OLD1=
We will be creating a "Hubs scorecard" to determine how hub-like potential spaces are. In order to do so, we will evaluate the places based on certain variables. Previous variables for potential hubs were collected. Below, we list those as well as other variables we think might be helpful to build out the scorecard.

Ideally, we would have the following variables (not collected previously):
#Onsite VC/Angel/Investors (Count or binary)
##Comments:
##Mechanical Turk Comments:
#Onsite Mentors (binary) --- ''Are these the same as advisers?''
##Comments:
##Mechanical Turk Comments:
#"Office hours" with investors or mentors (binary)
##Comments: Previously collected included number of events, but did not separate them into categories (e.g. networking events, workshops, etc.). We view this separation as important, BUT very difficult to collect
##Mechanical Turk Comments:
#Onsite temporary workshops (binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Networking Meetups (Binary or count) *** '''see mechanical turk'''
##Comments:
##Mechanical Turk Comments:
#Sponsors and Partners (binary and list) --- a''re these the same?''
##Comments:
##Mechanical Turk Comments:
#Alumni Network (binary) --- ''not all potential hubslist this and the fact that some do might indicate its importance''
##Comments:
##Mechanical Turk Comments:
#Num of Companies --- ''to help determine size as getting physical sqfootage is difficult''
##Comments:
##Mechanical Turk Comments:
#Nonprofit (binary) --- ''helpful in determining goals of potential hubs''
##Comments:
##Mechanical Turk Comments:
#Mission Includes Key Buzzwords (e.g. "ecosystem", "community") --- ''help separate simple coworking spaces form hubs''

Example of Prior Variables Collected:
*Specific Industry -- ''defined as LinkedIN Self Identifier, no categories just plain text. We think what we really want is to see if they have a specialty (e.g. healthcare)''
*Num of Events --- ''relatively complete inputs, but from March 2016 (see above as well)''
*Price for Single Space --- ''defined as price for flexible desk, relatively complete inputs''
*Price for Office --- ''no inputs''
*Twitter Activity (Multinomial or Count) --- ''High=2/Moderate=1/No=0, no explanations on how to categorize the activity. Also no handles''
*Size (sqft) --- ''no records for majority of the companies''
*Num Conference Rooms --- ''no records for majority of the companies''
*Onsite accelerator (binary) --- ''relatively complete inputs''
*Onsite code school (binary) --- ''relatively complete inputs''
*Community Membership (binary) --- ''relatively complete inputs''

=OLD2=
*'''Twitter activity''': ''
'''UPDATE (7/14)''': Updated turk to reflect our desired formats
'''UPDATE (7/12)''': '''AUDIT RESULTS''': We noticed

'''UPDATE (7/11)''': uploaded and published on amazon's mechanical turk site. Given the time cost to either record number of tweets in a month or look up more than 10 tweets, we decided to record the date of the last 10th tweet. Using a sample of ~10 companies, We noticed minimal differences in data observations among using 10,20, and 30 tweets.''
#Copy the text in the Search Text into a search engine.
#Click on result from twitter.com with the company name. If the link does not appear on the first 3 pages, record DNE for both outputs
#Record the company's Twitter Handle into Twitter Handle
#Record the date (MM/DD/YY) of that tweet for Twitter Activity. If there are less than 10 tweets, record DNE.

*'''NUMBER OF EVENTS''': ''UPDATE: written, not published, on amazon's mechanical turk site''
'''Considerations'''
*Difficulties Encountered:
*Expected Time to Complete:
*Expectation of Results (accuracy of turk, comprehensiveness):
*Other Comments:

'''Procedure'''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to events, such as 'Events' or 'Calendar' on the homepage.
#If not found on the homepage, check 'About' and check 'Community'
#Count the number of events in July 2016 and record it. If there is no information of events on the website, record DNE.

Note***: ''Events include meetups, workshops, info sessions etc. We do not want to count them separately since it is difficult to do so. Most companies put all the events on the same section and do not put event types in the titles of the events. We have to look into the details of the events to find out the type and even we do so some events descriptions do not allow us to determine the type easily. Differentiating the types of the events demands more time and effort and therefore is not suitable to be a mechanical turk project.''

*'''Onsite Mentors''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for links related to mentorship such as 'mentors', 'mentorship' or 'mentoring programs'
#If the key words can be identified, mark as 1
#If there is no explicit 'mentoring' section, look for links related to a description of the company, such as: 'About,' 'Our Team,' 'Our Mission,' etc., look for a subsection or mention of mentor/mentorship/mentoring
#If these exist, mark as 1.
#If not, go to links related to membership 'benefits,' 'perks,' or related.
#Do same process as end of 4 and 5
#If there is no mention of mentorship in these sections, type the company, city, and 'mentoring' into a search engine. If a link to a reliable website (such as Desktime) appears and mentorship can be found in the description, mark as 1.
#If none of these steps result in a mark of 1, mark as 0

*'''Nonprofit''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Go to links that describe the company, usually they are labelled: 'About', 'Our Story,' 'Mission'
#Look for the key word 'nonprofit'/'non-profit'
#If 'nonprofit' is identified, mark as 1, otherwise 0.

*'''Number of Members''': ''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link 'Members' or 'Residents', usually they are under the links 'Community', 'Membership', 'Our Space' or 'The Space'.
#Count the number of members
#If the link or section of 'Members' is not found, go the 'Community' and 'Coworking' and look for the description on number of startups/founders/members in the community. Record the number.
#If number of members cannot be identified using above steps, record DNE.

*'''Sponsors and Partners''':''UPDATE: written, not published, on amazon's mechanical turk site''
#Copy the text in the Search Text into a search engine.
#Click on the result that is the website of the company. If there does not exist a listing on the first three pages, mark as DNE.
#Look for the link or mention of 'Sponsors' or 'Partners', many times of which is often under the section of 'About', 'Community', or related sections
#If sponsors or partners can be found mark as 1 and list them, otherwise mark as 0.

Matching VentureOne (Data)

2016-07-19T18:46:22Z

ArielSun: /* Updated */

{{McNair Projects
|Project Title=Matching VentureOne (Data)
|Topic Area=Patents and Innovation
|Owner=Ariel Sun, Rosemarie Ziedonis
|Start Term=Summer 2016
|Status=Active
|Deliverable=Other
|Primary Billing= AccMcNair01
}}
=Updated=
'''New Requirements'''
*re-run the match using *both* name-related fields in the startups_cl.dta file: “name” and “name_prev”.
#the latter field pulls in patents applied for under a former name of the same company

*in the output file, please include…
#include the field “entityid” that corresponds to each startup (this step is critical; else, we can’t link patents filed under alternative names of the company to the same firm); in startups_cl.dta
#all assignee-related fields in your patent data (e.g., assignee name, and any original and current uspto assignee codes listed for the patent); merge in from your patent files

'''Output'''

Text files are in:<code>E:\McNair\Projects\Venture One Data\</code>
#<code>summarytablefinal</code>: summary on number of patents and grant year for all companies
#<code>ullyjoinedtable</code>: all patent and assignee information for entities that have patents (combining 3 and 4)
#<code>fullyjoinednow</code>: patent information under current name of the company
#<code>fullyjoinedprev</code>: patent information under previous name of the company

A new version of sql script can be cound at :<code>E:\McNair\Projects\Venture One Data\sql script.txt</code>

'''notes'''
In summarytablefinal table: (for all entities)
Variables:
Entity Name|Standard Orgname|Number of patent|
Previous Name|Previous Standard Orgname|Previous Number of Patent|
Total number of Patent|
Orinigal ID | Revised ID|
min grant year|max grant year|avg grant year|
***One company have the exactly same name for entity name and previous name(Z-KAT) and there is double counting of patent. So the total number of patent
should be 11 instead of 22.

In fullyjoinedtable: (for entities that have patent)
Including all patent and assignee variables
33 variables in total
variables start with 'asg' are assignee information, e.g. asgtype = assignee type
The rest are patent information.

=Old=
==Overview==
In this matching process, we will join patent data to VentureOne companies and count the number of patents that affiliated to each company.

===Raw Data===
Original data set of VentureOne companies can be found at: <code>E:\McNair\Projects\Venture One Data\Venture Data 1.xlsx</code>
*All Variables: EntityName,Employees, City, State, Zip, AreaCode, Business Status, IndustryGroup...etc
*Variables used for matching: EntityName

Original patent data is in our database: <code>128.42.44.181/bulk/allpatent</code>

===Procedure===
We first get the standard company names for VentureOne companies from the source VentureOne data set. Then we standardize the names of the companies that have patents from our patent database. Based on the common standard company names, we join patent information to VentureOne companies.

===Final Matched Tables===
#Summary table displaying number of patents owned, minimum grant year, maximum grant year and average grant year for each company (including the ones that own no patents). It can be found at:<code>E:\McNair\Projects\Venture One Data\venturesummary.txt</code>
#A table contains all patent information for the companies that have patents and can be found at <code>E:\McNair\Projects\Venture One Data\venturefullyjoined.txt</code>

===Desired Variables===

Below is the list of variables that were in the STATA file we were given:
Contains data from C:\Users\ArielSun\Downloads\allpats_3sectors_06jun13.dta
obs: 19,409
vars: 36 11 Jun 2016 17:31
size: 10,655,541 (_dta has notes)
----------------------------------------------------------------------------------------------------------------------
storage display value
variable name type format label variable label
----------------------------------------------------------------------------------------------------------------------
id_vone double %9.0g VentureOne id
name str39 %39s startup name
patent str9 %9s patno in string
apn str6 %6s pat application number
nmi str40 %40s inventor name
ttl str244 %40s invention title
nma str65 %65s original assignee
ocd str15 %15s main us patent class
icd str15 %15s main intl patent class
apd float %td application date
gdateold float %td Grant date
fnd_year float %8.0g startup founding year
last_yr float %9.0g * OLD last_yr, 2006; see notes
source byte %8.0g 1 if 2012 delphion searches; else from 2004/5 search
pdate float %td priority date, delphion; may pre-date application date if provisional apps
utility float %9.0g * 1 if utility patent as initially awarded; 0 if other (reissued, reexamed, design
state_country str3 %9s state/country of first inventor listed
asscode float %9.0g assignee code; basic.dta
ayear int %9.0g application year
amonth byte %9.0g application month
atype str1 %9s * initial assignee type; see notes
class str3 %9s 3 digit us pat class
subclass str6 %9s patent subclass
gdate int %d grant, or issuance, date
industry str15 %15s semi, software, or med devices
state_hq str2 %9s firm hq location; vone
status06 str4 %9s * status of firm known in 2006; rhs truncation varies by sector
exitdate str8 %9s exit date, if known
exityr str4 %9s exit year, if known
status08 str6 %9s * status of firm in 2008, see notes
last_yr08 int %8.0g * exityr if ipo/acq, else 2008
dcohort float %9.0g 1 if founding yr during 1987-99
lastyr08_minu~r float %9.0g
dsearch_assign float %9.0g 1 if searches of pat assignment data need to be conducted; carlosn confirm?
carlos_chk float %9.0g carlos: pls confirm assignment data = compiled for these pats
entityid long %12.0g unique startup id as of 2008, vone
* indicated variables have notes
----------------------------------------------------------------------------------------------------------------------

==Detailed Data Processing==
;*Get the VentureOne data ready
#Source file for VentureOne data <code>E:\McNair\Projects\Venture One Data\Venture Data 1.xlsx</code> Original data source
#Clean it up <code>E:\McNair\Software\Scripts\Matcher\Input\Venture Data 1.txt</code> extraneous symbols and words removed
#Match it against itself to get standardized entity names <code>E:\McNair\Projects\Venture One Data\Cleaned and Matched Data.xlsx</code>

;*Get the patent data ready
#Draw the distinct assignees <code>Z:\allpatentsprocessed\DistinctAssignees2.txt </code>
#Match them against themselves to get standardized org names for patent data <code>Z:\allpatentsprocessed\DistinctAssignees2matched.txt </code>

;*Match standardized org names of patent data to standardized entity names of venture data
:<code>Z:\allpatentsprocessed\Venture Patent Matched.txt</code>

;*Join patent data to venture data to get patent information of each venture-backed company
#Join <code>patent</code> data to <code>assignee</code> data, creating <code>firstjoin_cleaned</code> which matches assignees to patent numbers.
#Join <code>firstjoin_cleaned</code> data to <code>matchassignee</code> data, creating <code>secondjoin_cleaned</code> which matches standard org names to patent numbers
#Join <code>secondjoin_cleaned</code> data to <code>venturepatentmatched</code> data, creating <code>fourthjoin_cleaned</code> which matches standard venture company names to patent numbers

;*Final summary tables
#Summary table displaying number of patents owned, minimum grant year, maximum grant year and average grant year for each company <code>E:\McNair\Projects\Venture One Data\venturepatentreallyfinal.txt</code>
#A table of all patent information for each company that has patents <code>E:\McNair\Projects\Venture One Data\venturepatentfullyjoined.txt</code>

;*Notes
#All data in <code>allpatentsprocessed database</code>. Access it by logging on to <code>researcher@McNair DBServ:/bulk/allpatentsprocessed</code>
#A script of detailed processing procedure can be found at <code>E:\McNair\Projects\Venture One Data\patent data script.txt</code>

==The matched data==

We are giving back two files:
*One is at the patent level and contains information on 38,497 patents held by the 1,557 of the 3,357 companies.
*The other file is at the company level and aggregate patent information for the 3,357 companies.

<includeonly>
[[Category: McNair Projects]]
</includeonly>

Matching VentureOne (Data)

2016-07-19T18:44:31Z

ArielSun: /* Updated */

{{McNair Projects
|Project Title=Matching VentureOne (Data)
|Topic Area=Patents and Innovation
|Owner=Ariel Sun, Rosemarie Ziedonis
|Start Term=Summer 2016
|Status=Active
|Deliverable=Other
|Primary Billing= AccMcNair01
}}
=Updated=
'''New Requirements'''
*re-run the match using *both* name-related fields in the startups_cl.dta file: “name” and “name_prev”.
#the latter field pulls in patents applied for under a former name of the same company

*in the output file, please include…
#include the field “entityid” that corresponds to each startup (this step is critical; else, we can’t link patents filed under alternative names of the company to the same firm); in startups_cl.dta
#all assignee-related fields in your patent data (e.g., assignee name, and any original and current uspto assignee codes listed for the patent); merge in from your patent files

'''Output'''

<code>E:\McNair\Projects\Venture One Data\</code>
#<code>summarytablefinal</code>: summary on number of patents and grant year for all companies
#<code>ullyjoinedtable</code>: all patent and assignee information for entities that have patents (combining 3 and 4)
#<code>fullyjoinednow</code>: patent information under current name of the company
#<code>fullyjoinedprev</code>: patent information under previous name of the company

'''notes'''
In summarytablefinal table: (for all entities)
Variables:
Entity Name|Standard Orgname|Number of patent|
Previous Name|Previous Standard Orgname|Previous Number of Patent|
Total number of Patent|
Orinigal ID | Revised ID|
min grant year|max grant year|avg grant year|
***One company have the exactly same name for entity name and previous name(Z-KAT) and there is double counting of patent. So the total number of patent
should be 11 instead of 22.

In fullyjoinedtable: (for entities that have patent)
Including all patent and assignee variables
33 variables in total
variables start with 'asg' are assignee information, e.g. asgtype = assignee type
The rest are patent information.

=Old=
==Overview==
In this matching process, we will join patent data to VentureOne companies and count the number of patents that affiliated to each company.

===Raw Data===
Original data set of VentureOne companies can be found at: <code>E:\McNair\Projects\Venture One Data\Venture Data 1.xlsx</code>
*All Variables: EntityName,Employees, City, State, Zip, AreaCode, Business Status, IndustryGroup...etc
*Variables used for matching: EntityName

Original patent data is in our database: <code>128.42.44.181/bulk/allpatent</code>

===Procedure===
We first get the standard company names for VentureOne companies from the source VentureOne data set. Then we standardize the names of the companies that have patents from our patent database. Based on the common standard company names, we join patent information to VentureOne companies.

===Final Matched Tables===
#Summary table displaying number of patents owned, minimum grant year, maximum grant year and average grant year for each company (including the ones that own no patents). It can be found at:<code>E:\McNair\Projects\Venture One Data\venturesummary.txt</code>
#A table contains all patent information for the companies that have patents and can be found at <code>E:\McNair\Projects\Venture One Data\venturefullyjoined.txt</code>

===Desired Variables===

Below is the list of variables that were in the STATA file we were given:
Contains data from C:\Users\ArielSun\Downloads\allpats_3sectors_06jun13.dta
obs: 19,409
vars: 36 11 Jun 2016 17:31
size: 10,655,541 (_dta has notes)
----------------------------------------------------------------------------------------------------------------------
storage display value
variable name type format label variable label
----------------------------------------------------------------------------------------------------------------------
id_vone double %9.0g VentureOne id
name str39 %39s startup name
patent str9 %9s patno in string
apn str6 %6s pat application number
nmi str40 %40s inventor name
ttl str244 %40s invention title
nma str65 %65s original assignee
ocd str15 %15s main us patent class
icd str15 %15s main intl patent class
apd float %td application date
gdateold float %td Grant date
fnd_year float %8.0g startup founding year
last_yr float %9.0g * OLD last_yr, 2006; see notes
source byte %8.0g 1 if 2012 delphion searches; else from 2004/5 search
pdate float %td priority date, delphion; may pre-date application date if provisional apps
utility float %9.0g * 1 if utility patent as initially awarded; 0 if other (reissued, reexamed, design
state_country str3 %9s state/country of first inventor listed
asscode float %9.0g assignee code; basic.dta
ayear int %9.0g application year
amonth byte %9.0g application month
atype str1 %9s * initial assignee type; see notes
class str3 %9s 3 digit us pat class
subclass str6 %9s patent subclass
gdate int %d grant, or issuance, date
industry str15 %15s semi, software, or med devices
state_hq str2 %9s firm hq location; vone
status06 str4 %9s * status of firm known in 2006; rhs truncation varies by sector
exitdate str8 %9s exit date, if known
exityr str4 %9s exit year, if known
status08 str6 %9s * status of firm in 2008, see notes
last_yr08 int %8.0g * exityr if ipo/acq, else 2008
dcohort float %9.0g 1 if founding yr during 1987-99
lastyr08_minu~r float %9.0g
dsearch_assign float %9.0g 1 if searches of pat assignment data need to be conducted; carlosn confirm?
carlos_chk float %9.0g carlos: pls confirm assignment data = compiled for these pats
entityid long %12.0g unique startup id as of 2008, vone
* indicated variables have notes
----------------------------------------------------------------------------------------------------------------------

==Detailed Data Processing==
;*Get the VentureOne data ready
#Source file for VentureOne data <code>E:\McNair\Projects\Venture One Data\Venture Data 1.xlsx</code> Original data source
#Clean it up <code>E:\McNair\Software\Scripts\Matcher\Input\Venture Data 1.txt</code> extraneous symbols and words removed
#Match it against itself to get standardized entity names <code>E:\McNair\Projects\Venture One Data\Cleaned and Matched Data.xlsx</code>

;*Get the patent data ready
#Draw the distinct assignees <code>Z:\allpatentsprocessed\DistinctAssignees2.txt </code>
#Match them against themselves to get standardized org names for patent data <code>Z:\allpatentsprocessed\DistinctAssignees2matched.txt </code>

;*Match standardized org names of patent data to standardized entity names of venture data
:<code>Z:\allpatentsprocessed\Venture Patent Matched.txt</code>

;*Join patent data to venture data to get patent information of each venture-backed company
#Join <code>patent</code> data to <code>assignee</code> data, creating <code>firstjoin_cleaned</code> which matches assignees to patent numbers.
#Join <code>firstjoin_cleaned</code> data to <code>matchassignee</code> data, creating <code>secondjoin_cleaned</code> which matches standard org names to patent numbers
#Join <code>secondjoin_cleaned</code> data to <code>venturepatentmatched</code> data, creating <code>fourthjoin_cleaned</code> which matches standard venture company names to patent numbers

;*Final summary tables
#Summary table displaying number of patents owned, minimum grant year, maximum grant year and average grant year for each company <code>E:\McNair\Projects\Venture One Data\venturepatentreallyfinal.txt</code>
#A table of all patent information for each company that has patents <code>E:\McNair\Projects\Venture One Data\venturepatentfullyjoined.txt</code>

;*Notes
#All data in <code>allpatentsprocessed database</code>. Access it by logging on to <code>researcher@McNair DBServ:/bulk/allpatentsprocessed</code>
#A script of detailed processing procedure can be found at <code>E:\McNair\Projects\Venture One Data\patent data script.txt</code>

==The matched data==

We are giving back two files:
*One is at the patent level and contains information on 38,497 patents held by the 1,557 of the 3,357 companies.
*The other file is at the company level and aggregate patent information for the 3,357 companies.

<includeonly>
[[Category: McNair Projects]]
</includeonly>

Matching VentureOne (Data)

2016-07-19T18:44:06Z

ArielSun: /* Updated */

{{McNair Projects
|Project Title=Matching VentureOne (Data)
|Topic Area=Patents and Innovation
|Owner=Ariel Sun, Rosemarie Ziedonis
|Start Term=Summer 2016
|Status=Active
|Deliverable=Other
|Primary Billing= AccMcNair01
}}
=Updated=
'''New Requirements'''
*re-run the match using *both* name-related fields in the startups_cl.dta file: “name” and “name_prev”.
#the latter field pulls in patents applied for under a former name of the same company

*in the output file, please include…
#include the field “entityid” that corresponds to each startup (this step is critical; else, we can’t link patents filed under alternative names of the company to the same firm); in startups_cl.dta
#all assignee-related fields in your patent data (e.g., assignee name, and any original and current uspto assignee codes listed for the patent); merge in from your patent files

'''Output'''

<code>E:\McNair\Projects\Venture One Data\</code>
#<code>summarytablefinal</code>: summary on number of patents and grant year for all companies
#<code>ullyjoinedtable</code>: all patent and assignee information for entities that have patents (combining 3 and 4)
#<code>fullyjoinednow</code>: patent information under current name of the company
#<code>fullyjoinedprec</code>: patent information under previous name of the company

'''notes'''
In summarytablefinal table: (for all entities)
Variables:
Entity Name|Standard Orgname|Number of patent|
Previous Name|Previous Standard Orgname|Previous Number of Patent|
Total number of Patent|
Orinigal ID | Revised ID|
min grant year|max grant year|avg grant year|
***One company have the exactly same name for entity name and previous name(Z-KAT) and there is double counting of patent. So the total number of patent
should be 11 instead of 22.

In fullyjoinedtable: (for entities that have patent)
Including all patent and assignee variables
33 variables in total
variables start with 'asg' are assignee information, e.g. asgtype = assignee type
The rest are patent information.

=Old=
==Overview==
In this matching process, we will join patent data to VentureOne companies and count the number of patents that affiliated to each company.

===Raw Data===
Original data set of VentureOne companies can be found at: <code>E:\McNair\Projects\Venture One Data\Venture Data 1.xlsx</code>
*All Variables: EntityName,Employees, City, State, Zip, AreaCode, Business Status, IndustryGroup...etc
*Variables used for matching: EntityName

Original patent data is in our database: <code>128.42.44.181/bulk/allpatent</code>

===Procedure===
We first get the standard company names for VentureOne companies from the source VentureOne data set. Then we standardize the names of the companies that have patents from our patent database. Based on the common standard company names, we join patent information to VentureOne companies.

===Final Matched Tables===
#Summary table displaying number of patents owned, minimum grant year, maximum grant year and average grant year for each company (including the ones that own no patents). It can be found at:<code>E:\McNair\Projects\Venture One Data\venturesummary.txt</code>
#A table contains all patent information for the companies that have patents and can be found at <code>E:\McNair\Projects\Venture One Data\venturefullyjoined.txt</code>

===Desired Variables===

Below is the list of variables that were in the STATA file we were given:
Contains data from C:\Users\ArielSun\Downloads\allpats_3sectors_06jun13.dta
obs: 19,409
vars: 36 11 Jun 2016 17:31
size: 10,655,541 (_dta has notes)
----------------------------------------------------------------------------------------------------------------------
storage display value
variable name type format label variable label
----------------------------------------------------------------------------------------------------------------------
id_vone double %9.0g VentureOne id
name str39 %39s startup name
patent str9 %9s patno in string
apn str6 %6s pat application number
nmi str40 %40s inventor name
ttl str244 %40s invention title
nma str65 %65s original assignee
ocd str15 %15s main us patent class
icd str15 %15s main intl patent class
apd float %td application date
gdateold float %td Grant date
fnd_year float %8.0g startup founding year
last_yr float %9.0g * OLD last_yr, 2006; see notes
source byte %8.0g 1 if 2012 delphion searches; else from 2004/5 search
pdate float %td priority date, delphion; may pre-date application date if provisional apps
utility float %9.0g * 1 if utility patent as initially awarded; 0 if other (reissued, reexamed, design
state_country str3 %9s state/country of first inventor listed
asscode float %9.0g assignee code; basic.dta
ayear int %9.0g application year
amonth byte %9.0g application month
atype str1 %9s * initial assignee type; see notes
class str3 %9s 3 digit us pat class
subclass str6 %9s patent subclass
gdate int %d grant, or issuance, date
industry str15 %15s semi, software, or med devices
state_hq str2 %9s firm hq location; vone
status06 str4 %9s * status of firm known in 2006; rhs truncation varies by sector
exitdate str8 %9s exit date, if known
exityr str4 %9s exit year, if known
status08 str6 %9s * status of firm in 2008, see notes
last_yr08 int %8.0g * exityr if ipo/acq, else 2008
dcohort float %9.0g 1 if founding yr during 1987-99
lastyr08_minu~r float %9.0g
dsearch_assign float %9.0g 1 if searches of pat assignment data need to be conducted; carlosn confirm?
carlos_chk float %9.0g carlos: pls confirm assignment data = compiled for these pats
entityid long %12.0g unique startup id as of 2008, vone
* indicated variables have notes
----------------------------------------------------------------------------------------------------------------------

==Detailed Data Processing==
;*Get the VentureOne data ready
#Source file for VentureOne data <code>E:\McNair\Projects\Venture One Data\Venture Data 1.xlsx</code> Original data source
#Clean it up <code>E:\McNair\Software\Scripts\Matcher\Input\Venture Data 1.txt</code> extraneous symbols and words removed
#Match it against itself to get standardized entity names <code>E:\McNair\Projects\Venture One Data\Cleaned and Matched Data.xlsx</code>

;*Get the patent data ready
#Draw the distinct assignees <code>Z:\allpatentsprocessed\DistinctAssignees2.txt </code>
#Match them against themselves to get standardized org names for patent data <code>Z:\allpatentsprocessed\DistinctAssignees2matched.txt </code>

;*Match standardized org names of patent data to standardized entity names of venture data
:<code>Z:\allpatentsprocessed\Venture Patent Matched.txt</code>

;*Join patent data to venture data to get patent information of each venture-backed company
#Join <code>patent</code> data to <code>assignee</code> data, creating <code>firstjoin_cleaned</code> which matches assignees to patent numbers.
#Join <code>firstjoin_cleaned</code> data to <code>matchassignee</code> data, creating <code>secondjoin_cleaned</code> which matches standard org names to patent numbers
#Join <code>secondjoin_cleaned</code> data to <code>venturepatentmatched</code> data, creating <code>fourthjoin_cleaned</code> which matches standard venture company names to patent numbers

;*Final summary tables
#Summary table displaying number of patents owned, minimum grant year, maximum grant year and average grant year for each company <code>E:\McNair\Projects\Venture One Data\venturepatentreallyfinal.txt</code>
#A table of all patent information for each company that has patents <code>E:\McNair\Projects\Venture One Data\venturepatentfullyjoined.txt</code>

;*Notes
#All data in <code>allpatentsprocessed database</code>. Access it by logging on to <code>researcher@McNair DBServ:/bulk/allpatentsprocessed</code>
#A script of detailed processing procedure can be found at <code>E:\McNair\Projects\Venture One Data\patent data script.txt</code>

==The matched data==

We are giving back two files:
*One is at the patent level and contains information on 38,497 patents held by the 1,557 of the 3,357 companies.
*The other file is at the company level and aggregate patent information for the 3,357 companies.

<includeonly>
[[Category: McNair Projects]]
</includeonly>

Matching VentureOne (Data)

2016-07-19T18:43:15Z

ArielSun: /* Updated */

{{McNair Projects
|Project Title=Matching VentureOne (Data)
|Topic Area=Patents and Innovation
|Owner=Ariel Sun, Rosemarie Ziedonis
|Start Term=Summer 2016
|Status=Active
|Deliverable=Other
|Primary Billing= AccMcNair01
}}
=Updated=
'''New Requirements'''
*re-run the match using *both* name-related fields in the startups_cl.dta file: “name” and “name_prev”.
#the latter field pulls in patents applied for under a former name of the same company

*in the output file, please include…
#include the field “entityid” that corresponds to each startup (this step is critical; else, we can’t link patents filed under alternative names of the company to the same firm); in startups_cl.dta
#all assignee-related fields in your patent data (e.g., assignee name, and any original and current uspto assignee codes listed for the patent); merge in from your patent files

'''Output'''

<code>E:\McNair\Projects\Venture One Data\</code>
#summarytablefinal: summary on number of patents and grant year for all companies
#ullyjoinedtable: all patent and assignee information for entities that have patents (combining 3 and 4)
#fullyjoinednow: patent information under current name of the company
#fullyjoinedprec: patent information under previous name of the company

'''notes'''
In summarytablefinal table: (for all entities)
Variables:
Entity Name|Standard Orgname|Number of patent|
Previous Name|Previous Standard Orgname|Previous Number of Patent|
Total number of Patent|
Orinigal ID | Revised ID|
min grant year|max grant year|avg grant year|
***One company have the exactly same name for entity name and previous name(Z-KAT) and there is double counting of patent. So the total number of patent
should be 11 instead of 22.

In fullyjoinedtable: (for entities that have patent)
Including all patent and assignee variables
33 variables in total
variables start with 'asg' are assignee information, e.g. asgtype = assignee type
The rest are patent information.

=Old=
==Overview==
In this matching process, we will join patent data to VentureOne companies and count the number of patents that affiliated to each company.

===Raw Data===
Original data set of VentureOne companies can be found at: <code>E:\McNair\Projects\Venture One Data\Venture Data 1.xlsx</code>
*All Variables: EntityName,Employees, City, State, Zip, AreaCode, Business Status, IndustryGroup...etc
*Variables used for matching: EntityName

Original patent data is in our database: <code>128.42.44.181/bulk/allpatent</code>

===Procedure===
We first get the standard company names for VentureOne companies from the source VentureOne data set. Then we standardize the names of the companies that have patents from our patent database. Based on the common standard company names, we join patent information to VentureOne companies.

===Final Matched Tables===
#Summary table displaying number of patents owned, minimum grant year, maximum grant year and average grant year for each company (including the ones that own no patents). It can be found at:<code>E:\McNair\Projects\Venture One Data\venturesummary.txt</code>
#A table contains all patent information for the companies that have patents and can be found at <code>E:\McNair\Projects\Venture One Data\venturefullyjoined.txt</code>

===Desired Variables===

Below is the list of variables that were in the STATA file we were given:
Contains data from C:\Users\ArielSun\Downloads\allpats_3sectors_06jun13.dta
obs: 19,409
vars: 36 11 Jun 2016 17:31
size: 10,655,541 (_dta has notes)
----------------------------------------------------------------------------------------------------------------------
storage display value
variable name type format label variable label
----------------------------------------------------------------------------------------------------------------------
id_vone double %9.0g VentureOne id
name str39 %39s startup name
patent str9 %9s patno in string
apn str6 %6s pat application number
nmi str40 %40s inventor name
ttl str244 %40s invention title
nma str65 %65s original assignee
ocd str15 %15s main us patent class
icd str15 %15s main intl patent class
apd float %td application date
gdateold float %td Grant date
fnd_year float %8.0g startup founding year
last_yr float %9.0g * OLD last_yr, 2006; see notes
source byte %8.0g 1 if 2012 delphion searches; else from 2004/5 search
pdate float %td priority date, delphion; may pre-date application date if provisional apps
utility float %9.0g * 1 if utility patent as initially awarded; 0 if other (reissued, reexamed, design
state_country str3 %9s state/country of first inventor listed
asscode float %9.0g assignee code; basic.dta
ayear int %9.0g application year
amonth byte %9.0g application month
atype str1 %9s * initial assignee type; see notes
class str3 %9s 3 digit us pat class
subclass str6 %9s patent subclass
gdate int %d grant, or issuance, date
industry str15 %15s semi, software, or med devices
state_hq str2 %9s firm hq location; vone
status06 str4 %9s * status of firm known in 2006; rhs truncation varies by sector
exitdate str8 %9s exit date, if known
exityr str4 %9s exit year, if known
status08 str6 %9s * status of firm in 2008, see notes
last_yr08 int %8.0g * exityr if ipo/acq, else 2008
dcohort float %9.0g 1 if founding yr during 1987-99
lastyr08_minu~r float %9.0g
dsearch_assign float %9.0g 1 if searches of pat assignment data need to be conducted; carlosn confirm?
carlos_chk float %9.0g carlos: pls confirm assignment data = compiled for these pats
entityid long %12.0g unique startup id as of 2008, vone
* indicated variables have notes
----------------------------------------------------------------------------------------------------------------------

==Detailed Data Processing==
;*Get the VentureOne data ready
#Source file for VentureOne data <code>E:\McNair\Projects\Venture One Data\Venture Data 1.xlsx</code> Original data source
#Clean it up <code>E:\McNair\Software\Scripts\Matcher\Input\Venture Data 1.txt</code> extraneous symbols and words removed
#Match it against itself to get standardized entity names <code>E:\McNair\Projects\Venture One Data\Cleaned and Matched Data.xlsx</code>

;*Get the patent data ready
#Draw the distinct assignees <code>Z:\allpatentsprocessed\DistinctAssignees2.txt </code>
#Match them against themselves to get standardized org names for patent data <code>Z:\allpatentsprocessed\DistinctAssignees2matched.txt </code>

;*Match standardized org names of patent data to standardized entity names of venture data
:<code>Z:\allpatentsprocessed\Venture Patent Matched.txt</code>

;*Join patent data to venture data to get patent information of each venture-backed company
#Join <code>patent</code> data to <code>assignee</code> data, creating <code>firstjoin_cleaned</code> which matches assignees to patent numbers.
#Join <code>firstjoin_cleaned</code> data to <code>matchassignee</code> data, creating <code>secondjoin_cleaned</code> which matches standard org names to patent numbers
#Join <code>secondjoin_cleaned</code> data to <code>venturepatentmatched</code> data, creating <code>fourthjoin_cleaned</code> which matches standard venture company names to patent numbers

;*Final summary tables
#Summary table displaying number of patents owned, minimum grant year, maximum grant year and average grant year for each company <code>E:\McNair\Projects\Venture One Data\venturepatentreallyfinal.txt</code>
#A table of all patent information for each company that has patents <code>E:\McNair\Projects\Venture One Data\venturepatentfullyjoined.txt</code>

;*Notes
#All data in <code>allpatentsprocessed database</code>. Access it by logging on to <code>researcher@McNair DBServ:/bulk/allpatentsprocessed</code>
#A script of detailed processing procedure can be found at <code>E:\McNair\Projects\Venture One Data\patent data script.txt</code>

==The matched data==

We are giving back two files:
*One is at the patent level and contains information on 38,497 patents held by the 1,557 of the 3,357 companies.
*The other file is at the company level and aggregate patent information for the 3,357 companies.

<includeonly>
[[Category: McNair Projects]]
</includeonly>

Matching VentureOne (Data)

2016-07-19T18:42:32Z

ArielSun: /* Updated */

{{McNair Projects
|Project Title=Matching VentureOne (Data)
|Topic Area=Patents and Innovation
|Owner=Ariel Sun, Rosemarie Ziedonis
|Start Term=Summer 2016
|Status=Active
|Deliverable=Other
|Primary Billing= AccMcNair01
}}
=Updated=
'''New Requirements'''
#re-run the match using *both* name-related fields in the startups_cl.dta file: “name” and “name_prev”.
*the latter field pulls in patents applied for under a former name of the same company

#in the output file, please include…
*include the field “entityid” that corresponds to each startup (this step is critical; else, we can’t link patents filed under alternative names of the company to the same firm); in startups_cl.dta
*all assignee-related fields in your patent data (e.g., assignee name, and any original and current uspto assignee codes listed for the patent); merge in from your patent files

'''Output'''

<code>E:\McNair\Projects\Venture One Data\</code>
#summarytablefinal: summary on number of patents and grant year for all companies
#ullyjoinedtable: all patent and assignee information for entities that have patents (combining 3 and 4)
#fullyjoinednow: patent information under current name of the company
#fullyjoinedprec: patent information under previous name of the company

'''notes'''
In summarytablefinal table: (for all entities)
Variables:
Entity Name|Standard Orgname|Number of patent|
Previous Name|Previous Standard Orgname|Previous Number of Patent|
Total number of Patent|
Orinigal ID | Revised ID|
min grant year|max grant year|avg grant year|
***One company have the exactly same name for entity name and previous name(Z-KAT) and there is double counting of patent. So the total number of patent
should be 11 instead of 22.

In fullyjoinedtable: (for entities that have patent)
Including all patent and assignee variables
33 variables in total
variables start with 'asg' are assignee information, e.g. asgtype = assignee type
The rest are patent information.

=Old=
==Overview==
In this matching process, we will join patent data to VentureOne companies and count the number of patents that affiliated to each company.

===Raw Data===
Original data set of VentureOne companies can be found at: <code>E:\McNair\Projects\Venture One Data\Venture Data 1.xlsx</code>
*All Variables: EntityName,Employees, City, State, Zip, AreaCode, Business Status, IndustryGroup...etc
*Variables used for matching: EntityName

Original patent data is in our database: <code>128.42.44.181/bulk/allpatent</code>

===Procedure===
We first get the standard company names for VentureOne companies from the source VentureOne data set. Then we standardize the names of the companies that have patents from our patent database. Based on the common standard company names, we join patent information to VentureOne companies.

===Final Matched Tables===
#Summary table displaying number of patents owned, minimum grant year, maximum grant year and average grant year for each company (including the ones that own no patents). It can be found at:<code>E:\McNair\Projects\Venture One Data\venturesummary.txt</code>
#A table contains all patent information for the companies that have patents and can be found at <code>E:\McNair\Projects\Venture One Data\venturefullyjoined.txt</code>

===Desired Variables===

Below is the list of variables that were in the STATA file we were given:
Contains data from C:\Users\ArielSun\Downloads\allpats_3sectors_06jun13.dta
obs: 19,409
vars: 36 11 Jun 2016 17:31
size: 10,655,541 (_dta has notes)
----------------------------------------------------------------------------------------------------------------------
storage display value
variable name type format label variable label
----------------------------------------------------------------------------------------------------------------------
id_vone double %9.0g VentureOne id
name str39 %39s startup name
patent str9 %9s patno in string
apn str6 %6s pat application number
nmi str40 %40s inventor name
ttl str244 %40s invention title
nma str65 %65s original assignee
ocd str15 %15s main us patent class
icd str15 %15s main intl patent class
apd float %td application date
gdateold float %td Grant date
fnd_year float %8.0g startup founding year
last_yr float %9.0g * OLD last_yr, 2006; see notes
source byte %8.0g 1 if 2012 delphion searches; else from 2004/5 search
pdate float %td priority date, delphion; may pre-date application date if provisional apps
utility float %9.0g * 1 if utility patent as initially awarded; 0 if other (reissued, reexamed, design
state_country str3 %9s state/country of first inventor listed
asscode float %9.0g assignee code; basic.dta
ayear int %9.0g application year
amonth byte %9.0g application month
atype str1 %9s * initial assignee type; see notes
class str3 %9s 3 digit us pat class
subclass str6 %9s patent subclass
gdate int %d grant, or issuance, date
industry str15 %15s semi, software, or med devices
state_hq str2 %9s firm hq location; vone
status06 str4 %9s * status of firm known in 2006; rhs truncation varies by sector
exitdate str8 %9s exit date, if known
exityr str4 %9s exit year, if known
status08 str6 %9s * status of firm in 2008, see notes
last_yr08 int %8.0g * exityr if ipo/acq, else 2008
dcohort float %9.0g 1 if founding yr during 1987-99
lastyr08_minu~r float %9.0g
dsearch_assign float %9.0g 1 if searches of pat assignment data need to be conducted; carlosn confirm?
carlos_chk float %9.0g carlos: pls confirm assignment data = compiled for these pats
entityid long %12.0g unique startup id as of 2008, vone
* indicated variables have notes
----------------------------------------------------------------------------------------------------------------------

==Detailed Data Processing==
;*Get the VentureOne data ready
#Source file for VentureOne data <code>E:\McNair\Projects\Venture One Data\Venture Data 1.xlsx</code> Original data source
#Clean it up <code>E:\McNair\Software\Scripts\Matcher\Input\Venture Data 1.txt</code> extraneous symbols and words removed
#Match it against itself to get standardized entity names <code>E:\McNair\Projects\Venture One Data\Cleaned and Matched Data.xlsx</code>

;*Get the patent data ready
#Draw the distinct assignees <code>Z:\allpatentsprocessed\DistinctAssignees2.txt </code>
#Match them against themselves to get standardized org names for patent data <code>Z:\allpatentsprocessed\DistinctAssignees2matched.txt </code>

;*Match standardized org names of patent data to standardized entity names of venture data
:<code>Z:\allpatentsprocessed\Venture Patent Matched.txt</code>

;*Join patent data to venture data to get patent information of each venture-backed company
#Join <code>patent</code> data to <code>assignee</code> data, creating <code>firstjoin_cleaned</code> which matches assignees to patent numbers.
#Join <code>firstjoin_cleaned</code> data to <code>matchassignee</code> data, creating <code>secondjoin_cleaned</code> which matches standard org names to patent numbers
#Join <code>secondjoin_cleaned</code> data to <code>venturepatentmatched</code> data, creating <code>fourthjoin_cleaned</code> which matches standard venture company names to patent numbers

;*Final summary tables
#Summary table displaying number of patents owned, minimum grant year, maximum grant year and average grant year for each company <code>E:\McNair\Projects\Venture One Data\venturepatentreallyfinal.txt</code>
#A table of all patent information for each company that has patents <code>E:\McNair\Projects\Venture One Data\venturepatentfullyjoined.txt</code>

;*Notes
#All data in <code>allpatentsprocessed database</code>. Access it by logging on to <code>researcher@McNair DBServ:/bulk/allpatentsprocessed</code>
#A script of detailed processing procedure can be found at <code>E:\McNair\Projects\Venture One Data\patent data script.txt</code>

==The matched data==

We are giving back two files:
*One is at the patent level and contains information on 38,497 patents held by the 1,557 of the 3,357 companies.
*The other file is at the company level and aggregate patent information for the 3,357 companies.

<includeonly>
[[Category: McNair Projects]]
</includeonly>

Matching VentureOne (Data)

2016-07-19T18:41:13Z

ArielSun:

{{McNair Projects
|Project Title=Matching VentureOne (Data)
|Topic Area=Patents and Innovation
|Owner=Ariel Sun, Rosemarie Ziedonis
|Start Term=Summer 2016
|Status=Active
|Deliverable=Other
|Primary Billing= AccMcNair01
}}
=Updated=
'''New Requirements'''
#re-run the match using *both* name-related fields in the startups_cl.dta file: “name” and “name_prev”.
note: the latter field pulls in patents applied for under a former name of the same company

#in the output file, please include…
*include the field “entityid” that corresponds to each startup (this step is critical; else, we can’t link patents filed under alternative names of the company to the same firm); in startups_cl.dta
*all assignee-related fields in your patent data (e.g., assignee name, and any original and current uspto assignee codes listed for the patent); merge in from your patent files

'''Output'''
<code>E:\McNair\Projects\Venture One Data\</code>
#summarytablefinal: summary on number of patents and grant year for all companies
#ullyjoinedtable: all patent and assignee information for entities that have patents (combining 3 and 4)
#fullyjoinednow: patent information under current name of the company
#fullyjoinedprec: patent information under previous name of the company

'''notes'''
In summarytablefinal table: (for all entities)
Variables:
Entity Name|Standard Orgname|Number of patent|
Previous Name|Previous Standard Orgname|Previous Number of Patent|
Total number of Patent|
Orinigal ID | Revised ID|
min grant year|max grant year|avg grant year|

***One company have the exactly same name for entity name and previous name(Z-KAT) and there is double counting of patent. So the total number of patent
should be 11 instead of 22.

In fullyjoinedtable: (for entities that have patent)
Including all patent and assignee variables
33 variables in total
variables start with 'asg' are assignee information, e.g. asgtype = assignee type
The rest are patent information.

=Old=
==Overview==
In this matching process, we will join patent data to VentureOne companies and count the number of patents that affiliated to each company.

===Raw Data===
Original data set of VentureOne companies can be found at: <code>E:\McNair\Projects\Venture One Data\Venture Data 1.xlsx</code>
*All Variables: EntityName,Employees, City, State, Zip, AreaCode, Business Status, IndustryGroup...etc
*Variables used for matching: EntityName

Original patent data is in our database: <code>128.42.44.181/bulk/allpatent</code>

===Procedure===
We first get the standard company names for VentureOne companies from the source VentureOne data set. Then we standardize the names of the companies that have patents from our patent database. Based on the common standard company names, we join patent information to VentureOne companies.

===Final Matched Tables===
#Summary table displaying number of patents owned, minimum grant year, maximum grant year and average grant year for each company (including the ones that own no patents). It can be found at:<code>E:\McNair\Projects\Venture One Data\venturesummary.txt</code>
#A table contains all patent information for the companies that have patents and can be found at <code>E:\McNair\Projects\Venture One Data\venturefullyjoined.txt</code>

===Desired Variables===

Below is the list of variables that were in the STATA file we were given:
Contains data from C:\Users\ArielSun\Downloads\allpats_3sectors_06jun13.dta
obs: 19,409
vars: 36 11 Jun 2016 17:31
size: 10,655,541 (_dta has notes)
----------------------------------------------------------------------------------------------------------------------
storage display value
variable name type format label variable label
----------------------------------------------------------------------------------------------------------------------
id_vone double %9.0g VentureOne id
name str39 %39s startup name
patent str9 %9s patno in string
apn str6 %6s pat application number
nmi str40 %40s inventor name
ttl str244 %40s invention title
nma str65 %65s original assignee
ocd str15 %15s main us patent class
icd str15 %15s main intl patent class
apd float %td application date
gdateold float %td Grant date
fnd_year float %8.0g startup founding year
last_yr float %9.0g * OLD last_yr, 2006; see notes
source byte %8.0g 1 if 2012 delphion searches; else from 2004/5 search
pdate float %td priority date, delphion; may pre-date application date if provisional apps
utility float %9.0g * 1 if utility patent as initially awarded; 0 if other (reissued, reexamed, design
state_country str3 %9s state/country of first inventor listed
asscode float %9.0g assignee code; basic.dta
ayear int %9.0g application year
amonth byte %9.0g application month
atype str1 %9s * initial assignee type; see notes
class str3 %9s 3 digit us pat class
subclass str6 %9s patent subclass
gdate int %d grant, or issuance, date
industry str15 %15s semi, software, or med devices
state_hq str2 %9s firm hq location; vone
status06 str4 %9s * status of firm known in 2006; rhs truncation varies by sector
exitdate str8 %9s exit date, if known
exityr str4 %9s exit year, if known
status08 str6 %9s * status of firm in 2008, see notes
last_yr08 int %8.0g * exityr if ipo/acq, else 2008
dcohort float %9.0g 1 if founding yr during 1987-99
lastyr08_minu~r float %9.0g
dsearch_assign float %9.0g 1 if searches of pat assignment data need to be conducted; carlosn confirm?
carlos_chk float %9.0g carlos: pls confirm assignment data = compiled for these pats
entityid long %12.0g unique startup id as of 2008, vone
* indicated variables have notes
----------------------------------------------------------------------------------------------------------------------

==Detailed Data Processing==
;*Get the VentureOne data ready
#Source file for VentureOne data <code>E:\McNair\Projects\Venture One Data\Venture Data 1.xlsx</code> Original data source
#Clean it up <code>E:\McNair\Software\Scripts\Matcher\Input\Venture Data 1.txt</code> extraneous symbols and words removed
#Match it against itself to get standardized entity names <code>E:\McNair\Projects\Venture One Data\Cleaned and Matched Data.xlsx</code>

;*Get the patent data ready
#Draw the distinct assignees <code>Z:\allpatentsprocessed\DistinctAssignees2.txt </code>
#Match them against themselves to get standardized org names for patent data <code>Z:\allpatentsprocessed\DistinctAssignees2matched.txt </code>

;*Match standardized org names of patent data to standardized entity names of venture data
:<code>Z:\allpatentsprocessed\Venture Patent Matched.txt</code>

;*Join patent data to venture data to get patent information of each venture-backed company
#Join <code>patent</code> data to <code>assignee</code> data, creating <code>firstjoin_cleaned</code> which matches assignees to patent numbers.
#Join <code>firstjoin_cleaned</code> data to <code>matchassignee</code> data, creating <code>secondjoin_cleaned</code> which matches standard org names to patent numbers
#Join <code>secondjoin_cleaned</code> data to <code>venturepatentmatched</code> data, creating <code>fourthjoin_cleaned</code> which matches standard venture company names to patent numbers

;*Final summary tables
#Summary table displaying number of patents owned, minimum grant year, maximum grant year and average grant year for each company <code>E:\McNair\Projects\Venture One Data\venturepatentreallyfinal.txt</code>
#A table of all patent information for each company that has patents <code>E:\McNair\Projects\Venture One Data\venturepatentfullyjoined.txt</code>

;*Notes
#All data in <code>allpatentsprocessed database</code>. Access it by logging on to <code>researcher@McNair DBServ:/bulk/allpatentsprocessed</code>
#A script of detailed processing procedure can be found at <code>E:\McNair\Projects\Venture One Data\patent data script.txt</code>

==The matched data==

We are giving back two files:
*One is at the patent level and contains information on 38,497 patents held by the 1,557 of the 3,357 companies.
*The other file is at the company level and aggregate patent information for the 3,357 companies.

<includeonly>
[[Category: McNair Projects]]
</includeonly>