USPTO Patent Assignment Dataset - Revision history

Ed at 17:41, 21 September 2020

2020-09-21T17:41:46Z

2020-09-21T17:34:21Z

2020-09-20T17:20:18Z

2020-09-20T17:12:30Z

2017-11-17T03:12:11Z

2017-11-16T19:17:29Z

Getting the data

2017-11-16T18:38:49Z

Getting the data

2017-11-16T18:36:55Z

2017-11-15T18:10:20Z

2017-11-15T17:30:05Z

@@ Line 1: / Line 1: @@
 {{Project
-|Has project output=
+|Has project output=Data
 |Has sponsor=McNair Center
 |Has title=USPTO Patent Assignment Dataset

@@ Line 1: / Line 1: @@
 {{Project
 |Has sponsor=McNair Center
 |Has title=USPTO Patent Assignment Dataset

@@ Line 1: / Line 1: @@
 {{Project
 |Has title=USPTO Patent Assignment Dataset
 |Has owner=Ed Egan,

@@ Line 1: / Line 1: @@
-{{McNair Projects
+{{Project
 |Has title=USPTO Patent Assignment Dataset
 |Has owner=Ed Egan,

@@ Line 32: / Line 32: @@
   LoadUSPTOPAD.sql
-To get the data into UTF-8, move it to the dbase server then:
+To get the data into ASCII or ASCII, move it to the dbase server then:
 *Check its encoding using:
   file -i Car.java
@@ Line 42: / Line 42: @@
   chmod  +x  encoding.sh
   ./encoding.sh

@@ Line 37: / Line 37: @@
 *Convert it to UTF-8 using (the TRANSLIT option approximates characters that can't be directly encoded)
   iconv -f oldformat -t UTF-8//TRANSLIT file -o outfile
-*A bash script to do all of the csvs is in Z:\USPTO_assigneesdata; make it executable and then run it
+**The sc  options forces iconv to ignore bad chars and move on:
   chmod  +x  encoding.sh
   ./encoding.sh

← Older revision		Revision as of 18:36, 16 November 2017
Line 31:		Line 31:
	The load script is:		The load script is:
	LoadUSPTOPAD.sql		LoadUSPTOPAD.sql
		+
		+	To get the data into UTF-8, move it to the dbase server then:
		+	*Check its encoding using:
		+	file -i Car.java
		+	*Convert it to UTF-8 using (the TRANSLIT option approximates characters that can't be directly encoded)
		+	iconv -f oldformat -t UTF-8//TRANSLIT file -o outfile
		+	*A bash script to do all of the csvs is in Z:\USPTO; make it executable and then run it
		+	chmod +x encoding.sh
		+	./encoding.sh

@@ Line 7: / Line 7: @@
 This project describes the build out and basic use of the USPTO Assignment Dataset.
 The data is described in a USPTO Economic Working Paper by Marco, Myers, Graham and others: https://www.uspto.gov/sites/default/files/documents/USPTO_Patents_Assignment_Dataset_WP.pdf
 ==Pre-load checks==
@@ Line 24: / Line 26: @@
 ==Getting the data==

← Older revision		Revision as of 17:30, 15 November 2017
Line 5:		Line 5:
	\|Has project status=Active		\|Has project status=Active
	}}		}}
		+
		+	This project describes the build out and basic use of the USPTO Assignment Dataset.
		+
		+	The data is described in a USPTO Economic Working Paper by Marco, Myers, Graham and others: https://www.uspto.gov/sites/default/files/documents/USPTO_Patents_Assignment_Dataset_WP.pdf
		+
		+
		+	==Pre-load checks==
		+
		+	The data is large. We don't have space on the main dbase server for it.
		+
		+	df -h
		+	/dev/nvme1n1p2 235G 208G 15G 94% /var/postgresql
		+
		+
		+	Note: To check dbase space usage on the dbase server see [[Posgres_Server_Configuration#Size.2C_Backup_.26_Restore]].
		+
		+	The postgres dbase on the RDP, however, currently has more than 300Gb free and is on a solid state drive, so its performance should be acceptable.
		+
		+	==Getting the data==