Difference between revisions of "Moroccan Parliament Web Crawler"

From edegan.com
Jump to navigation Jump to search
(Created page with "{{McNair Projects |Project Title=Moroccan Parliament Web Crawler, |Owner=Peter Jalbert, |Start Term=9/27/2016, |Status=Active }} ==Overview== This web crawler is designed t...")
 
Line 1: Line 1:
 
{{McNair Projects
 
{{McNair Projects
|Project Title=Moroccan Parliament Web Crawler,
+
|Project Title=Moroccan Parliament Web Drivewr,
 
|Owner=Peter Jalbert,
 
|Owner=Peter Jalbert,
 
|Start Term=9/27/2016,
 
|Start Term=9/27/2016,
Line 7: Line 7:
 
==Overview==
 
==Overview==
  
This web crawler is designed to save information from the Moroccan Legislature website as a pdf before the information is removed from the website due to lack of space.
+
This web driver is designed to save information from the Moroccan Legislature website as a pdf before the information is removed from the website due to lack of space.
 +
 
 +
===Navigating the Site===
 +
On the right hand side of the website, the final bullet is a link to archived bills.
 +
 
 +
On the right hand side of the website, one bullet above the last header, is a link to links of all the proposed bills. When clicked, the user is directed to the most recent batch of links of proposed bills. The movement button on the bottom left in arabic means, "go to last page", and the second from the left means "previous page". When "go to last page" is clicked, the batch of links to proposed bills that are about to be removed from the website are listed with the oldest link at the bottom of the list.
 +
 
 +
When any proposed bill link is clicked, it opens up a page with information about the bill, and about discussions in parliament. There are up to two hyperlinks on this page, the first of which is a pdf of the original bill. If there is a second link further below, it contains a pdf of the Committee Report for the bill (if it was sent to a Committee).
 +
 
 +
The two pdfs, as well as the webpage of the proposed bill may be subject to record keeping.
 +
 
  
 
[http://www.chambredesrepresentants.ma/ar/%D8%A7%D9%84%D8%AA%D8%B4%D8%B1%D9%8A%D8%B9/%D9%84%D8%A7%D8%A6%D8%AD%D8%A9-%D9%85%D9%82%D8%AA%D8%B1%D8%AD%D8%A7%D8%AA-%D8%A7%D9%84%D9%82%D9%88%D8%A7%D9%86%D9%8A%D9%86?body_value=&field_og_commission_target_id=All&page=11]
 
[http://www.chambredesrepresentants.ma/ar/%D8%A7%D9%84%D8%AA%D8%B4%D8%B1%D9%8A%D8%B9/%D9%84%D8%A7%D8%A6%D8%AD%D8%A9-%D9%85%D9%82%D8%AA%D8%B1%D8%AD%D8%A7%D8%AA-%D8%A7%D9%84%D9%82%D9%88%D8%A7%D9%86%D9%8A%D9%86?body_value=&field_og_commission_target_id=All&page=11]
  
==Possible Crawling Opportunities==
+
==Driving Opportunities==
 +
 
 +
Five websites within the Moroccan Legislature site have data that needs to be recorded.
 +
 
 +
===Moroccan Monarchy Proposed Bills===
 +
 
 +
[http://www.chambredesrepresentants.ma/ar/%D8%A7%D9%84%D8%AA%D8%B4%D8%B1%D9%8A%D8%B9/%D9%85%D8%B4%D8%A7%D8%B1%D9%8A%D8%B9-%D8%A7%D9%84%D9%82%D9%88%D8%A7%D9%86%D9%8A%D9%86]
 +
 
 +
===Moroccan House of Representatives Proposed Bills===
 +
 
 +
[http://www.chambredesrepresentants.ma/ar/%D8%A7%D9%84%D8%AA%D8%B4%D8%B1%D9%8A%D8%B9/%D9%84%D8%A7%D8%A6%D8%AD%D8%A9-%D9%85%D9%82%D8%AA%D8%B1%D8%AD%D8%A7%D8%AA-%D8%A7%D9%84%D9%82%D9%88%D8%A7%D9%86%D9%8A%D9%86]
 +
 
 +
===Moroccan Legislature Ratified Bills===
 +
 
 +
[http://www.chambredesrepresentants.ma/ar/%D8%A7%D9%84%D8%AA%D8%B4%D8%B1%D9%8A%D8%B9/%D8%A7%D9%84%D9%86%D8%B5%D9%88%D8%B5-%D8%A7%D9%84%D8%AA%D9%8A-%D8%B5%D8%A7%D8%AF%D9%82-%D8%B9%D9%84%D9%8A%D9%87%D8%A7-%D9%85%D8%AC%D9%84%D8%B3-%D8%A7%D9%84%D9%86%D9%88%D8%A7%D8%A8?field_legislature_tid=All&field_nature_loi_tid=All&page=27]
 +
 
 +
===Moroccan Legislature Oral Questions===
 +
 
 +
[http://www.chambredesrepresentants.ma/ar/%D9%85%D8%B1%D8%A7%D9%82%D8%A8%D8%A9-%D8%A7%D9%84%D8%B9%D9%85%D9%84-%D8%A7%D9%84%D8%AD%D9%83%D9%88%D9%85%D9%8A/%D8%A7%D9%84%D8%A3%D8%B3%D9%80%D8%A6%D9%84%D8%A9-%D8%A7%D9%84%D8%B4%D9%81%D9%88%D9%8A%D8%A9?field_ministeres_tid=All&field_groupe_concerne_target_id=All&field_parlementaires_associes_target_id=All&body_value=&field_transfere_ou_non_value=All]
 +
 
 +
===Moroccan Legislature Written Questions===
 +
 
 +
[http://www.chambredesrepresentants.ma/ar/%D8%A7%D9%84%D8%A3%D8%B3%D9%80%D8%A6%D9%84%D8%A9-%D8%A7%D9%84%D9%83%D8%AA%D8%A7%D8%A8%D9%8A%D8%A9]
 +
 
 +
===Further Inquiries===
 +
 
 +
Further inquiries have been requested for the Kuwait, Tunisian, and Algerian Parliaments.
 +
 
 +
==Kuwait Parliament==
 +
 
 +
[http://search.kna.kw/web/Retrieval/Home.aspx]
 +
 
 +
Data to download (Tables and PDF files):
 +
    Monarchy - Proposed Bills (مشروع بقانون); For 13th and 14th terms.
 +
    Parliament - Proposed Bills (اقتراح بقانون); for 14th term:
 +
    Proposals (اقتراح بــرغــبـــة): For 13th term and 14th terms
 +
    Meeting Agendas/Minutes (جدول اعمال الجلسه); for 14th term
 +
 
 +
==Tunisian Parliament==
 +
 
 +
[http://arp.tn/site/main/AR/index.jsp]
 +
 
 +
Data to Download(save web pages as PDFs and documents as PDFs):
 +
 
 +
Bills proposed to parliament(مشروع قانون معروض على المجلس): [http://arp.tn/site/projet/AR/index.jsp?c_t=17&prof=5]
 +
Bills proposed to legislative committees (مشروع قانون معروض على اللجان): [http://arp.tn/site/projet/AR/index.jsp?c_t=39&prof=6]
 +
General Assembly Deliberations (الجلسات العامة): [http://arp.tn/site/debat/AR/res.jsp?numscreen=31]
  
  
===Archived Bills===
 
On the right hand side of the website, the final bullet is a link to archived bills.
 
  
===Proposed Bills===
+
==Algerian Parliament==
On the right hand side of the website, one bullet above the last header, is a link to links of all the proposed bills. When clicked, the user is directed to the most recent batch of links of proposed bills. The movement button on the bottom left in arabic means, "go to last page", and the second from the left means "previous page". When "go to last page" is clicked, the batch of links to proposed bills that are about to be removed from the website are listed with the oldest link at the bottom of the list.
 
  
When any proposed bill link is clicked, it opens up a page with information about the bill, and about discussions in parliament. There are up to two hyperlinks on this page, the first of which is a pdf of the original bill. If there is a second link further below, it contains a pdf of the Committee Report for the bill (if it was sent to a Committee).  
+
[http://www.apn.dz/ar/]
  
The two pdfs, as well as the webpage of the proposed bill may be subject to record keeping.
+
Data to download:
 +
Bills that have been voted on (القوانين المصوت عليها الفترة التشريعية السابعة : 2012 - 2017): [http://www.apn.dz/ar/textes-de-lois-ar/lois-adoptees-ar/219-lois-adoptees-ar-2012-2017]
 +
Parliamentary initiatives/questions (المبادرات البرلمانية): [http://www.apn.dz/ar/initiatives-parlementaires-ar?start=40]

Revision as of 14:23, 13 October 2016


McNair Project
Moroccan Parliament Web Crawler
Project logo 02.png
Project Information
Project Title
Start Date
Deadline
Primary Billing
Notes
Has project status
Copyright © 2016 edegan.com. All Rights Reserved.


Overview

This web driver is designed to save information from the Moroccan Legislature website as a pdf before the information is removed from the website due to lack of space.

Navigating the Site

On the right hand side of the website, the final bullet is a link to archived bills.

On the right hand side of the website, one bullet above the last header, is a link to links of all the proposed bills. When clicked, the user is directed to the most recent batch of links of proposed bills. The movement button on the bottom left in arabic means, "go to last page", and the second from the left means "previous page". When "go to last page" is clicked, the batch of links to proposed bills that are about to be removed from the website are listed with the oldest link at the bottom of the list.

When any proposed bill link is clicked, it opens up a page with information about the bill, and about discussions in parliament. There are up to two hyperlinks on this page, the first of which is a pdf of the original bill. If there is a second link further below, it contains a pdf of the Committee Report for the bill (if it was sent to a Committee).

The two pdfs, as well as the webpage of the proposed bill may be subject to record keeping.


[1]

Driving Opportunities

Five websites within the Moroccan Legislature site have data that needs to be recorded.

Moroccan Monarchy Proposed Bills

[2]

Moroccan House of Representatives Proposed Bills

[3]

Moroccan Legislature Ratified Bills

[4]

Moroccan Legislature Oral Questions

[5]

Moroccan Legislature Written Questions

[6]

Further Inquiries

Further inquiries have been requested for the Kuwait, Tunisian, and Algerian Parliaments.

Kuwait Parliament

[7]

Data to download (Tables and PDF files):

   Monarchy - Proposed Bills (مشروع بقانون); For 13th and 14th terms.
   Parliament - Proposed Bills (اقتراح بقانون); for 14th term: 
   Proposals (اقتراح بــرغــبـــة): For 13th term and 14th terms
   Meeting Agendas/Minutes (جدول اعمال الجلسه); for 14th term

Tunisian Parliament

[8]

Data to Download(save web pages as PDFs and documents as PDFs):

Bills proposed to parliament(مشروع قانون معروض على المجلس): [9] Bills proposed to legislative committees (مشروع قانون معروض على اللجان): [10] General Assembly Deliberations (الجلسات العامة): [11]


Algerian Parliament

[12]

Data to download: Bills that have been voted on (القوانين المصوت عليها الفترة التشريعية السابعة : 2012 - 2017): [13] Parliamentary initiatives/questions (المبادرات البرلمانية): [14]