ICT705 Data and System Integration

Task:

Task 1.1 Remove non-printable characters

The Fire_Stations.csv file contains non-printable Unicode characters, in order to perform other  cleansing tasks and merging of data you’ll first need to clean these characters from the data.

Note: You have been provided with a file “Fire_Stations (ASCII).csv”, if you are unable to complete this task you may use this file to complete remaining tasks.

Task 1.2 Create E-Mail

An email address for each station needs to be constructed from its name: e.g. the address for Acacia Ridge Fire Station will be [email protected]

Task 1.3 Merge Data

You are to merge data from the three sources into “Fire_Station_Locations.csv” with fields.

Task 1.4 Correct Field Names

Ensure your field names match the fields - Field Mapping .

Task 1.5 Correct Field Order

Ensure the order of fields matches the order- Field Mapping

Task 1.6 Sort Data

Data must be sorted firstly on “RegionID” and then on “Station Number”

Note: Should you be unable to fully complete the above tasks, you have been supplied with a file “Fire_Station_Locations (Solution).csv” that you can use for Task 2.

Task 1.7 Clean and Separate Street Address (Optional 10 Bonus Marks)

Separate data in the Address field into: “Street Address”, “Suburb” & “Post Code” fields.

Create a “State” field with a value of “Qld” for each record

Replace abbreviations for street type (eg. Rd is used instead of Road, Crt instead of Court) 

Task 2 – RESTful Web Service Demo

You are to submit a python script named “data_services.py”.

For tasks 2.1 to 2.2 Your script should build a RESTful web service that supports a ‘getstations’ query from the client browser similar to “/getstations?regionid=x”. The server Web Service will return a JSON table with the following fields (attributes): Station Number, Station Name, Street Address, Phone Number, Email, Lat, Lon. Data is to come from the “Fire_Station_Locations.csv” you built in task 1 (or, “Fire_Station_Locations (Solution).csv” if you were unable to fully complete task 1).

Task 2.1 Return stations for a region 

The server will return a table of records (tuples) of fire stations in the region passed to it.

Task 2.2 Return all fire station

In the advent of a call to “getstations?regionid=0”, the server will return a list of all fire stations.

Task 2.3 List of Regions

To populate your drop-down list in task 3.1 you will need to return a JSON table of all records from “Station_Regions.csv” with the following fields (attributes): RegionID, Region Name. The server should respond to a “getregions” request.

Task 3 Mashup Demo

You are to submit a HTML file “stations_map.html” and optionally a CSS file named “stations_map.css”. For ease of marking all JavaScript must be contained in your HTML file.

Task 3.1 Form Layout 

You are to create an input form that accepts user input for a station region. The input for the station region should be a drop-down list with the first item being “All Regions” with a value = 0 remaining items should be created dynamically from a call to getregions from task

2.3. This input should be accompanied with a “Display Stations” button and appropriate descriptors / information on the operation of the web page.

Task 3.2 Google Map

Clicking the “Display Stations” button will trigger a “getstations” web service to retrieve a table of stations matching the region with attributes described in task 2. From this data you are to display a Google map marking the position of the returned stations.

Task 3.3 Label Markers

Markers on the map should be labelled with the “Station Number” 

Task 3.4 Centred & Zoomed

The map should be centred on the region and zoomed to an appropriate level to show all fire stations in the region selected.

Task 3.5 Information Window Demographics

Upon clicking a marker bubble on the map, the user will be displayed an information  window containing: Station, Address, Phone and a clickable email address. 

Task 3.6 Information window email 

Clicking an email address link in the information window should launch the user’s email application and automatically insert the subject line “Enquiry”

Deliverable 2 - Report

You are required to write a report explaining the key concepts around the design and implementation of your demonstration system. You are also required to explain how to run your code.

Data Merging and Cleaning 

Provide a scholarly definition of data merging and data cleaning. What issues did you face and how did you deal with these? What recommendations do you have for QFES regarding data integration and why?

2.2 RESTful Web Services

Provide a scholarly definition of REST.

How was REST incorporated in your demo?

What problems can you identify with the design of your demo?

2.3 Mashups

Provide a scholarly definition of Mashups.

How were mashups incorporated into your demo?

How could you improve the system to provide a more efficient mashup?

3.0 Demo Running Instructions

Given your client QFES has limited technical knowledge, you are to provide instructions for getting the ZIP file you supplied (the one you uploaded to BlackBoard) up and running. You should presume that they have a new workstation with a clean installation of Windows to test your demo.