Excel Indicator: Difference between revisions

From Tygron Support wiki
Jump to navigation Jump to search
Line 442: Line 442:
==Upload an Excel file==
==Upload an Excel file==
To upload an Excel xlsx-file for the Excel Indicator, have the file ready on an easy to remember location (desktop for instance), and add in the Editor an Excel indicator to the project. Select Excel File Name on the left panel and select the Upload button on the right panel. In the newly opened panel, select the file to upload and confirm. Now the file has been uploaded to the project, and the new indicator has appeared on the top bar. If there was already a previous version of the file present, please select the [[Recalculate indicators|Recalculate Indicators]] option from the Indicators drop down menu, to ensure the newly uploaded spreadsheet has an actual impact on the project.
To upload an Excel xlsx-file for the Excel Indicator, have the file ready on an easy to remember location (desktop for instance), and add in the Editor an Excel indicator to the project. Select Excel File Name on the left panel and select the Upload button on the right panel. In the newly opened panel, select the file to upload and confirm. Now the file has been uploaded to the project, and the new indicator has appeared on the top bar. If there was already a previous version of the file present, please select the [[Recalculate indicators|Recalculate Indicators]] option from the Indicators drop down menu, to ensure the newly uploaded spreadsheet has an actual impact on the project.
 
<br>
{{Editor steps|title=upload an Excel Indicator|Select Indicators > Add Excel Indicator|Rename the newly added indicator in the 'Name' and Short Name' fields on the right panel|Select the color to be used in the progression panel|Select to activate the indicator, if desired|Add a proper description|Highlight 'Excel File Name' on the left panel panel|Select the 'Upload' button|Select the file to upload in the 'Choose your file' panel|Select Indicators > recalculate Indicators}}
{{Editor steps|title=upload an Excel Indicator|Select Indicators > Add Excel Indicator|Rename the newly added indicator in the 'Name' and Short Name' fields on the right panel|Select the color to be used in the progression panel|Select to activate the indicator, if desired|Add a proper description|Highlight 'Excel File Name' on the left panel panel|Select the 'Upload' button|Select the file to upload in the 'Choose your file' panel|Select Indicators > recalculate Indicators}}
 
<br>
<gallery mode=nolines>
<gallery mode=nolines>
File:AddExcelIndicator-Q3-2015.jpg|1. Select Indicators > Indicators > Add Excel Indicator
File:AddExcelIndicator-Q3-2015.jpg|1. Select Indicators > Indicators > Add Excel Indicator

Revision as of 10:59, 13 August 2015

Please note: This page is currently being updated.

Template:Learned

Excel Indicator

The Excel Indicator is an indicator that uses a Microsoft Excel File to perform calculations. Spatial information can be send to an uploaded Excel spreadsheet and score and explanation information is retrieved from the file to be displayed in the project main view.

Please note that the full offline version of Microsoft Excel is required and the file format used is the xlsx-format. Also, we can not guarantee that other (open source and online MS Office) packages offer the same functionality as the full offline version of Microsoft Excel, such as the naming of cells and expandable entry fields for longer cell names.

ExcelFlow2-Q3-2015.jpg


How is the Excel Indicator implemented in the Tygron Engine?

The Tygron Engine uses spatial data sets from different sources. If this data set contains information that can be retrieved with a query, a dedicated indicator in the form of an (xlsx) Excel spreadsheet can be created by the user to process this data. A change in the project state provides input to the indicator, the indicator spreadsheet performs calculations based on this input and displays the result as output in the indicator and progress panel on the top bar.

Detail from sample Indicator Excel File


To better understand the implementation of the Excel Indicator, please read the Prerequisites and Getting Started (with an example) sections below.

Prerequisites

In order for the Excel indicator to work, the spreadsheet must contain the following:

  • A cell named EXPLANATION, containing a (html-) text string or table to display the indicator output.

And either one of these two options:

  • A cell named SCORE

Or

  • Cells named SCORE_MAQUETTE and SCORE_CURRENT

The Explanation Text in the EXPLANATION cell can contain the variables %s, which will be replaced by cells named:

  • VAR_0
  • VAR_1
  • VAR_2, and so on...

If the Explanation Text contains a total of n %s variables, VAR_0 to VAR_(n-1) should be present as named cells. The first %s will be replaced by the output of the cell named VAR_0, the second %s with VAR_1, and the n %s will thus be replaced with VAR_(n-1). In other words, an EXPLANATION text containing 10 %s variables, will require cells named from VAR_0 to VAR_9.

As a rule of thumb, a cell must contain a name and/ or a value. The name can consist of a text string, such as EXPLANATION or SCORE, a variable designation (VAR_#) or a query (SELECT_UNITS_WHERE_CATEGORY_IS_SOCIAL_AND_MAP_IS_CURRENT) in order to load data from the project. Cell values can consist of actual values or text strings, a reference to the value of another cell, or formulas that return a processed value as output.

Getting Started (with an example)

This section contains a tutorial on how to create a spreadsheet that will be able to perform as an Excel Indicator in the Tygron Engine. We will go through this process step-by-step with a use case in Lower Manhattan (New York, USA) as example project, dealing with flood hazard and safe zones. The indicator will score on the amount of housing units protected, both before and after implementing flood protection measures, such as levees and barriers.

A complete Excel Workbook with this example is available to download: http://support.tygron.com/w/Downloads/examples/LM_NYC_Housing_TQL_150804-VVD-0.1.xlsx

Example Setup

First create a new blank Excel workbook/ spreadsheet. In the image below you can see a spreadsheet with Function Categories. For the Lower Manhattan use case we are interested in calculating the amount of housing units per construction type that are protected within a safe zone. In the Tygron Engine, a project, situated around Lower Manhattan, containing a Safe Zone Terrain, has already been created. This project is conveniently named "Lower Manhattan". The Safe Zone terrain of this project has been imported from ArcGIS, based on the National Flood Hazard Layer (NFHL) from the Federal Emergency Agency (FEMA).

Naming Cells

To let the spreadsheet read the amount of housing units within the Safe Zone from the project, a cell must be given a specific name. The name field is shown in the upper left corner of the spreadsheet. The name given in this example is actually a query command that can be interpreted by the Tygron Engine. Such queries use the Tygron Query Language (TQL).

In this case it says:

SELECT_UNITS_WHERE_CATEGORY_IS_SOCIAL_AND_MAP_IS_MAQUETTE_AND_TERRAINTYPE_IS_SAFE_ZONE

This query is not hard to read or understand;

Select all units > of the social (affordable) housing category > that are planned > in the protected area.

For another example, to retrieve the total amount of both protected and unprotected Affordable Housing in the area, the query reads as follows:

SELECT_UNITS_WHERE_CATEGORY_IS_SOCIAL_AND_MAP_IS_MAQUETTE

To assist in configuring these queries, a Query Tool is available in the Tygron Engine editor. This tool also aids in testing queries.

We start in a cell by creating a column of function categories, containing entries for affordable housing (SOCIAL), normal housing (NORMAL), top market housing (LUXE), SUM and SCORE. After this column we add the following columns: Total current, In safe zone current, Unprotected current, In safe zone planned, SZP (In safe zone planned)- SZC (In safe zone current), Total planned, VAR1, VAR2, VAR3, VAR4 and VAR5.

Indicator Function Category Total current In safe zone current Unprotected Current In safe zone planned SZP-SZC Total Planned VAR1 VAR2 VAR3 VAR4 VAR5
Number of housing units protected SOCIAL 0 0 0 0 0 0 0 0 0 0 0
NORMAL 0 0 0 0 0 0 0 0 0 0 0
LUXE 0 0 0 0 0 0 0 0 0 0 0
SUM 0 0 0 0 0 0 0 0 0 0 0
SCORE - - - - - - 0 0 - - -

Please note that all the zeroes refer to the default state. The above example is not uploaded to the project yet.

Total Current

The cells in this column (Column D in the example file) use the following queries to retrieve the total amount of units present per function category from the project data. Queries are entered in the Name field.
SELECT_UNITS_WHERE_CATEGORY_IS_SOCIAL_AND_MAP_IS_CURRENT
SELECT_UNITS_WHERE_CATEGORY_IS_NORMAL_AND_MAP_IS_CURRENT
SELECT_UNITS_WHERE_CATEGORY_IS_LUXE_AND_MAP_IS_CURRENT
The SUM cell contains a simple formula adding up the above cells: =SUM(D4;D5;D6)

In safe zone current (SZC)

The cells in this column (Column E in the example file) use the following queries to retrieve the amount of currently protected units per function category from the project data. Queries are entered in the Name field.
SELECT_UNITS_WHERE_CATEGORY_IS_SOCIAL_AND_MAP_IS_CURRENT_AND_TERRAINTYPE_IS_SAFE_ZONE
SELECT_UNITS_WHERE_CATEGORY_IS_NORMAL_AND_MAP_IS_CURRENT_AND_TERRAINTYPE_IS_SAFE_ZONE
SELECT_UNITS_WHERE_CATEGORY_IS_LUXE_AND_MAP_IS_CURRENT_AND_TERRAINTYPE_IS_SAFE_ZONE
The SUM cell contains a simple formula adding up the above cells: =SUM(E4;E5;E6)

Unprotected Current

The cells in this column (Column F in the example file) use the following formulas to calculate the currently unprotected units per function category. Formulas are entered in the Function field (Fx).
=SUM(D4;-E4)
=SUM(D5;-E5)
=SUM(D6;-E6)
The SUM cell contains a simple formula adding up the above cells: =SUM(F4;F5;F6)

In safe zone planned (SZP)

The cells in this column (Column G in the example file) use the following queries to retrieve the total amount of units in the planned (= MAQUETTE) Safe Zone, per function category, from the project data. Queries are entered in the Name field.
SELECT_UNITS_WHERE_CATEGORY_IS_SOCIAL_AND_MAP_IS_MAQUETTE_AND_TERRAINTYPE_IS_SAFE_ZONE
SELECT_UNITS_WHERE_CATEGORY_IS_NORMAL_AND_MAP_IS_MAQUETTE_AND_TERRAINTYPE_IS_SAFE_ZONE
SELECT_UNITS_WHERE_CATEGORY_IS_LUXE_AND_MAP_IS_MAQUETTE_AND_TERRAINTYPE_IS_SAFE_ZONE
The SUM cell contains a simple formula adding up the above cells: =SUM(G4;G5;G6)

SZP (In safe zone planned)- SZC (In safe zone current)

The cells in this column (Column H in the example file) use the below formulas (Safe Zone Planned minus Safe Zone Current) to calculate the amount of units being added to the planned Safe Zone. Formulas are entered in the Function field (Fx).
=SUM(G4;-E4)
=SUM(G5;-E5)
=SUM(G6;-E6)
The SUM cell contains a simple formula adding up the above cells: =SUM(H4;H5;H6)

Total Planned

The cells in this column (Column I in the example file) use the following queries to retrieve the total amount of planned units per function category, from the project data. If no new housing units are added to or removed from the project area, this should equal the Total current column. Queries are entered in the Name field.
SELECT_UNITS_WHERE_CATEGORY_IS_SOCIAL_AND_MAP_IS_MAQUETTE
SELECT_UNITS_WHERE_CATEGORY_IS_NORMAL_AND_MAP_IS_MAQUETTE
SELECT_UNITS_WHERE_CATEGORY_IS_LUXE_AND_MAP_IS_MAQUETTE
The SUM cell contains a simple formula adding up the above cells: =SUM(I4;I5;I6)

VAR1

This column (J in the example file) retrieves the value of the Total Current column and rounds the value up to whole numbers with the following formulas:
=ROUND(D4;0)
=ROUND(D5;0)
=ROUND(D6;0)
This value can then be retrieved by a variable %s in the EXPLANATION.
The SUM cell contains a formula rounding up the totals of the original cells: =ROUND(D7;0)

VAR2

This column (K in the example file) retrieves the value of the In Safe Zone Current column and rounds the value up to whole numbers with the following formulas:
=ROUND(E4;0)
=ROUND(E5;0)
=ROUND(E6;0)
This value can then be retrieved by a variable %s in the EXPLANATION.
The SUM cell contains a formula rounding up the totals of the original cells: =ROUND(E7;0)

VAR3

This column (L in the example file) retrieves the value of the SZP (In safe zone planned)- SZC (In safe zone current) column and rounds the value up to whole numbers with the following formulas:
=ROUND(H4;0)
=ROUND(H5;0)
=ROUND(H6;0)
This value can then be retrieved by a variable %s in the EXPLANATION.
The SUM cell contains a formula rounding up the totals of the original cells: =ROUND(H7;0)

VAR4

This column (M in the example file) retrieves the value of the In safe zone planned (SZP) column and rounds the value up to whole numbers with the following formulas:
=ROUND(G4;0)
=ROUND(G5;0)
=ROUND(G6;0)
This value can then be retrieved by a variable %s in the EXPLANATION.
The SUM cell contains a formula rounding up the totals of the original cells: =ROUND(G7;0)

VAR5

This column (N in the example file) calculates and rounds up the amount of units that remain unprotected, with the following formulas:
=ROUNDUP(D4-G4;0)
=ROUNDUP(D5-G5;0)
=ROUNDUP(D6-G6;0)
This value can then be retrieved by a variable %s in the EXPLANATION.
The SUM cell contains a formula rounding up the totals of the original cells: =ROUNDUP(D7-G7;0)

SCORE

These cells can contain different formulas, depending on the project type (timeline or planning). In general the score is a percentage of the scoring value on as a fraction of the total value.
SCORE_CURRENT: =E7/IF(D7;D7;1) = In safe zone current (SZC)/ Total Current (if Total Current > 0, with one decimal significance)
SCORE_MAQUETTE: =G7/IF(I7;I7;1) = In safe zone planned (SZP)/ Total Plannend (if Total Planned > 0, with one decimal significance)

Editing Named Cells

The naming of cells should be done carefully, because any mistake here will result in an error during the calculation of the Excel Indicator. Once a cell has been labelled with a name, the Microsoft Excel Name Manager must be used to edit or remove the name of the cell. The Name Manager can be opened as follows; select Formulas > Defined Names > Name Manager.

On the Excel Name Manager panel you can find all defined names in the workbook and to what cells these names refer. If you want to edit a cell name, highlight it and select the Edit Button. The following panel will then appear:

Edit Cell Name


To delete a cell name, highlight the entry and select Delete. A message will ask for confirmation.

Delete Confirmation Message


You can even select multiple entries at once, by pressing the Shift key when selecting. This can be very convenient when rearranging all VAR_# entries for instance.

ExcelNameManagerMultiSelect-Q3-2015.jpg


Fixing Name Problems

In the Name Manager panel you can edit both the name as well as the cell it refers to. This is the easiest way to correct a naming issue. It is possible to (incorrectly) refer two or more labels to the same cell, as the image below shows. In this example both a MAQUETTE and a CURRENT query are referring to the same cell. One will override the other and the order is unpredictable. Please make sure to resolve these issues first. You can delete the name, or let it refer to another cell.

Errors in cell naming


Indicator Scores

To be able to generate scores from the Excel indicator, there needs to be either one cell named SCORE, or two cells named SCORE_CURRENT and SCORE_MAQUETTE. In Planning Games, only SCORE (or SCORE_MAQUETTE) are used. In Time Line games both SCORE_MAQUETTE and SCORE_CURRENT queries are used to indicate the difference between the planned outcome and the current situation respectively.

SCORE output


Explanation

Last but not least is the explanation. This is the text shown in the lower left corner of the Indicator panel during a session. The explanation text can be written in html format. The cell should be named EXPLANATION. When using explanation texts, you may also want to include numbers and/ or text output from your excel. For this you can include %s values, which will be replaced by VAR_# cells, starting from VAR_0. See also #Prerequisites.

Explanation field on Indicator Panel


Simple text string as EXPLANATION output

A simple HTML text string as EXPLANATION output can be written as follows:

<p>SOCIAL:%s units total, of which %s are currently protected, %s are planned to be protected, protecting a total of %s units, leaving %s units unprotected</p>

In this string, values from cells named VAR_0 to VAR_4 are being used to output values in the explanation text.

Combining three strings with only a change in category names will cover VAR_0 to VAR_18 and results in the following:

<p>SOCIAL:%s units total, of which %s are currently protected, %s are planned to be protected, protecting a total of %s units, leaving %s units unprotected</p>
<p>NORMAL:%s units total, of which %s are currently protected, %s are planned to be protected, protecting a total of %s units, leaving %s units unprotected</p>
<p>LUXE:%s units total, of which %s are currently protected, %s are planned to be protected, protecting a total of %s units, leaving %s units unprotected</p>

Which looks on the Excel Indicator panel in the project main view like this:

Text string as EXPLANATION


HTML table as EXPLANATION output

As the above shows, with many VAR_# variables and categories present, the EXPLANATION field tends to lack clarity. To improve readability of the EXPLANATION output, it is recommended to implement a table format. This can be done by using personal HTML skills, however, as this can be a bit too advanced for general users, we recommend using an HTML table generator, such as: http://www.tablesgenerator.com/html_tables#.

Following steps on this page will result in an HTML based table that can be copied onto the EXPLANATION cell in the spreadsheet and then loaded into the Tygron Engine.

Such a table will look like this in HTML:

"<style type=""text/css"">
.tg  {border-collapse:collapse;border-spacing:0;}
.tg td{font-family:Arial, sans-serif;font-size:14px;padding:10px 5px;border-style:solid;border-width:1px;overflow:hidden;word-break:normal;}
.tg th{font-family:Arial, sans-serif;font-size:14px;font-weight:normal;padding:10px 5px;border-style:solid;border-width:1px;overflow:hidden;word-break:normal;}
.tg .tg-0ord{text-align:right}
.tg .tg-s6z2{text-align:center}
</style>
<table class=""tg"">
  <tr>
    <th class=""tg-0ord"">Housing Units</th>
    <th class=""tg-s6z2"">Affordable Housing<br></th>
    <th class=""tg-s6z2"">Market Housing<br></th>
    <th class=""tg-s6z2"">Top Market Housing<br></th>
    <th class=""tg-s6z2"">Totals<br></th>
  </tr>
  <tr>
    <td class=""tg-0ord"">Total present</td>
    <td class=""tg-s6z2"">%s units<br></td>
    <td class=""tg-s6z2"">%s units</td>
    <td class=""tg-s6z2"">%s units</td>
    <td class=""tg-s6z2"">%s units</td>
  </tr>
  <tr>
    <td class=""tg-0ord"">Already protected</td>
    <td class=""tg-s6z2"">%s units</td>
    <td class=""tg-s6z2"">%s units</td>
    <td class=""tg-s6z2"">%s units</td>
    <td class=""tg-s6z2"">%s units</td>
  </tr>
  <tr>
    <td class=""tg-0ord"">To be added to protected area</td>
    <td class=""tg-s6z2"">%s units</td>
    <td class=""tg-s6z2"">%s units</td>
    <td class=""tg-s6z2"">%s units</td>
    <td class=""tg-s6z2"">%s units</td>
  </tr>
  <tr>
    <td class=""tg-0ord"">Total Protected<br></td>
    <td class=""tg-s6z2"">%s units</td>
    <td class=""tg-s6z2"">%s units</td>
    <td class=""tg-s6z2"">%s units</td>
    <td class=""tg-s6z2"">%s units</td>
  </tr>
  <tr>
    <td class=""tg-0ord"">Remaining unprotected</td>
    <td class=""tg-s6z2"">%s units</td>
    <td class=""tg-s6z2"">%s units</td>
    <td class=""tg-s6z2"">%s units</td>
    <td class=""tg-s6z2"">%s units</td>
  </tr>
</table>"

This will result in the following table:

Housing Units Affordable Housing Market Housing Top Market Housing Totals
Total present %s units %s units %s units %s units
Already protected %s units %s units %s units %s units
To be added to protected area %s units %s units %s units %s units
Total Protected %s units %s units %s units %s units
Remaining unprotected %s units %s units %s units %s units
HTML table as EXPLANATION


Summary (how to...)

Below is a small summary describing a suggested workflow from a bird's eye perspective, without going deeper into details:
How to create an Excel Indicator:
  1. Load the sample project Lower Manhattan in the editor.
  2. Create an empty xlsx workbook.
  3. Name one cell EXPLANATION.
  4. Create the EXPLANATION output format (HTML text string, HTML table) with %s variables.
  5. Decide, based on the EXPLANATION, which function categories are needed, and place them in one column.
  6. Add consecutive columns that match the EXPLANATION.
  7. Create the VAR columns with ROUND(UP) formulas and VAR_n name labels.
  8. Create the SCORE field(s) as required by the type of project (Timeline/ Planning).
  9. Optionally, test the spreadsheet by entering round values in query fields.
  10. Create a new Excel Indicator in the project and upload the Excel file to the project.
  11. Recalculate the indicators and verify if no errors are present.

Tips

  • Divisions by zero can be solved as follows: =C2/IF(D2,D2,1). In this example cells C2 and D2 contain number values.
  • Instead of using the VAR_# method for the explanation text, you can also use the concatenate function of excel:

CONCATENATE("<p>",A2, ": ", E2, " m2 and in Safe Zone: ", F2, " m2</p>")

  • Starting with creating a table aids in setting up the Excel spreadsheet, by already thinking in advance about the lay out and formatting of the EXPLANATION.
  • To quickly test the spreadsheet, without uploading it to the project, it is possible to enter some values in all the cells that contain queries as name. Other cells with formulas will change their content accordingly. By entering round values, for example 100, 1000, etc, calculations can easily be verified. Don't forget to save first and to revert back to the last saved version when done verifying!

Upload an Excel file

To upload an Excel xlsx-file for the Excel Indicator, have the file ready on an easy to remember location (desktop for instance), and add in the Editor an Excel indicator to the project. Select Excel File Name on the left panel and select the Upload button on the right panel. In the newly opened panel, select the file to upload and confirm. Now the file has been uploaded to the project, and the new indicator has appeared on the top bar. If there was already a previous version of the file present, please select the Recalculate Indicators option from the Indicators drop down menu, to ensure the newly uploaded spreadsheet has an actual impact on the project.

How to upload an Excel Indicator:
  1. Select Indicators > Add Excel Indicator
  2. Rename the newly added indicator in the 'Name' and Short Name' fields on the right panel
  3. Select the color to be used in the progression panel
  4. Select to activate the indicator, if desired
  5. Add a proper description
  6. Highlight 'Excel File Name' on the left panel panel
  7. Select the 'Upload' button
  8. Select the file to upload in the 'Choose your file' panel
  9. Select Indicators > recalculate Indicators