Inference Overlay: Difference between revisions

From Tygron Preview Support Wiki
Jump to navigation Jump to search
Maxim@tygron.com (talk | contribs)
No edit summary
Tag: Reverted
Maxim@tygron.com (talk | contribs)
Undo revision 63569 by Maxim@tygron.com (talk)
Tag: Undo
 
(3 intermediate revisions by the same user not shown)
Line 5: Line 5:


It is not possible to run the convolution network on the grid as a whole. Therefore, a marching window strategy is applied instead, where the window is moved over the input grid with a [[Stride fraction (Inference Overlay)|configurable stride]]. This window takes the input values of one or more grids and puts these into tensors representing either floating point values or color channels (red, green and blue). Depending on the dataset used to train the neural network, the tensor values are normalized based on a particular value range. For example, a relative height input tensor for a foliage neural network trained on height data can be normalized using a range of 0 to 40 meters, when 40 meters is considered the largest tree height in the Netherlands.
It is not possible to run the convolution network on the grid as a whole. Therefore, a marching window strategy is applied instead, where the window is moved over the input grid with a [[Stride fraction (Inference Overlay)|configurable stride]]. This window takes the input values of one or more grids and puts these into tensors representing either floating point values or color channels (red, green and blue). Depending on the dataset used to train the neural network, the tensor values are normalized based on a particular value range. For example, a relative height input tensor for a foliage neural network trained on height data can be normalized using a range of 0 to 40 meters, when 40 meters is considered the largest tree height in the Netherlands.
The {{software}} contains several trained models, such as the foliage example explained below. However it is also possible to train your own model with the [[AI Suite]].


==Foliage Example==
==Foliage Example==
Line 22: Line 20:
{{article end
{{article end
|seealso=
|seealso=
* [[AI Suite|AI Suite (for more information on training your own model)]]
* [[Model attributes (Inference Overlay)]]
* [[Model attributes (Inference Overlay)]]
* [[Neural Network]]
* [[Neural Network]]
Line 34: Line 31:
* [[How to detect solar panels using an Inference Overlay]]
* [[How to detect solar panels using an Inference Overlay]]
* [[How to create the input overlay for leafless trees detection using the Inference Overlay]]
* [[How to create the input overlay for leafless trees detection using the Inference Overlay]]
* [[How to train your own AI model for an Inference Overlay]]
* [[How to select specific input data for AI Inference]]
* [[How to select specific input data for AI Inference]]
* [[How to evaluate an AI model]]
* [[How to create AI train data with QGIS]]
}}
}}
{{InferenceOverlay nav}}
{{InferenceOverlay nav}}
{{Overlay nav}}
{{Overlay nav}}

Latest revision as of 15:09, 17 October 2025

Trees detected with Inference Overlay.

The AI Inference Overlay is a Grid Overlay which can spatially identify features using one or more Prequel Grids. Features are identified using a Convolution Neural Network that used a limited amount of proposal regions (RCNN). This Neural Network takes a subsection (window) of the input grid and either;

It is not possible to run the convolution network on the grid as a whole. Therefore, a marching window strategy is applied instead, where the window is moved over the input grid with a configurable stride. This window takes the input values of one or more grids and puts these into tensors representing either floating point values or color channels (red, green and blue). Depending on the dataset used to train the neural network, the tensor values are normalized based on a particular value range. For example, a relative height input tensor for a foliage neural network trained on height data can be normalized using a range of 0 to 40 meters, when 40 meters is considered the largest tree height in the Netherlands.

Foliage Example

Animation of inference with a moving window and Bounding Box detection and a stride fraction of 0.5.

Using a Satellite Overlay of 0.25m detail, foliage features can be identified using an Inference Overlay and enhanced with a Digital Terrain Model Overlay (DTM), a WCS Overlay representing the DSM, Combo Overlay to combine these and an optionally an iterative Max Overlay to enhance the foliage height. For more information, see this how-to.