Confidence intervals
null
Technology
28/09/2023
by
Damien Raynaud
7 min
null
null
Confidence intervals are an essential source of information in weather forecasting. In particular, they make it possible to objectively quantify the uncertainty associated with a forecast. Here we define confidence intervals, describe how they are generated and illustrate their possible uses. Before going any further, we recommend that you read our article about weather forecasting at the following link. Some concepts and notions will be repeated here without being explained again.
null
null
Deterministic and probabilistic forecasts
The adjective deterministic refers to a weather forecast for which only a single scenario is available, i.e. a single simulation from a single numerical weather prediction model. In this case, it is impossible to determine the confidence in the forecast. This situation can potentially lead to large errors, especially for distant forecast timescales or for meteorological phenomena whose occurrence and location are particularly difficult to predict. To overcome this limitation, it is possible to use ensemble forecasting, which propose a whole set of scenarios and allows us to deduce the most accurate evolution of the atmospheric state.
There are several ways of generating this set of scenarios:
- Multi-model: Every National Meteorological and Hydrological Services (NMHS) in the world has its own numerical weather prediction model. They all provide different forecasts, which are as many possible scenarios.
- Multi-member: We saw in our previous article about weather forecasting that it was possible to take advantage of the chaotic nature of the atmosphere and the uncertainty about the initial state provided by the model. Here, a set of forecasts is generated from a set of equiprobable initial states.
- Multi-run: Most operational numerical weather prediction models generate a forecast every 3 to 6 hours. Even if the most recent forecast is statistically more likely to be the most accurate, it can be useful to take into account the one or two previous forecasts.
- Spatio-temporal radius: For certain meteorological variables for which location and timing are difficult to establish (e.g. precipitation), it can be interesting to use not only the model grid point and time step of interest, but also surrounding points and previous and following time steps.
null
null
From ensemble forecasting to quantiles and confidence intervals
Now let's imagine that we have at our disposal a very rich set of forecasts providing 100 scenarios of temperature forecasts at our point of interest. How do we process and take advantage of this data volume? Statistics!
For each time step, we will first sort our forecast temperature values in ascending order. We can then easily deduce quantiles. These divide our dataset into equiprobable intervals. For example, the 10% quantile (P10), is the expected temperature value such that 10% of our set is lower and 90% is higher. The 50% quantile (P50), also known as the median, is the temperature forecast such that 50% of our set is lower and 50% is higher. Quantiles provide essential information about the statistical distribution of our set, and therefore about the confidence we can have in the forecast. For example, if our set gives a median value of 25°C, a P10 quantile of 24°C and a P90 of 27°C, this means that the set is relatively homogeneous and that we have an 80% chance of having a temperature between 24°C and 27°C. On the other hand, if for the same median value of 25°C, the P10 and P90 quantiles are 17°C and 30°C respectively, this means that the different scenarios are widely dispersed and that the forecast is uncertain.
Example of precipitation forecasts using quantiles.
null
null
null
Example of temperature forecasts using quantiles.
null
Case study: Frost risk in agriculture
Frost is one of the hazards most feared by farmers. The impact of frost on vineyards and orchards can be devastating if it occurs at flowering time, leading to a reduction or even total loss of harvests.
Producers invest a great deal of time, energy and financial resources in protecting their land against this hazard. There are several ways to protect against frost:
- Sprinkling, which consists of irrigating parcels and covering buds with a layer of ice to keep them at a temperature close to 0°C.
- Atmospheric warming using burners or heating wires.
- Air ventilation with anti-freeze towers (also known as air blowers or helicopters) to prevent the accumulation of cold air in the lower meters of the atmosphere.
All these techniques are very costly, and it is essential to use high-quality meteorological measurements and forecasts to :
- Activate them when there is a risk of frost and avoid crop loss.
- Limit false alarms and thus avoid the costs associated with them.
We propose here to use a simplified case to illustrate the contribution of quantiles in a temperature forecast for the activation of means to combat crop frost.
Let's take the following temperature forecast for the next 48 hours for our point of interest. We assume that farmers will activate their frost protection measures in the event of a forecast indicating a temperature below 0°C. In the first case, we only have a deterministic forecast (red), which does not indicate that the 0°C trigger threshold will be exceeded. Unfortunately, the temperature drops to -2°C on the second night, causing crop damage.
null
null
null
In the second case, we also have two quantiles, P20 and P80, to quantify the confidence in our forecast. On the first night, the P20 quantile also remains above 0°C, so it seems certain that the temperature will remain positive. However, the uncertainty is higher for the second night, and the risk of frost becomes significant. Thanks to this information, the farmer will have been able to avoid activating his preventive equipment unnecessarily on the first night, but will have protected his crops well on the second night!
null
null
null
null
null
null
null
null
null
null
null
null
null
null
null
null
null
null
null
null
null
null
null
null
null
Start for free!
null
null
null
null
null
null
