Get to know the Accuracy and Reliability of Our Vilhelm Weather Prediction Model

Vilhelm model by Jua:
Dive into the Benchmarks!

Temperature 2 meters above ground

We've assessed how well two weather forecasting systems - the IFS model by ECMWF and the Vilhelm model by Jua - perform when it comes to predicting air temperatures 2 meters above the ground.

When we evaluate using Mean Bias Error (MBE), the Jua model surpasses the IFS model for the initial 48 hours.

This suggests that the Jua model is more effective at reducing consistent forecasting errors. This is a crucial discovery since these systematic errors can impact the long-term reliability of weather predictions.

Vilhelm model consistently beats the IFS model in accuracy for the first 48 hours, as measured by the Root Mean Square Error (RMSE).

Remarkably, up to the 30-hour mark, the RMSE is even lower by 1 Kelvin. This represents a substantial 13% improvement over the IFS model. So, in short-term forecasts, it's clear that the Vilhelm model is more precise in predicting air temperatures.

Looking at the Kling-Gupta Efficiency (KGE) scores, the Vilhelm model also surpasses the IFS model for the first 48 hours.

This shows that Vilhelm excels at accurately reflecting the statistical patterns and relationships between the actual observations and the forecasted values.

Our analysis indicates that the Vilhelm model has an edge over the IFS model by ECMWF. Specifically, when it comes to accurately and reliably predicting air temperatures 2 meters above the ground in the short-term forecasts, Vilhelm consistently delivers superior performance.

New York with and without Jua

Total Precipitation

We've compared the abilities of two weather forecasting systems - ECMWF's IFS and Vilhelm - to accurately predict rainfall events. We specifically focused on whether or not rain will occur (a binary precipitation forecast) and used various measurement techniques to evaluate their performance.

Jua's Vilhelm delivers the same accuracy at 54 hours that the IFS delivers at 12 hours.

Comparison between Vilhelm and IFS Total Precipitation forecasts - 2018

The Jua precipitation model outshines the IFS model when it comes to predicting total rainfall more than two days in advance. It's significantly more accurate and reliable.

When it comes to 'nowcasting' - which is essentially very short-term weather forecasting - the Jua model once again performs much better than the IFS model.

Interestingly, both models show their best performance when predicting weather conditions over land surfaces.

The analysis reveals that Jua's precipitation model consistently outperforms the IFS model in several areas. It has notably superior performance in predicting total rainfall more than two days in advance and excels in nowcasting, or very short-term forecasting. Both models, do show their best performance when forecasting weather conditions over land surfaces.

New York with and without Jua

Wind Speed - 10 m above the ground

Parameter being tested is Wind for v10 and u10, which are the north and east components of the wind, respectively, 10 meters above the ground. This parameter includes both wind direction and wind speed.

u10

v10

In terms of MBE, the Jua model outperforms the IFS model until the 48th hour,

suggesting that it is better at eliminating systematic errors in the forecasts. This is an important finding, as systematic errors can affect the reliability of weather forecasts over time.

Based on the results of the analysis, the Vilhelm model slightly outperforms the IFS model until the 24th hour,

with only 1 m/s error in wind speed and direction. The RMSE values for both models match until the 36th hour, indicating that they have similar accuracy in predicting wind conditions until then.

The KGE results also show that the Vilhelm model outperforms the IFS model up to the 48th hour,

indicating that it is better at reproducing statistical moments and correlations between the observed and forecasted values.

Our analysis shows that the Vilhelm model, has a slight advantage over the IFS model by ECMWF. When it comes to accurately and reliably predicting wind speed and direction 10 meters above the ground in short-term forecasts, the Vilhelm model comes out a bit ahead.

Wind Speed - 1000 hPa layer

In this study, we're focusing on wind characteristics at the 1000 hPa atmospheric layer. Specifically, we're examining the meridional (north-south) and zonal (east-west) wind components, known as v1000 and u1000 respectively. These factors give us both the direction and speed of the wind at this specific layer.

u10

v10

When we look at the Mean Bias Error (MBE), the Jua model surpasses the IFS model for the first 48 hours.

This suggests that Jua is more efficient in reducing consistent forecasting errors. This finding is significant as these systematic errors can impact the long-term dependability of weather predictions.

Vilhelm model consistently outdoes the IFS model in the first 48 hours when we measure their performance with the Root Mean Square Error (RMSE).

Impressively, for the initial 30 hours, Vilhelm's RMSE is even lower by 1 Kelvin - a significant 13% improvement over the IFS model. This suggests that, at least in the short term, Vilhelm is more precise in predicting air temperatures.

Vilhelm model has a slight edge over the IFS model for the first 24 hours.

Interestingly, both models have matching Root Mean Square Error (RMSE) values up to the 36-hour mark. This suggests that when it comes to predicting wind conditions, both models offer similar accuracy up to that point.

When we assess the models using the Kling-Gupta Efficiency (KGE) scores, the Vilhelm model shines brighter than the IFS model for the initial 48 hours.

This suggests that Vilhelm is superior in accurately reflecting the statistical patterns and the relationship between what was actually observed and what was forecasted.

Vilhelm model slightly outperforms the IFS model by ECMWF. Specifically, when it comes to short-term forecasts of wind speed and direction 10 meters above the ground, the Vilhelm model proves to be a bit more accurate and reliable.

New York with and without Jua

Terminology and Methodology