Loss Function Weights
Weights in PINNICLE control the relative contribution of each term in the composite loss function. Because physical variables in glaciology differ in units and magnitudes (e.g., velocity vs. stress vs. elevation), assigning appropriate weights is critical to ensure balanced training and model convergence.
Overview
The total loss in PINNICLE is composed of multiple terms:
Where:
\(L_i\) is the loss for a specific variable or physics term
\(\gamma_i\) is the corresponding weight
These weights scale the magnitude of each loss component so that no single variable dominates or becomes numerically insignificant.
Default Weights
PINNICLE uses empirically derived default weights that normalize each term to be approximately order 1 based on typical values in glaciological applications:
Component |
Weight Symbol |
Default Value |
Typical Variable Value |
|---|---|---|---|
Ice velocity |
\(\gamma_u\) |
\(10^{-8} \cdot 31536000^2\) |
\(10^4\ \text{m/yr}\) |
Ice thickness |
\(\gamma_H\) |
\(10^{-6}\) |
\(10^3\ \text{m}\) |
Surface elevation |
\(\gamma_s\) |
\(10^{-6}\) |
\(10^3\ \text{m}\) |
Mass balance |
\(\gamma_a\) |
\(T^2\) |
\(1\ \text{m/yr}\) |
Friction coefficient |
\(\gamma_C\) |
\(10^{-8}\) |
\(10^4\ \text{Pa}^{1/2}\ \text{m}^{-1/6}\ \text{s}^{1/6}\) |
Rheology pre-factor |
\(\gamma_B\) |
\(10^{-18}\) |
\(10^9\ \text{Pa·s}^{1/3}\) |
Driving stress (PDE) |
\(\gamma_{\tau}\) |
\(10^{-10}\) |
\(10^5\ \text{Pa}\) |
Dynamic thinning |
\(\gamma_{H/t}\) |
\(10^{10}\) |
\(10^3\ \text{m/year}\) |
Customization
You can override these defaults in your hyper-parameter configuration by setting it in each equation, for example:
hp["equations"] = {
"SSA": {
"pde_weight": [1.0e-8, 1.0e-8];
}
}
or .. code:
hp["equations"] = {
"SSA": {
"data_weight": [1.0e-8*31536000**2.0, 1.0e-8*31536000**2.0, 1.0e-6, 1.0e-6, 1.0e-8],
}
}
"pde_weight"follows the same order as theresidualsdefined in the PDEs"data_weight"follows the same order as theoutputdefined in the PDEs
Use lower weights to reduce influence, higher weights to emphasize a particular term.
See the Examples page to view how weights influence different training scenarios.