Loss Function Weights

Weights in PINNICLE control the relative contribution of each term in the composite loss function. Because physical variables in glaciology differ in units and magnitudes (e.g., velocity vs. stress vs. elevation), assigning appropriate weights is critical to ensure balanced training and model convergence.

Overview

The total loss in PINNICLE is composed of multiple terms:

\[L = \sum_i \gamma_i \cdot L_i\]

Where:

  • \(L_i\) is the loss for a specific variable or physics term

  • \(\gamma_i\) is the corresponding weight

These weights scale the magnitude of each loss component so that no single variable dominates or becomes numerically insignificant.

Default Weights

PINNICLE uses empirically derived default weights that normalize each term to be approximately order 1 based on typical values in glaciological applications:

Default Weights and Typical Values

Component

Weight Symbol

Default Value

Typical Variable Value

Ice velocity

\(\gamma_u\)

\(10^{-8} \cdot 31536000^2\)

\(10^4\ \text{m/yr}\)

Ice thickness

\(\gamma_H\)

\(10^{-6}\)

\(10^3\ \text{m}\)

Surface elevation

\(\gamma_s\)

\(10^{-6}\)

\(10^3\ \text{m}\)

Mass balance

\(\gamma_a\)

\(T^2\)

\(1\ \text{m/yr}\)

Friction coefficient

\(\gamma_C\)

\(10^{-8}\)

\(10^4\ \text{Pa}^{1/2}\ \text{m}^{-1/6}\ \text{s}^{1/6}\)

Rheology pre-factor

\(\gamma_B\)

\(10^{-18}\)

\(10^9\ \text{Pa·s}^{1/3}\)

Driving stress (PDE)

\(\gamma_{\tau}\)

\(10^{-10}\)

\(10^5\ \text{Pa}\)

Dynamic thinning

\(\gamma_{H/t}\)

\(10^{10}\)

\(10^3\ \text{m/year}\)

Customization

You can override these defaults in your hyper-parameter configuration by setting it in each equation, for example:

hp["equations"] = {
   "SSA": {
      "pde_weight": [1.0e-8, 1.0e-8];
   }
}

or .. code:

hp["equations"] = {
   "SSA": {
      "data_weight": [1.0e-8*31536000**2.0, 1.0e-8*31536000**2.0, 1.0e-6, 1.0e-6, 1.0e-8],
   }
}
  • "pde_weight" follows the same order as the residuals defined in the PDEs

  • "data_weight" follows the same order as the output defined in the PDEs

Use lower weights to reduce influence, higher weights to emphasize a particular term.

See the Examples page to view how weights influence different training scenarios.