Open-source framework for detecting bias and overfitting for large pathology images
Fig 5
Sequential checkpointing: In a regular computation (above), information from the forward pass of the model is stored in memory.
To do a backwards pass, this information is passed on for calculations. For sequential checkpointing (lower part), not all information is kept in memory. Therefore, to get the information needed for the gray node, the latest checkpoint is found (red), and information from that checkpoint is recalculated (blue nodes).