Help me understand the loss spikes during pretraining of a custom flow matching action prediction model
|
I am pre-training a custom flow matching diffusion action prediction model using Lerobot dataset (only 2k episodes) I am getting these spikes in loss around ~600-700 global steps Can anyone help me understand these spikes ? submitted by /u/Quiet_Dependent_9552 |