Help me understand the loss spikes during pretraining of a custom flow matching action prediction model

Help me understand the loss spikes during pretraining of a custom flow matching action prediction model

I am pre-training a custom flow matching diffusion action prediction model using Lerobot dataset (only 2k episodes)

I am getting these spikes in loss around ~600-700 global steps

Can anyone help me understand these spikes ?
Is it normal ?
What can be the probable cause of it ?

https://preview.redd.it/d3urde8c0udh1.png?width=2808&format=png&auto=webp&s=6b80e27dc2aa4d48d531814fa36d0756cdc0678a

https://preview.redd.it/yfumi60n0udh1.png?width=2810&format=png&auto=webp&s=f7a4076ff3f46e9fb7d82c874752d12e1170d40a

submitted by /u/Quiet_Dependent_9552
[comments]

Similar Posts

Leave a Reply

Your email address will not be published. Required fields are marked *