Is there anyway to speedup the simulation time with caravel? It seems like the cpu can sometimes take ~50 clock cycles per instruction to fetch and execute some instructions.

it is possible to move the instruction memory directly into the CPU instead of having the simulated spi flash, this will make it significantly faster (but potentially slightly inaccurate since it's no longer an exact copy of what happens in caravel)