Sure, but when I klayout user_project_wrapper.gds I see only the user project rectangle. Tried caravel.gds but got whole chip with empty user space. Which gds?

Sorry, I keep forgetting to use threads. See those files in https://github.com/PyFive-RISC-V/caravel_pyfive for an example of what you should end up with