Hello, I'd like to build dummies around my critical device (see picture below). What is an elegant way to do it? I'm thinking about deleting guard ring and add fingers around the edges but I wonder if this would cause LVS problem?

you can add the dummies to schematic. Then it wont cause LVS

Ok great thank you