How do we control the spread of mice inside apartment? Do you have factsheet for this? We hired an exterminator and it's really costly.

What non-toxic way(s)can I get rid of mice or rats? I thought about getting a cat or two as well as closing up all holes to stop them from getting in in the 1st place.