To put some data to my assertion in comments, from this query, close votes per question closed:
Out of 453 questions that were closed, 207 (46%) were closed with either no moderator vote or the moderator being a 5th vote (so, acting as a regular citizen). 124 (27%) were closed with a moderator casting either the first or second vote. 122 (27%) were closed with a moderator casting either a third or fourth vote.
Changing the policy would, then, affect perhaps 27% of questions (the questions closed with 3 or 4 votes), and perhaps 122 questions over the past 300 days, for less than half of a question per day.
This assumes that nearly all questions that should be closed, are, but I think that is the case here - we don't tend to have questions sitting in the close vote queue for months.
Close dates are fairly good on this site. Of the 423 questions opened in 2020 that were subsequently closed, 174 questions were closed on the same day they were opened (41%), and 292 (69%) were closed within one day. 383 (91%) are closed within a week. Only 40 questions in total were closed in more time than one week, which seems entirely reasonable for a site of this size.
Edit: Per GS's question, most questions that are closed do have answers. Of the 434 questions (slightly more due to later runtime of the query, note) that were opened in 2020 and subsequently closed, 123 (28%) have zero answers, while 205 (47%) have one answer, and the remaining 106 (24%) have more than one answer.