That makes it seem like a great test, right? It detects environments with mutual lack-of-fit. You don’t want to work there. They don’t what you to work there. Outcome from experiment: both realize this.
This is ableist too. You might be relieved to eliminate candidates who could be a great fit with some accommodation. You’re eliminating people unnecessarily, and it harms both you and the candidates.
As the originator of the question addressed elsewhere in these comments, they gave advance notice to the candidates and worked with them to provide an alternative setup as needed.
As far as interviews go, it’s pretty good.