Yeah there are a lot of subtleties that are hard to program; that's why it must be extremely effective on things that _can_ be programmed such as quick breaking, quick steering; prefer lanes that are farther away from pedestrians near-by, beep when entering a non-illuminated zone and hundreds of other details.
Then it shouldn't be deployed. I had several occasions where I overlooked somebody (luckily without consequences) but never one where I falsely registered someone or something to warrant to brake.
I don't think it will work. Instead the failing effort will be cover to add more and more rules in an attempt to hide the obvious while blaming the victim(s) for breaking the rules.