There are ethical issues involved
Someone mentioned earlier the trolley problem. It was apt. Your child is in that field beside the field with ten people. Who decides on the decision to crash into that field with one child? The software design team? The programmer? The manufacturer? The operator? Will these ethical decisions be decided on in committees? Will these have joint liability?