Elon Musk is going to solve this problem eventually, but still some years away.
If you haven’t seen his humanoid robot, it’s very interesting.
https://www.teslaoracle.com/2023/09/...ff-mechanisms/
“In less than a year, the Optimus engineering team at Tesla enabled it to perform complex hand and body gestures. This is the result of the advancement Tesla has achieved in both the hardware and software side of Optimus.
Interestingly, Tesla Optimus identifies even its own body using the Tesla Vision neural net. “Using only vision and joint position encoders, it can precisely locate its limbs in space,” Tesla states as Optimus attempts to identify its arms and hands through its vision.“
https://youtu.be/0SGPdqTg-g4?si=3SaSwojJ-knvzhcV