The smartphone was taught to guess the user's desires by sight

The smartphone was taught to guess the user’s desires by looking at them. A special algorithm tracks where you look

a person, and based on this controls commands for the voice assistant.

This may be useful for voiceThe assistant was able to answer the question: “Until what time is this store open?” Now, with such a request, your smartphone will not understand which “this” store we are talking about. However, with the new technology of the developers, the device would be able to accurately identify the establishment simply by using both its cameras: the front and the main one.

To turn ideas into reality, engineersused an iPhone with iOS 13. It is in this version that the system allows you to use two cameras simultaneously. The developers used the system API to track head position to determine the direction of gaze.

Objects are recognized by a special framework. Then the program listens to the user's request, compares the demonstrative pronouns with the objects, and only after that forms the final command for the voice assistant.