Xbox has patented an AI assistant that can navigate difficult parts of a game for the user

Microsoft has filed a patent for a new technology designed to make life easier for gamers facing insurmountable challenges in video games. Called "Assisted Sessions," the system allows players to transfer control to either another live player via cloud streaming or a specially trained artificial intelligence (AI) if they're stuck at any point.

The system operates using machine learning, which analyzes the player's behavior and identifies moments when they're experiencing significant difficulty. At these moments, the system offers assistance. If the player agrees, a save point is created, after which control is temporarily transferred to the assistant. The assistant can not only perform the necessary action but also explain their steps so the user understands the logic behind the solution. After completing the challenging section, control is returned to the player, who can continue the game or revert to a saved game and try to solve the problem independently.

The patent application provides a clear example: a player unsuccessfully trying to find a hidden object. The system recognizes the problem and offers to connect an assistant, who temporarily takes control, demonstrates the object's location, and returns control to the player.

Interestingly, PlayStation previously patented a similar technology, calling it Ghost Player. Sony's system offers two AI assistant modes: Guide Mode, where the artificial intelligence simply shows the player what to do, and Complete Mode, in which the neural network completely solves a difficult section for the player.