Microsoft has revealed information on how the Recall feature will utilize the Windows Semantic Index and Windows Copilot Runtime. The company also outlined the steps app developers can take to enhance their products for seamless interactions with Recall and ensure smoother transitions between snapshots.
The core of Recall is the new Windows Copilot Library, which contains a set of APIs based on more than 40 artificial intelligence models and algorithms built directly into Windows. This library is already used in many new AI features in Windows, including Studio Effects, Live Captions, OCR in Snipping Tool, and now Windows Recall.
Microsoft says Recall will work automatically in most apps. However, developers can extend the functionality of the feature by adding contextual information to the vector database using the User Activity API. This will allow Recall to restore to the point at that the application was at the snapshot moment.
Microsoft PowerPoint and Teams are the first Microsoft apps to support this feature. Recall is also available in the third-party sketching app Concepts.
How Recall works under the hood
Recall uses the Windows Semantic Index, a new operating system feature that reimagines search in Windows. Recall is powered by several advanced AI models, including multi-modal SLMs, that run in parallel and are integrated into the OS itself.
These models are designed to understand various types of content and accommodate different languages for efficiently organizing vast amounts of information, whether it be text, images, or videos. This information is then converted and stored in a vector store known as the Windows Semantic Index, which is kept solely on the user's local device.
This seamless integration offers a distinctive level of privacy as all data stays within the user's device.
Microsoft underscores that all data processed by Recall is kept on the local device and is not transmitted to the cloud. The company also confirms that the collected data is not utilized for training artificial intelligence models.
👉 More Build 2024 announcements 👈
Support us
Winaero greatly relies on your support. You can help the site keep bringing you interesting and useful content and software by using these options:
I really do hope they make the Recall feature available to PCs that don’t have NPU processors.