The DeepReality Unity package is aimed at simplifying and streamlining the usage of machine learning models in conjunction with the AR functionality. At its core it links the functionality of:
- Barracuda: a neural network inference library
- AR Foundation: a package that acts as an interface between Unity and platform-specific AR libraries (ARCore and ARKit), giving a unified way to access their common functionality
The result is that users with different skill levels in Unity and Machine Learning can easily create mobile applications (iOS and Android) that can:
- Identify objects or features in the world by analyzing via machine learning images acquired with the device’s camera.
- Show content on top of those elements, creating an augmented reality experience.