Extensions add features to Game Builder that are not part of every game, like AI models, hand and face tracking, and music.
What an Extension Adds
When you add an extension to your game, two things are added:
A new tab next to the Sprites, Widgets, Sounds and Game tabs, with the extension's settings.
A new group of blocks in the block library under the code editor, with the blocks of the extension.
Adding an Extension
Extensions are not available by default. To add one, click the + sign on the Game Builder tabs.
Choose the extension you want, and click Add.
Each extension can be added to a game once. A game can have only one AI extension: if your game has AI - Image and you add AI - Pose (or the other way around), the new one replaces the old one. The other extensions can be added together.
Available Extensions
Extension | Description | Read more |
AI - Image | Train a model based on images from your webcam. | |
AI - Pose | Train a model based on poses from your webcam. | |
Hand Tracking | Control your game by moving your hand. | |
Face Tracking | Control your game with your face and make face filters. | |
Music | Compose music and play notes in your game. |
Using the Camera
AI - Image, AI - Pose, Hand Tracking and Face Tracking use the computer's camera. When you click RUN!, the browser asks for permission to use the camera. If the permission was blocked by mistake, you can allow it again from the camera icon in the browser's address bar.
Hand Tracking and Face Tracking run in the browser, and the camera images are not recorded, collected or stored. The AI extensions don't save the images you train them with either: only the trained model is saved.
Relevant Articles: