Scratch Artificial Intelligence

Advanced

60 mins

Teacher/Student led

+75 XP

What you need:
Chromebook/Laptop/PC or iPad/Tablet
Webcam/camera

Scratch AI Pose Space Game

In this lesson, you'll create an exciting space game using Scratch and Google Teachable Machine. Learn to control a spaceship with tilt poses using a Teachable Machine Pose model, or use the provided model if needed.

Learning Goals Learning Outcomes Curriculum Mapping Teacher Notes Lesson Files

Warning: Your screen size is quite small for viewing this. Rotate your device into landscape mode if you can.

1 Introduction
2 Setup Scratch and TMPose2Scratch
3 Add the Rocketship Sprite
4 Load Teachable Machine Model
5 Display Pose Label
Challenge
Quiz

1 - Introduction

In this lesson, you will create a fun Space game using Scratch and Google Teachable Machine.

You will learn how to use your Teachable Machine Pose model with tilt poses to control a spaceship.

If you don't have a Teachable Machine Image model, don't worry! You can use the provided model.

👇 Mark your steps as done as you complete them.

+5 XP

2 - Setup Scratch and TMPose2Scratch

Go to https://stretch3.github.io/ and start a new Scratch project and delete the Cat sprite.

Then, add the TMPose2Scratch extension by clicking on the Extensions button at the bottom left corner of the screen and selecting TMPose2Scratch. This extension allows you to use Google Teachable Machine pose models in your Scratch projects.

When you add this extension, it will automatically try and use your computer's camera. If necessary, click on 'Allow' to give it permission to use your camera. You should see what the camera is showing in the stage area.

Scratch: How to add extension blocks

Understanding and Adding Extensions in Scratch

What are Scratch Extensions?

Scratch Extensions are additional sets of blocks that expand the capabilities of your Scratch projects. They allow you to:

Mention extensions like Pen here
Connect with external hardware (e.g., microbits)
Access web-based services (e.g., Google Translate, Amazon Text to Speech)
Use more advanced programming features

How Extensions Work

When you add an extension to your project:

New blocks appear in the blocks palette
These blocks are grouped under a category named after the extension
You can use these blocks just like any other Scratch blocks

Adding an Extension to Your Project

Look for the "Add Extension" button in the bottom-left corner of the Scratch editor
Click the "Add Extension" button
A window will open showing all available extensions
Browse through the options or use the search bar to find a specific extension
Click on the extension you want to add
The extension is now added to your project, and its blocks appear in the blocks palette

👇 Mark your steps as done as you complete them.

+10 XP

3 - Add the Rocketship Sprite

Add the Rocketship sprite to the project and then add the following code to it, to shrink it's size and position a the bottom center of the stage area.


when green flag clicked
  set size to (40) %
  go to x (0) y (-150)

Scratch: How to add a sprite from the library

To add a sprite from the sprite library follow these steps:

Put your mouse over the Choose a Sprite button
Click on the magnifying glass
Find the sprite you want in the library
Click on your chosen sprite

You can use search box or the filter links (Animals, People, Fantasy etc) to locate your sprite.

+10 XP

4 - Load Teachable Machine Model

Now, let's set up the pose model that our project will use. Add the following new code to your sprite:


 when green flag clicked
  set size to (40) %
  go to x (0) y (-150)
  pose classification model URL [link to your model] :: extension

Put the link of your pose model into the pose classification model URL block.

If you don't have your own pose model URL, you can use this one: https://teachablemachine.withgoogle.com/models/R9i0aRHth/

+20 XP

5 - Display Pose Label

Click on the 'pose label' block in the TMPose2Scratch extension category to turn it on. This will show you the current pose label being applied to what's being recorded on your webcam.

+5 XP

Unlock the Full Learning Experience

Get ready to embark on an incredible learning journey! Get access to this lesson and hundreds more in our Digital Skills Curriculum.

Get started

Copyright Notice
This lesson is copyright of Coding Ireland. Unauthorised use, copying or distribution is not allowed.

Scratch is developed by the Lifelong Kindergarten Group at the MIT Media Lab. It is available for free at https://scratch.mit.edu

Your Answer or Description of Your Work

Project URL This can be a link to your project (e.g. a Scratch, Microbit, Arcade or CodePen URL link).

Upload File

You must be logged into Scratch to share your project, otherwise the link will not work.

To get the URL link of your Scratch project:

Make sure you're logged into Scratch.
Click on the Share button in the project editor.
Click on the Copy Link button.
Click on the Copy Link link. This will save the URL of your project page into your clipboard.

To get the URL link of your Microbit project:

Click on the button in the project editor.
Click on the Publish Project button.
Click on the Copy button. This will save the URL of your project page into your clipboard.

To get the URL link of your Arcade project:

Click on the button in the project editor.
Click on the Publish Project button.
Click on the Copy button. This will save the URL of your project page into your clipboard.

To get the URL link of your CodePen project:

Make sure you're logged into CodePen.
Open your project in the editor.
Click on the Save button at the top of the editor.
Copy the link from the address bar in your web browser (e.g. https://codepen.io/Jane-Smith/pen/gOVXxBQ)

Scratch AI Pose Space Game

Teacher Class Feed

1 - Introduction

Send your work to your teacher

2 - Setup Scratch and TMPose2Scratch

Understanding and Adding Extensions in Scratch

What are Scratch Extensions?

How Extensions Work

Adding an Extension to Your Project

Send your work to your teacher

3 - Add the Rocketship Sprite

Send your work to your teacher

4 - Load Teachable Machine Model

Send your work to your teacher

5 - Display Pose Label

Send your work to your teacher

Unlock the Full Learning Experience