Maker.io main logo

Tiny AI Stack-chan “AI Atom-chan”

2023-11-10 | By M5Stack

Share

Robot Kits

* Thanks for the source code and project information provided by @Hako

1

2

3

 

Background

 

Development material

3

 

System configuration

2

 

■Hardware configuration

  • Connect M5StickCPLUS Speaker 2 Hat and micro servo motor to rear GPIO of ATOM S3
  • Connect PDM MEMS Microphone Unit to GROVE port of ATOM S3
  • Connect the power supply to the USB-Type C board and power the ATOM S3 via the PDM MEMS Microphone Unit

■Software configuration

  • Shift to voice recognition mode using the ATOM S3 screen button
  • Record audio with PDM MEMS Microphone Unit
  • Send recording data to Google Cloud STT and convert audio to text
  • Send voice text to ChatGPT and generate conversation text
  • Generate audio from conversation sentences with the web version of VOICEVOX (TTS)
  • Play audio with M5StickCPLUS Speaker 2 Hat
  • Display Stack Chan's expression with M5Stack-avatar
  • Control the vertical and horizontal movements of the stack chain with 2 micro servo motors

■Hardware Configuration

  • Connect M5StickCPLUS Speaker 2 Hat and micro servo motor to GPIO on the back of ATOM S3.
  • Connect PDM MEMS Microphone Unit to GROVE port of ATOM S3.
  • Connect power supply to USB-Type C board and supply power to ATOM S3 via PDM MEMS Microphone Unit.

■Software Configuration

  • Press the ATOM S3 screen button to voice recognition mode.
  • Record voice with PDM MEMS Microphone Unit.
  • Send recorded data to Google Cloud STT to convert voice to text.
  • Send voice text to ChatGPT to generate conversational text.
  • Generate voice from the conversation text with web version of VOICEVOX. (TTS)
  • Playback voice with M5StickCPLUS Speaker 2 Hat.
  • M5Stack-Avatar displays Stuck Chan's facial expressions.
  • Two micro servo motors to control Stack-chan's up, down, left and right movement.

story

I wanted to make a small AI Stack Chan, so I ported robo8080's AI Stack Chan to M5STACK ATOM S3.

*Stack Chan is a “cute” communication robot designed by Hashishikawa (@meganetaan/@stack_chan)

The synthesized voice uses VOICEBOX: Zundamon.

I broke many servo motors, re-arranged them many times, rebuilt the case many times, and got stuck in modifying the software, but with the help of pioneers, I finally completed it.

Is it Japanese culture to look for cuteness in robots? Even if it is not useful for labor, cuteness enriches people's hearts. I would like to continue to improve robots with the aim of creating robots that support people's minds.

I wanted a tiny AI robot. So, I built it based on robo8080's AI Stack-Chan and M5STACK ATOM S3.

 

Número de parte del fabricante C123
ATOM S3 DEV KIT W/ 0.85-INCH SCR
M5Stack Technology Co., Ltd.
More Info
Ver más Details
Número de parte del fabricante U089
PDM MICROPHONE UNITSPM1423
M5Stack Technology Co., Ltd.
Número de parte del fabricante U055-B
M5STICKCPLUS SPEAKER 2 HAT (MAX9
M5Stack Technology Co., Ltd.
Número de parte del fabricante 15100
USB-C BREAKOUT
SparkFun Electronics
More Info
Ver más Details
Add all DigiKey Parts to Cart
Have questions or comments? Continue the conversation on TechForum, DigiKey's online community and technical resource.