Things Of Zoom
Zoom is a pervasive part of our classes and our lives today. The work is an open-ended experiment that combines what I learned in two classes this summer, Make Art With AI and Device Design. Through collaboration with Yutian and Jackie, I hope to investigate these technologies and see how we can utilize them to enhance the Zoom experience.
An interactive Zoom filter
For the main project of Make Art With AI, Yutian and I aim to create an interactive Zoom filter.
We took inspiration from the takawo's sketch and migrated the code to the p5.js web editor.
Hand movement and body segmentation
We then applied MoveNet and MediaPipe Selfie Segmentation to create a particle effect with a blurred and snowy background where web users can move their hands around to draw on-the-fly generative patterns on the canvas.
OBS VirtualCam and Zoom
The third step is using OBS Studio's Virtual Camera to do a filter demo on Zoom.
A tangible Zoom button
As a follow-up step and the final project for the Device Design class, Jackie, Yutian, and I worked as a group to prototype a Zoom button that turns this interactive filter on and off.
Prototyping
Materials: a brush for cleaning glass and a broken desk lamp base. For details, please refer to Jackie's mural board.
Zoom testing
The device uses an Arduino and button module to control the keyboard shortcut (Shift + Cmd + N if you are using a Mac) to the camera settings. Zoom users can press the button to switch between the built-in camera and the OBS virtual camera so that they can turn the filter on and off.
