This is the updated system architecture for B-Wind! developed together with team members Pedro and Maurício during the second half of the AZ residency, nodes marked with dashed lines represent features that we’re planning to develop in the next stage.
Currently, the system involves four main components:
- Real-time video capture and streaming at a remote location using a wireless IP Camera. The video stream is processed in openFrameworks using a custom GStreamer pipeline.
- Real-time motion tracking of the user at the instalation implemented using OpenCV.
- A working prototype of an Arduino based fan controller that can turn on and rotate a 12v fan according to motion tracking.
- Particle effects generated from the user’s performance at the local installation, where motion information is used to displace a fluid simulation grid which is overlayed in the streamed video of the remote location.
We still have to hurry, for there’s some work to be done to customize the system to the available technical resources and to the characteristics of the exhibition space. Go B-wind team, go!