Maybe ArUco
ArUco markers area a kind of fiducial marker. They are likely to be useful for the current idea for this simple TUI project.
So far, the process I've gone through to get these to work has been relatively successful. I managed to get opencv 4.14 - browser javascript version to work. It's simply detecting the marker and then inferring the location of a dot. Once the dot is also detected, an angular value is converted to some value from 0-128.
I can see that this is definitely a plausible approach to getting items around the home to be somewhat useful as TUIs. At this stage, having this proof of concept is enough to begin figuring out exactly how to make it work in such a way that isn't so janky. The difficulty with reading the camera data is very much like reading any kind of sensor data, its noisy and inconsistent. This was something I found to be the case when reading signals from analog to digital converters in TUIs built from electronic circuits.
I will need to bring the setup closer to what I intend to be a more realistic, which will hopefully mean a stable, low noisy input image. Once I can work with this, I can then see whether there's get a nice stable input value. Or, more optimization is required.
