3D Camera software development
I’d like to build an app that gets the data into a point cloud, and has basic OpenGL visualization of the data as it’s recorded. I definitely want something useable with Point Cloud Library, and Meshlab. I would like to use that as the basis of a tutorial on how to use the camera to do useful things. I would also like to write a websocket app to make it easy to get the data into other applications such as a web browser.
intel RealSense camera on Linux
3d Camera Controls
RealSense 3d camera on Linux Mac OS X. infrared, calibration, point clouds
Software developed so far is available on github https://github.com/teknotus/depthview
Besides two cameras having no support sent upstream there hasn't been work on calibration, or a serious kernel issue that currently requires a camera reset to work around. I've become very interested in the kernel side of things, and spent a huge amount of time learning kernel development so that I can work on these types of problems.
So far I wrote a driver from scratch that can fetch data from the camera. It needs a lot of work before it would be seriously considered upstream, but the steepest part of the learning curve is done.
As it is a different software stack is needed for each 3d camera on the market. When working to get code upstreamed I plan to address this as well by trying to get standard methods for working with 3d cameras. Doing this would be the basis of allowing programs to be written the same no matter what vendor built the camera. Interestingly many of the problems are the same for 360 degree video so this may solve more than one problem. Here is a link to my driver in progress.
Next up is a blog post detailing this and other 3d camera issues that don't seem to be actively developed. I increased my funding goal considerably in the hopes that I can afford to work on this full time.
This lets me shift my focus to application stuff, but there are a few things I learned in my investigations that aren't represented in the new library so I may still do some driver type work.
Also today an open source app for RealSense on OSX was released. The email I got for that preceded the one for librealsense by a few hours.
The forums indicate that they will have another batch to ship out in January. I just got invited to an R200 hackathon at the end of February where they will be giving away cameras. The F200 is getting a replacement with a new name SR300. The R200 is similar enough to the F200 that I've managed to figure out a lot just from emailing back and forth with people lucky enough to have one. Hopefully the same will be true of the SR300. Probably will for the same reason that Windows has ancient code in it, "the code works, don't fix it".
FYI: Intel have stopped making the F200 and R200 cameras - their web site shows them perpetually "Out of Stock". Similar cameras have appeared in some laptops - and eventually, we'll start to see them showing up in more phones and tablets. But perhaps we've seen the end of the USB devices.