Kinect Point Cloud texture

Sounds great, thanks! I’m not entirely sure how you get a full 16:9 frame of depth values when the depth sensor is closer to a square aspect ratio. Are they letterboxing the depth data or something?

Great news.
:slight_smile:

The posted build now has the feature, here is a sample .toe using it
pointCloud.toe (6.83 KB)

I`m connecting my kinect v2 !
Well done !
youtu.be/HFR3ZPryGzY
(unlisted)

  • I have FPS drop to ~28 avg (GTX660TI) when using the color point cloud option.
  • Your example is great I had only to rotate the camera 180 degrees and change z position.
    (As far much as I notcied)

Keep the great work !

Barak

It will be a lot of work to add another layer of “player index” maybe as alpha channel option ?
or just another option to be aligned with with 1080p output.
It will help a lot to isolate users…

Barak

WoW, amazing.
Exactly what i needed !

Where i am sad, i want record kinect point cloud output…
Kinect point cloud need to have a pixel format at less 16 bit float.
No MovieFilesOut can export 16bit format video ?

This is awesome indeed !

Question though :
How can I record the Color Point Cloud texture in an Animated movie file ?

I want to synchronize the 2 Point Clouds of 2 Kinects (back/front) to reproduce full 3D.
Did it with 2 stills already
DrummerStill.gif

My plan is to sync the 2 videos in editing software then use it in Touch and generate 2 geos merged.

Thanks for this @derivative!

This color point cloud feature is awesome, super handy. I’m seeing some artifacts in the cloud, though, because it’s been scaled up and remapped into the color camera point of view. It’s also cropping the top and bottom of the point cloud.

Malcolm, any chance of adding a second “point cloud” texture, but leaving it unmapped and uncropped straight to the depth view? It’s possible to reproject the depth image into XYZ with a glsl top, but it’d be awesome to have this built right in! :slight_smile:

Hello, there’s any suggestion on how to align this image with a projector?
I’m alignin the camera manually, in the 3D space trying to match the projector position and I put the FOV of the camera to a value like the projector FOV but it doesn’t work.

There’s something else to do?

Hi All,

Just curious - are you running two kinect sensors (k4w v2) on the same machine in the same touch process?

looking at the best way to use multiple kinect v2 sensors in TD - looks like it may have to run on separate machine and touch in/out around the place…?

How did you go with this? Did you solve your problem? I am currently looking at hour to calibrate with the realworld view of the projector

Best,

O.

Hi @malcolm,
I was playing with this today and saw that you did a great job of assigning depth to the the 1080p RGB texture.

This is nice and very useful, but I’d rather get the the 512x424 depth image with the color data, is there a way to do so? I feel like the color to depth mapper is in C and so we can’t use it without a change in the top code.

Thanks

Hello there

I want to record a performance, should I record both point cloud texture and RGB camera texture? Or the point cloud texture has already the RGB color of the color camera?

Thanks!

point cloud texture provide xyz values of the points.
the color camera only provide you the rgb data.

two separate textures.

New to TD.

Experimenting with the point cloud and the example offered, thank you…!

Not sure how to explain my issue. I seam to have a large shadow/vacuum of points around outline of my body that moves to covers the points representing my body the closer I get to the Kinect.? is this artefact or a byproduct of the process.
many thanks

How can I export the point cloud data into Houdini? Anyone?

To export to Houdini…there are so many ways.

Use a tableDat and write to a csv
Write a .chan file that can be read through Houdini in Chops
Write a sequential .bgeo sequence

Try outputting it as .exr with the Movie File Out TOP. Set the Movie File Out TOP to output as an Image, or an Image Sequence. Make sure of course your input is a 32-bit floating point TOP.

Related to much earlier posts in this thread, the next build of the 2019.10000 series will have a Depth Point Cloud output which is lower resolution but solves some of the artifact issues the color space point cloud has