topic Re: queryNumJoints() only returns 0 in Items with no label

queryNumJoints() only returns 0

MMich26 — Sun, 08 Jan 2017 08:20:43 GMT

Hi,

I am currently working with the Person Tracking Module using an R200. The personTracking module works successfully, and I can successfully query features like centerMass. However, querying skeleton joints has not been working. To start, I queried the number of joints that my module was currently configured to track.

PXCPersonTrackingData::PersonTracking* personTracking = personData->QueryTracking();

PXCPersonTrackingData::PersonJoints * ptj = personData->QuerySkeletonJoints();int numJoints = ptj->QueryNumJoints();printf("numJoints: %d ", numJoints);

The above code outputs 0, no matter which tracking area is selected (AREA_FULL_BODY, AREA_FULL_BODY_ROUGH, AREA_UPPER_BODY, and AREA_UPPER_BODY_ROUGH). Has anyone gotten queryNumJoints to successfully return the number of joints being tracked?

Michael

Re: queryNumJoints() only returns 0

idata — Mon, 09 Jan 2017 20:48:35 GMT

Hello Michael,

Thanks for reaching out!

May I ask, which SDK version are you using? Also, have you already tried running the example found in https://software.intel.com/sites/landingpage/realsense/camera-sdk/v1.1/documentation/html/index.html?doc_pt_tracking_joints.html. If so, how did it go? Does it also returns 0?

Let me know.

-Peter.

Re: queryNumJoints() only returns 0

MMich26 — Tue, 10 Jan 2017 03:05:24 GMT

Hi Peter,

I am using the 2016 R2 SDK. I tried your link, and am still only getting the function to return 0. I used the example you provided, and ended up with the following code:

/* Enabling skeleton joint tracking */PXCPersonTrackingConfiguration* personTrackingConfig = pp->QueryPersonTracking()->QueryConfiguration();personTrackingConfig->SetTrackedAngles(PXCPersonTrackingConfiguration::TrackingAngles::TRACKING_ANGLES_ALL);PXCPersonTrackingConfiguration::SkeletonJointsConfiguration* skeletonJoints = personTrackingConfig->QuerySkeletonJoints();skeletonJoints->Enable();printf("is jointTracking Enabled?: %d\n", skeletonJoints->IsEnabled());

...

int numPeople = personModule->QueryOutput()->QueryNumberOfPeople();

/* Found a person */if (numPeople != 0) {printf("Number of people: %d\n", numPeople);PXCPersonTrackingData::Person* personData = personModule->QueryOutput()->QueryPersonData(PXCPersonTrackingData::ACCESS_ORDER_BY_ID, 0);assert(personData != NULL);PXCPersonTrackingData::PersonJoints* ptj = personData->QuerySkeletonJoints();int numJoints = ptj->QueryNumJoints();printf("numJoints: %d ", numJoints);}

It states that joint tracking is enabled, but continues to loop through and print that there were 0 joints found.

Michael

Re: queryNumJoints() only returns 0

MMich26 — Tue, 10 Jan 2017 07:49:34 GMT

Ok, so I've been experimented with the Person Tracking example included in the SDK example library. I attached a console to the GUI, and have been able to reverse engineer some important details. The example, for starters, has working skeleton tracking with 6 points. I can explain what I have found a little more if anyone needs it, but for now I'll just list the joints I was able to uncover:

JOINT_HEAD

JOINT_LEFT_SHOULDER

JOINT_RIGHT_SHOULDER

JOINT_LEFT_HAND

JOINT_RIGHT_HAND

JOINT_SPINE_MID

While this is nowhere close to the number of points mentioned in the documentation, it should work for my purposes. The example code has a working queryNumJoints function--it returns 6. It also has a working queryJoints function...something that I have so far been unable to port into my own code. In the picture below, you can see that I have been able to access the 6 skeleton joints and their respective members inside the example code.

So, it is nice to see that there is a working evidence of skeleton joints tracking. However, I cannot figure out how to enable it in my own programs and the online documentation frankly sucks. I cannot figure out the right combination/ordering of method required to enable skeletonJoint tracking. The example code bring up another function, setTrackingMode(), that was not even mentioned in the SDK documentation and seems to be necessary to function. Is there anyone on your end that can explain or provide a working piece of code to track these 6 functions and that doesn't come cluttered with a massive GUI?

Thanks,

Michael

Re: queryNumJoints() only returns 0

idata — Tue, 10 Jan 2017 20:14:44 GMT

Hi Michael,

I understand, this is a strange behavior. Please let me investigate about this and if I'm able to find something useful, I'll make sure to share it with you.

Nevertheless, I would like to point out that setTrackingMode is actually found on the SDK documentation. It can be found in https://software.intel.com/sites/landingpage/realsense/camera-sdk/v1.1/documentation/html/index.html?settrackingmode_pxcfaceconfiguration.html.

-Peter.

Re: queryNumJoints() only returns 0

MMich26 — Tue, 10 Jan 2017 20:30:46 GMT

OK, thanks for the help!

Re: queryNumJoints() only returns 0

idata — Wed, 11 Jan 2017 20:07:14 GMT

Hi Michael,

Thank you for your patience, I understand this could be frustrating. We will try to get a simplified code snippet that works for tracking joints from RealSense developers but I cannot promise if and when we will be able to get the code.

I will get back to you once I have an update.

-Peter.

Re: queryNumJoints() only returns 0

STiru — Sun, 15 Jan 2017 22:41:27 GMT

Hello Michael and Peter, I am also having this same issue. The example in the SDK is able to identify six of the joints. First, I must say I'm disappointed in the marketing and documentation which led me to believe that the R200 device had greater joint tracking capabilities. The device is impressive nonetheless.

With that aside, QueryNumJoints() returns a value of 0 in my program as well. While perusing the SDK source files, I noticed the variable joints is both a member variable of the PersonTrackingRenderer2D class as well as a variable defined separately as:

if (!joints)

{

joints = new PXCPersonTrackingData::PersonJoints::SkeletonPoint[personJoints->QueryNumJoints()];

}

personJoints->QueryJoints(joints);

This variable can be used exclusively to plot the location of the known joints within the DrawSkeleton method of the aforementioned class. Perhaps, Peter, you can clear up this ambiguity to help us out. Furthermore, there is some level of redundancy in accessing joint position data. Do you have suggestions on the best way to access this information?

Thank you,

Sragvi

Re: queryNumJoints() only returns 0

MartyG — Sun, 15 Jan 2017 23:50:03 GMT

I remembered that a couple of people on the old RealSense forum had this returning-zero issue, so I dug out the links as a reference source.

https://software.intel.com/en-us/forums/realsense/topic/685380 RealSense R200: How resolve call to QueryJoints (C# ) causing exception?

https://software.intel.com/en-us/forums/realsense/topic/607652?language=es Skeleton Joint Data Available?

https://software.intel.com/en-us/forums/realsense/topic/624543 Issue with SkeletonPoint

Re: queryNumJoints() only returns 0

idata — Mon, 16 Jan 2017 13:37:40 GMT

Skeleton tracking will work only when tracking mode is set to Interactive (It is not mentioned in the documentation ) and also you must enable skeleton tracking (by default skeleton tracking is disabled)

here is my code (tested with R200 and SDK R2)

int wmain(int argc,WCHAR* argv[])

{

PXCSenseManager *sm = PXCSenseManager::CreateInstance();

PXCPersonTrackingData::PersonJoints::SkeletonPoint* joints;

sm->EnablePersonTracking();

PXCPersonTrackingModule *tracker = sm->QueryPersonTracking();

sm->Init();

PXCPersonTrackingConfiguration *config = tracker->QueryConfiguration();

PXCPersonTrackingData *PersonData = tracker->QueryOutput();

config->QuerySkeletonJoints()->Enable();

config->QueryTracking()->SetTrackingMode(PXCPersonTrackingConfiguration::TrackingConfiguration::TRACKING_MODE_INTERACTIVE);

while (sm->AcquireFrame(true) >= PXC_STATUS_NO_ERROR)

{

pxcI32 npersons = PersonData->QueryNumberOfPeople();

for (pxcI32 i = 0; i < npersons; i++)

{

PXCPersonTrackingData::Person *Person = PersonData->QueryPersonData(PXCPersonTrackingData::ACCESS_ORDER_BY_ID, i);

PXCPersonTrackingData::PersonTracking *ptt = Person->QueryTracking();

PXCPersonTrackingData::PersonJoints *PersonJoint = Person->QuerySkeletonJoints();

pxcI32 numJoints = PersonJoint->QueryNumJoints();

joints = new PXCPersonTrackingData::PersonJoints::SkeletonPoint[numJoints];

PersonJoint->QueryJoints(joints);

wprintf(L"no.of joints : %d", numJoints);

}

wprintf(L"\nno.of person : %d\n", npersons);

sm->ReleaseFrame();

}

sm->Release();

return 0;

}

Re: queryNumJoints() only returns 0

MartyG — Mon, 16 Jan 2017 13:41:13 GMT

Thanks so much for the info, Kamalraj

Re: queryNumJoints() only returns 0

YLi77 — Tue, 31 Jan 2017 18:21:44 GMT

I found that there is not SetTrackingMode function in C# . Neither in C# project nor in Unity project. Any idea?

Re: queryNumJoints() only returns 0

MartyG — Tue, 31 Jan 2017 18:37:41 GMT

Whilst there is not a SetTrackingMode function in the RealSense online documentation pages for C# UWP, you can click on the C# tab to get code in ordinary C# . UWP stands for Universal Windows Platform. So you only need to use the UWP version instead of ordinary C# if you want to develop a single universal Windows app for all types of Microsoft-supported devices, including phone, Surface tablet, HoloLens headset and Xbox console.

https://software.intel.com/sites/landingpage/realsense/camera-sdk/v1.1/documentation/html/index.html?settrackingmode_pxchandconfiguration.html Intel® RealSense™ SDK 2016 R2 Documentation

Re: queryNumJoints() only returns 0

YLi77 — Tue, 31 Jan 2017 20:32:42 GMT

Hi, MartyG, thanks for your reply. I need to make me more clear. I can not find the SetTrackingMode function in the SDK. Such as :

ptc.QueryTracking().Enable();

ptc.QueryTracking().SetTrackingMode();

There will be error: PXCMPersonTrackingConfiguration.TrackingConfiguration does not contain a definition for "SetTrackingMode".

I install the RealSense SDK 2016 R2, and import it into Unity 3D, as https://software.intel.com/en-us/blogs/2015/02/13/add-realsense-to-unity 8 Steps to Add Intel RealSense Unity Toolkit to your Project | Intel® Software

Re: queryNumJoints() only returns 0

MartyG — Tue, 31 Jan 2017 20:55:01 GMT

That guide is a couple of years old and the SDK has gone through about 5 different versions since then. I suspect though that your error may be related to Unity, if you have followed that guide. Although the procedure for copying RealSense DLL files into a Unity project was correct at the time, things changed when Unity 5 was introduced.

Up until Unity 4 Pro, Unity was based on 32-bit code. After Unity 5, Unity switched to 64-bit code and so the 32-bit RealSense library files placed in the Plugins and Plugins. Managed folders by the Unity Toolkit were no longer compatible. You need to ensure that these folders have the 64-bit versions of the RealSense files, as you cannot rely on the Unity Toolkit to do it properly automatically.

Go to the Plugins and Plugins.Managed folders in your project and delete their contents (libpxccpp2c.dll and libpxcclr.unity.dll).

Then go to C:\Program Files (x86)\Intel\RSSDK\bin\x64 (which is the location for the 64-bit version of files) and from this directory, copy libpxccpp2c.dll into Plugins and libpxcclr.unity.dll into Plugins.Managed. The filenames are the same, they are just the 64-bit version of the files that Unity 5 requires.

The rest of the Unity Toolkit files do not need to be changed.

Please comment here again if you still have problems.

Re: queryNumJoints() only returns 0

YLi77 — Tue, 31 Jan 2017 22:14:52 GMT

Hi, MartyG. After changed as you said, there is still no definition for "SetTrackingMode", and even more, there are no definition for "QuerySkeletonJoints" in PXCMPersonTrackingData.Person and no definition for "QueryJoints" in PXCMPersonTrackingData.PersonJoints.

Re: queryNumJoints() only returns 0

MartyG — Tue, 31 Jan 2017 23:04:45 GMT

1. What camera are you using please? F200, R200 or SR-300?

2. Are you using the R2 version of the RealSense SDK or version R3? The newest R3 version and the Unity Toolkit files are not currently working with Unity, as it is very different in structure to the previous R2 version. If you want to develop in Unity with RealSense, you should use R2.

Re: queryNumJoints() only returns 0

YLi77 — Tue, 31 Jan 2017 23:14:09 GMT

1. I use R200.

2. I use version R2.

Re: queryNumJoints() only returns 0

MartyG — Tue, 31 Jan 2017 23:26:43 GMT

My apologies, I see now from your earlier message that you are using R2.

I would usually expect to see the error messages that you have received if there was a problem with the DLL files in the Plugins and Plugins.Managed folders of the project. For a new project, the folders should look like this, with absolutely nothing in them except those 2 files.

Re: queryNumJoints() only returns 0

YLi77 — Wed, 01 Feb 2017 22:05:20 GMT

Hi, MartyG. My Plugins and Plugins.Managed folders are just like yours, using x64 files. Then there are two errors:

Assets/DrawSkeleton.cs(120,67): error CS1061: Type `PXCMPersonTrackingData.Person' does not contain a definition for `QuerySkeletonJoints' and no extension method `QuerySkeletonJoints' of type `PXCMPersonTrackingData.Person' could be found. Are you missing an assembly reference?

Assets/DrawSkeleton.cs(129,25): error CS1061: Type `PXCMPersonTrackingData.PersonJoints' does not contain a definition for `QueryJoints' and no extension method `QueryJoints' of type `PXCMPersonTrackingData.PersonJoints' could be found. Are you missing an assembly reference?

And there is still not "SetTrackingMode" function in PXCMPersonTrackingConfiguration.TrackingConfiguration.

I also tested in Visual Studio. I created a new windows form app project, then added x64 libpxccpp2c.dll and libpxcclr.cs.dll in the project. I found there is still not "SetTrackingMode" function in PXCMPersonTrackingConfiguration.TrackingConfiguration. So, I am very sure that there is not "SetTrackingMode" function for PXCMPersonTrackingConfiguration.TrackingConfiguration in the 2016 R2 SDK for C# .