Questions for the Intel RealSense SDK Java/Processing wrapper

GProf — Tue, 14 Jul 2015 19:53:47 GMT

Hello,

I've just started playing with the F200 camera and I have a few initial questions as I began with the Java Wrapper:

Is the Processing Wrapper the same thing as the Java library ? (It appears this way, but I could use a confirmation)
How can I retrieve the Face landmarks using Java ? (snippet bellow)
Can I use the heart rate features in Java ? If so, how ?
Can I use the BlobModule in Java ? If so, how ? (snippet bellow)
Where can I get an updated documentation (including what's currently supported or not in Java) ?

For Issue 2, retrieving facial landmarks, I've tried using both the non-grouped and grouped methods:

int npoints = detectData.QueryNumPoints();
PXCMFaceData.LandmarkPoint[] points=new PXCMFaceData.LandmarkPoint[npoints];
detectData.QueryPoints(points);
println(points);

This returns an empty list, similar to retrieving grouped points (which returns true):

int numPtsLE = detectData.QueryNumPointsByGroup(LandmarksGroupType.LANDMARK_GROUP_LEFT_EYE);
LandmarkPoint[] ptsLE = new LandmarkPoint[numPtsLE];
boolean hasLEPoints = detectData.QueryPointsByGroup(LandmarksGroupType.LANDMARK_GROUP_LEFT_EYE,ptsLE);
if(hasLEPoints){
for(int le = 0; le < numPtsLE; le++){
if(ptsLE[le] != null) ellipse(ptsLE[le].image.x,ptsLE[le].image.y,3,3);
}
}
println(hasLEPoints);
println(ptsLE);

prints

true
[0] null
[1] null
[2] null
[3] null
[4] null
[5] null
[6] null
[7] null
[8] null

When setting up, I've enabled landmark using the PXCMFaceConfiguration instance:

faceConfig.landmarks.isEnabled = true;

For issue 3, using hearRate, calling QueryPulse as the documentation suggests

// cfg is a PXCMFaceConfiguration instance
cfg.QueryPulse().Enable();

ends up with a NullPointerException

Exception in thread "Animation Thread" java.lang.NullPointerException
at intel.rssdk.PXCMFaceConfiguration$PulseConfiguration.Enable(PXCMFaceConfiguration.java:335)

I was expecting to write something like

faceConfig.pulse.isEnabled = true;

but pulse doesn't appear to be a property of PXCMFaceConfiguration

For issue 4, using the Blob Algorithm, I tried following the documentation:

// Create an instance of the SenseManager
PXCMSenseManager sm = PXCMSenseManager.CreateInstance();
// Enable the blob module
sm.EnableBlob();
// Get an instance of PXCMBlobModule
PXCMBlobModule blobModule = sm.QueryBlob();

but EnableBlob() isn't present. I'm guessing EnableModule(int,ImplDesc) might work,

but I'm not sure what arguments to pass. Again, QueryBlob() is missing (perhaps QueryModule(int) should be used) ? If so, how ?

Regarind issue 5, I'm trying to use as the SDK as much I can, but it would be a huge time saver

knowing what I can an can not use for now (and when to expect currently unsupported features).

I am using the latest Intel RealSense Drivers and SDK AFAIK:

Intel RealSense Depth Camera Manager F200 1.3.20.55679

Intel RealSense SDK 2014 5.0.3.187777

on Windows 8 (version 6.2, build 9200)

Thank you,

George

Has anyone encountered these

GProf — Tue, 21 Jul 2015 16:59:00 GMT

@CaptGeek (Intel) , @Colleen Culbertson (Intel) Has anyone encountered these issues with the Java wrapper ?
If so, how were these issues addressed ?

Thank you,
George

There's no blob module done

Alexander_L_Intel — Fri, 24 Jul 2015 20:21:12 GMT

There's no blob module done in Java in R3, and it most probably won't be in Java.
It is left in the doc - need to wipe off Java for blob.

Hi Alexander,

GProf — Fri, 24 Jul 2015 21:09:53 GMT

Hi Alexander,

Thank you for getting back.

Can you please advise on using Face Landmarks and Pulse using the Java API ?

Thank you,
George

topic Hi Alexander, in Software Archive

Questions for the Intel RealSense SDK Java/Processing wrapper

Has anyone encountered these

There's no blob module done

Hi Alexander,