Questions for the Intel RealSense SDK Java/Processing wrapper

[GProf]

Hello,

I've just started playing with the F200 camera and I have a few initial questions as I began with the Java Wrapper:

1. Is the Processing Wrapper the same thing as the Java library ? (It appears this way, but I could use a confirmation)
2. How can I retrieve the Face landmarks using Java ? (snippet bellow)
3. Can I use the heart rate features in Java ? If so, how ?
4. Can I use the BlobModule in Java ? If so, how ? (snippet bellow)
5. Where can I get an updated documentation (including what's currently supported or not in Java) ?

For Issue 2, retrieving facial landmarks, I've tried using both the non-grouped and grouped methods:

1. int npoints = detectData.QueryNumPoints();  
2.             PXCMFaceData.LandmarkPoint[] points=new PXCMFaceData.LandmarkPoint[npoints];  
3.             detectData.QueryPoints(points);  
4.             println(points);  

This returns an empty list, similar to retrieving grouped points (which returns true):

1. int numPtsLE = detectData.QueryNumPointsByGroup(LandmarksGroupType.LANDMARK_GROUP_LEFT_EYE);  
2.             LandmarkPoint[] ptsLE = new LandmarkPoint[numPtsLE];  
3.             boolean hasLEPoints = detectData.QueryPointsByGroup(LandmarksGroupType.LANDMARK_GROUP_LEFT_EYE,ptsLE);  
4.             if(hasLEPoints){  
5.               for(int le = 0; le < numPtsLE; le++){  
6.               if(ptsLE[le] != null) ellipse(ptsLE[le].image.x,ptsLE[le].image.y,3,3);  
7.               }  
8.             }  
9.             println(hasLEPoints);  
10.             println(ptsLE);  

prints

1. true  
2. [0] null  
3. [1] null  
4. [2] null  
5. [3] null  
6. [4] null  
7. [5] null  
8. [6] null  
9. [7] null  
10. [8] null  

When setting up, I've enabled landmark using the PXCMFaceConfiguration instance:

1. faceConfig.landmarks.isEnabled = true;  

For issue 3, using hearRate, calling QueryPulse as the documentation suggests

1. // cfg is a PXCMFaceConfiguration instance  
2. cfg.QueryPulse().Enable();  

ends up with a NullPointerException

1. Exception in thread "Animation Thread" java.lang.NullPointerException  
2.   at intel.rssdk.PXCMFaceConfiguration$PulseConfiguration.Enable(PXCMFaceConfiguration.java:335)  

I was expecting to write something like

1. faceConfig.pulse.isEnabled = true;  

but pulse doesn't appear to be a property of PXCMFaceConfiguration

For issue 4, using the Blob Algorithm, I tried following the documentation:

1. // Create an instance of the SenseManager  
2. PXCMSenseManager sm = PXCMSenseManager.CreateInstance();  
3.    
4. // Enable the blob module  
5. sm.EnableBlob();  
6.    
7. // Get an instance of PXCMBlobModule   
8. PXCMBlobModule blobModule = sm.QueryBlob();  

but EnableBlob() isn't present. I'm guessing EnableModule(int,ImplDesc) might work,

but I'm not sure what arguments to pass. Again, QueryBlob() is missing (perhaps QueryModule(int) should be used) ? If so, how ?

Regarind issue 5, I'm trying to use as the SDK as much I can, but it would be a huge time saver

knowing what I can an can not use for now (and when to expect currently unsupported features).

I am using the latest Intel RealSense Drivers and SDK AFAIK:

Intel RealSense Depth Camera Manager F200 1.3.20.55679

Intel RealSense SDK 2014 5.0.3.187777

on Windows 8 (version 6.2, build 9200)

Thank you,

George

[GProf]

@CaptGeek (Intel) , @Colleen Culbertson (Intel) Has anyone encountered these issues with the Java wrapper ? 
If so, how were these issues addressed ?

Thank you,
George

[Alexander_L_Intel]

There's no blob module done in Java in R3, and it most probably won't be in Java.
It is left in the doc - need to wipe off Java for blob.

[GProf]

Hi Alexander,

Thank you for getting back.

Can you please advise on using Face Landmarks and Pulse using the Java API ?

Thank you,
George