topic Hi Andre, in Software Archive

FaceExpression Enumeration

Brennon_W_ — Tue, 17 Mar 2015 14:50:56 GMT

Hi,

I am trying to execute the enumeration against the FaceExpression object - it would appear that there are only about 8 implemented at the moment when I send a query to ExpressionData.QueryExpression.

I note 22 items that should be recognised - is this just a case of them not being implemented yet?

Thanks for your help.

Cheers

Can you include your code

Colleen_C_Intel — Thu, 02 Apr 2015 20:39:02 GMT

Can you include your code please? (And which 8 are you getting?)

Hi Colleen,

Brennon_W_ — Thu, 02 Apr 2015 22:40:57 GMT

Hi Colleen,

I have the following method that creates a Dictionary entry for each element that as per the document, should be resolved:

        private void BuildExpressionLibrary()
        {
            //Brow Movements
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_BROW_LOWERER_RIGHT, @"Brow_Lowerer_Right");
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_BROW_LOWERER_LEFT, @"Brow_Lowerer_Left");
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_BROW_RAISER_RIGHT, @"Brow_Raiser_Right");
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_BROW_RAISER_LEFT, @"Brow_Raiser_Left");
                        
            //Mouth Movements
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_MOUTH_OPEN, @"Mouth_Open");
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_SMILE, @"Smile");
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_KISS, @"Kiss");
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_TONGUE_OUT, @"Tongue_Out");
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_PUFF_LEFT, @"Puff_Left");
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_PUFF_RIGHT, @"Puff_Right");

            //Head Movement
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_HEAD_TURN_LEFT, @"Head_Turn_Left");
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_HEAD_TURN_RIGHT, @"Head_Turn_Right");
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_HEAD_UP, @"Head_Up");
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_HEAD_DOWN, @"Head_Down");
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_HEAD_TILT_LEFT, @"Head_Tilt_Left");
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_HEAD_TILT_RIGHT, @"Head_Tilt_Right");

            //Eye Movement
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_EYES_UP, @"Eyes_Up");
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_EYES_DOWN, @"Eyes_Down");
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_EYES_TURN_LEFT, @"Eyes_Turn_Left");
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_EYES_TURN_RIGHT, @"Eyes_Turn_Right");
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_EYES_CLOSED_LEFT, @"Eyes_Closed_Left");
            this.ExpressionDictionary.Add(PXCMFaceData.ExpressionsData.FaceExpression.EXPRESSION_EYES_CLOSED_RIGHT, @"Eyes_Closed_Right");
            


        }

I never get any of the head or eye movement data, or the two PUFF items.

Cheers

So the different 'language'

Colleen_C_Intel — Thu, 02 Apr 2015 23:20:33 GMT

So the different 'language' types return different groups out of the 22 - at least 2 of them definitely return the puff and some of the eyes.
Can you quickly use the samples page and try the various face ones and you may have to mix and match to see what they're doing differently than you.

Hi Brennon,

AndreCarlucci — Tue, 07 Apr 2015 14:04:19 GMT

Hi Brennon,

I have some working code getting the eyes movement. Check it out here: https://github.com/andrecarlucci/SharpSenses/blob/master/SharpSenses.RealSense/RealSenseCamera.cs

Hi Andre,

Brennon_W_ — Wed, 08 Apr 2015 09:47:17 GMT

Hi Andre,

Thanks for the link to your project - really appreciate you sharing all that hard work.

I will progress with some further work on RS over the next few weeks and will dive a little further into your implementation.

Just to note, I see that your library requires 64bit. Any reasons for that? I only raise this as usage of the library in WPF or Store app scenarios may create small issues as the design surfaces of both platforms are 32bit only. (Had the same problem when I consulted on the Xbox one launch).

Thanks again,

Cheers

Hi Brennon,

AndreCarlucci — Wed, 08 Apr 2015 17:20:25 GMT

Hi Brennon,

The libraries provided by Intel are either x86 or x64 so I had to pick to one to create a nuget package.

You could easy change the code to work with x86, just swap the dlls with the ones you have in your SDK installation dir.

I'm working in a AnyCpu version of the library, also with some support for Javascript and Windows Store Apps using SignalR, but without an AnyCpu version of the original c# dll I don't know if it would be possible to support both architectures out of the box.

More details here: https://software.intel.com/en-us/forums/topic/549031 ;

Hi Brennon,

AndreCarlucci — Thu, 30 Apr 2015 02:32:54 GMT

Hi Brennon,

Just to let you know: the latest version of SharpSenses supports x86 or x64.

Cheers :)

https://github.com/SharpSenses/SharpSenses

Hi Andre,

Brennon_W_ — Wed, 06 May 2015 10:08:12 GMT

Hi Andre,

Thanks for the update!

Cheers

Hi Andre,

Brennon_W_ — Wed, 20 May 2015 01:09:56 GMT

Hi Andre,

Just wanted to ask if you are you working to adapt the library to R3?

Also, perhaps you have a license somewhere, but I couldn't find it. Can you point me to it when you get a chance please.

Thanks for your help.

Cheers

Brennon

Don't mind me Andre, Im an

Brennon_W_ — Wed, 20 May 2015 01:21:40 GMT

Don't mind me Andre, Im an idiot. Just found the LICENSE file.

Still, let me know if you are working on R3. I must say that I really like your implementation much better than how I've implemented it.

Cheers

Are all the expressions

Mona_J_1 — Thu, 02 Jul 2015 00:13:26 GMT

Are all the expressions mentioned in the SDK website supported? I can't get the head expressions to work. Here's my extended post on that:

https://software.intel.com/en-us/forums/topic/560883