FaceAPI (Construct 3 Plugins)

  • 8
    This content is deleted
    Addon
    FaceAPI

    Integrates face-api.Js for face detection, landmarks.

You're viewing a single comment in a conversation. View all the comments →

  • 7 Comments

  • Order by

  • Can you point me to the aws link, so I can try it from my browser and see if I see errors?

    Answer to your other questions: no it cannot track hand movements (the model is not trained to recognize a hand.) You can check distance between eyes (in pixels) to get an idea of how close or far the face is from the camera.

    This algorithm is pretty GPU compute-intensive, so phones may not have enough of a GPU to have it work well (though I have tried on an iPhone XR and it works ok, but I mainly am using this on PC notebook and desktop for the game I am making.)

    • Here is the aws link.

      vserv-images.s3.amazonaws.com/adsunit/faceapi/index.html

      It is working fine on desktop but on mobile, face points not correctly syncing. I m using vivo nex with 8gb ram and latest gpu..so cant be processing power issue. Thanks for your support. Would love to see if you can guide me how Can i use to put glasses on eyes using this template.

      • Displaying on live video would be amazing and screenshot procedure could be removed from this (might be this is just my assumption) but I tried your suggested solution for live video and nothing worked. Might be something I did in a wrong way. Can you please share a c3 file for the same. It will be really helpful. Thanks in advance.

      • Try this for the dots(you can do something similar for the box), it scales the location based on the ratio of the display Sprite and the video input:

        -> System: Create object Dot on layer 0 at (JSON.Get("._x")×Sprite.Width÷(UserMedia.VideoWidth)+Sprite.X, JSON.Get("._y")×Sprite.Height÷UserMedia.VideoHeight+Sprite.Y)

        Another fun thing to do (but it will _lag_) is to display dots on the live video:

        -> System: Create object Dot on layer 0 at (JSON.Get("._x")×UserMedia.Width÷(UserMedia.VideoWidth)+UserMedia.X, JSON.Get("._y")×UserMedia.Height÷UserMedia.VideoHeight+UserMedia.Y)

        If you still see something is not right, play with the ratio / offset: ×Sprite.Width÷UserMedia.VideoWidth+Sprite.X (I have sometimes seen mobile with 2X the expected resolution.)