Human Pose Estimator

Overview

This model detects humans and their poses in a given image. The model first detects the humans in the input image and then identifies the body parts, including nose, neck, eyes, shoulders, elbows, wrists, hips, knees, and ankles. Next, each pair of associated body parts is connected by a pose line. The pose lines are assembled into full body poses for each of the humans detected in the image. The model is based on the TF implementation of OpenPose model.

Model Metadata

References

• Zhe Cao, Tomas Simon, Shih-En Wei, Yaser Sheikh, “Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields”, CVPR 2017.
• TF-Pose-Estimation Github Repository

Licenses

Options available for deploying this model

This model can be deployed using the following mechanisms:

• Deploy from Dockerhub:

docker run -it -p 5000:5000 codait/max-human-pose-estimator

• Deploy on Kubernetes:

kubectl apply -f https://raw.githubusercontent.com/IBM/MAX-Human-Pose-Estimator/master/max-human-pose-estimator.yaml

• Locally: follow the instructions in the model README on GitHub

Example Usage

You can test or use this model

• using cURL
• in a Node-RED flow
• in CodePen

Test the model using cURL

Once deployed, you can test the model from the command line. For example if running locally:

curl -F "image=@samples/p3.jpg" -XPOST http://localhost:5000/model/predict

You should see a JSON response like that below:

{
  "status": "ok",
  "predictions": [
    {
      "human_id": 0,
      "pose_lines": [
        {
          "line": [
            110,
            53,
            91,
            53
          ]
        },
        {
          "line": [
            110,
            53,
            129,
            50
          ]
        },
        .
        .
        .
        {
          "line": [
            114,
            35,
            119,
            32
          ]
        }
      ]
    }
  ]
}

The information returned from the model can be used to construct and visualize pose lines for the humans detected in the image, such as shown in the example below. For more details see the GitHub README.

Test the model in a Node-RED flow

Complete the node-red-contrib-model-asset-exchange module setup instructions and import the human-pose-estimator getting started flow.

Test the model in CodePen

Learn how to send an image to the model and how to render the results in CodePen.

Links

• Use your arms to make music This interactive example application was built using a TensorFlow.js version of this model.