31 questions
2
votes
0
answers
134
views
How to compare two body poses detected with Vision’s VNDetectHumanBodyPoseRequest in Swift? [closed]
I’m working on an iOS app where I want to check if two poses are the same (e.g., matching a live yoga pose to a preset reference pose).
I use VNDetectHumanBodyPoseRequest to extract joint keypoints, ...
0
votes
0
answers
101
views
How to process pose, left hand, right hand, and face landmarks in the correct order using MediaPipe?
I am working on a project where I need to process pose landmarks, left hand landmarks, right hand landmarks, and face landmarks in a specific order using MediaPipe. However, the landmarks are not ...
-2
votes
1
answer
189
views
React-Native can't find function, but it's there
I'm developing an app with React-Native for Android. The app was supposed to use the ML Kit PoseDetection API of Google to count reps of an exercise. Right now I just want the app to open the camera, ...
0
votes
1
answer
328
views
How do I solve "Reading from _value directly is only possible on the UI runtime" in Reanimated?
I'm developing an app in React Native that uses the PoseDetection API by Google ML Kit.
It's a project for my university.
Here my package.json:
"dependencies": {
"metro-react-native-...
0
votes
1
answer
428
views
ML Kit PoseDetection cannot access Detector
I wanted to create an app via React-Native for pose detection by using ML Kit.
I used the instructions of the Google Ml Kit website and I used the following task:
poseDetector.process(image)
But when ...
1
vote
1
answer
563
views
Optimizing Pose Detection in React.js with TensorFlow.js: Addressing Lag and Hanging Issues
In my React.js code, I'm using the TensorFlow.js PoseNet model to detect multiple poses. When I get all the pose keypoints, I draw lines on each point pair (jointPairs).
It's working, but after 25 ...
0
votes
1
answer
753
views
How to use WebWorkers with @mediapipe/tasks-vision (Pose Landmarker)
I am trying to use a webworker to detect the pose each frame and then on the main thread I display the results but I am having some delay/sync issues.
I use next js 14.0.4 with @mediapipe/tasks-vision@...
0
votes
1
answer
250
views
ML-Kit Android pose detection landmark coordinate matching with preview
I am trying to draw points on landmarks by using the result of ML-Kit Pose Detection on Android app with Jetpack Compose.
First, I draw points (red points) by using the pure coordinates that obtained ...
3
votes
1
answer
376
views
Add keypoint Extraction Post-Processing Layer to TensorFlow Model
I have PoseNet Tensorflow saved model that takes in an image and outputs heatmap and offset tensors.
PoseNet is an already trained model from Google, and I've very little control over it. the model ...
1
vote
1
answer
365
views
MediaPipe Pose Landmarker Question - how to play a sound when certain pose is detected
First I'll apologize and explain I'm a UX designer, not really a developer, though I have a basic understanding of HTML, CSS, Javascript.
I want to create a super simple web-app based on this codepen ...
0
votes
1
answer
572
views
How to convert YOLOv7 model into core ML model for pose detection
How to convert YOLOv7 for pose detection into Core ML model to run model or application on ios device.
the refrence for the model is :
https://github.com/googlesamples/mediapipe/blob/main/examples/...
0
votes
0
answers
191
views
How to get 3D points with both CMSampleBuffer and AVDepthData in iOS17 with video session?
I want to get 3D points by using VNDetectHumanBodyPose3DRequest and VNImageRequestHandler in video session. And I have succeed by using VNImageRequestHandler.init(cmSampleBuffer:options:) without ...
0
votes
1
answer
1k
views
i could not installl a openpose library from c++ for pose detection
I have installed the OpenPose library for my pose detection project using C++. However, I am encountering difficulties with the installation process, particularly when trying to download models as per ...
0
votes
1
answer
264
views
Storing AVDepthData for processing in Swift
I'm trying to use VNDetectHumanBodyPose3DRequest to get 3D keypoints from videos taken in my app at 30 fps. Since the request takes too long to do in real time I'm saving the CMSampleBuffers from the ...
0
votes
1
answer
753
views
Mediapipe pose_landmarks out of range [0, 1]
It is written in the documentation of Mediapipe that: "x and y: Landmark coordinates normalized to [0.0, 1.0] by the image width and height respectively.", however I'm getting values out of ...
1
vote
1
answer
255
views
Framerate decreases after multiple video file loads on my MediaPipe Pose Detection Webserver
I am working on a MediaPipe solution where a user can choose a video on my web server, and then view the video with pose detection landmarks on top of the video. The following solution works ok, but ...
1
vote
1
answer
595
views
Error on running bazel build to use mediapipe pose detection
I want to use mediapipe pose detection in Android studio and I am trying to make. Aar file to use it. So on running
build -c opt --config=android_arm64 mediapipe/modules/pose_detection:*,
I am getting ...
0
votes
0
answers
467
views
mediapipe solution api pose detection VueJS
I want to use mediapipe in Vue.js to detect human pose, I have tried to replicate this example using Vue.js, but I didn't succeed, can you please tell me how can I do it? thanks in advance.
P.S: I ...
1
vote
1
answer
1k
views
ML Kit - pose graphic overlay Compose implementation not working as intended
I'm trying to implement JetPack Compose version of ML Kit pose detection using ML Kit Vision Quickstart Sample App
My issue is that the pose graphic overlay lines are flipped when the camera is set to ...
0
votes
1
answer
1k
views
Understanding the output shape of mediapipes tflite models for pose detection
I'm trying to use one of mediapipes pretrained tflite models to perform a pose landmark detection in android (java), which offers me information about 33 landmarks of a human body. I know there are ...
0
votes
0
answers
328
views
Mediapipe pose detect the person inside the rectangle
So I've drawn a rectangle on a video and now I want to detect the person inside the rectangle with mediapipe pose and not the one mediapipe pose defaults to show if there are many people.
Can someone ...
0
votes
0
answers
292
views
Google MLKit pose detection not executing onSuccessListener or onFailureListener
I am using MediaMetadataRetriever as well as MLkit to do pose detection on a saved video file. I have attached some of my code here:
public ArrayList<ArrayList<Float>> extractPoses() ...
0
votes
0
answers
150
views
Pose Detection vs Object Detection/Tracking
I am currently working on a new project aimed at tracking treadmill steps in an app via a front-facing camera. I'm still in the early idea phase and I'm trying to decide if it would be better/more ...
6
votes
0
answers
4k
views
How to implement MediaPipe pose library in React Native Expo
I am working on a module where I have to integrate pose detection in our mobile application. The mobile application is developed using the react native framework and the project is expo managed. We ...
7
votes
1
answer
15k
views
How to run MediaPipe's Pose Landmark Detection on a GPU
I am able to run MediaPipe's Pose Landmark detection on my Windows 10 computer by following this tutorial here: https://google.github.io/mediapipe/solutions/pose.html#python-solution-api, but I'm not ...
0
votes
1
answer
346
views
How can I do Holistic tracking on MLKit
I was wondering if there are any plans to have the Holistic Detection (face + pose + hand tracking) implemented in MLKit, or if there is an easy and efficient way to add the face and the hand ...
0
votes
1
answer
1k
views
No poses returned by estimatePoses in BlazePose TFJS pose detection
Trying to get BlazePose TFJS working in Angular 12. I have an empty project and have installed the requires packages (I think). Package.json looks like this:
{
"name": "posetrackingtest",
"...
0
votes
1
answer
663
views
Head 3d rotation and position with MLKit PoseDetection
I'm using the Pose Detection, and I tried to use the facial landmarks to calculate the 3d head position and rotation. But as said in MLKit's PoseDetection documentation, the z position for the face ...
0
votes
0
answers
944
views
Compute distance between skeletal keypoints in pose detection mlkits then store in Firebase datase
i'm using the google provide sample for pose detection in an android app.
I would get automatically distances beetween Keypoints placed by Pose (rightKnee to rightAnkle by example). I willing to store ...
1
vote
1
answer
421
views
How to evaluate results of PoseNet from TensorFlow Lite
I am using PoseNet from TensorFlow Lite library to detect key point on images. What is the best way to evaluate the results. I feed in images and get key points as a result. How can I say if the ...
1
vote
2
answers
3k
views
Pose Detection for squat with count using ML Kit
How can I get real time exercise count and angle using ML kit? Here, I check https://ai.googleblog.com/2020/08/on-device-real-time-body-pose-tracking.html for push up and squat exercise count.
I am ...