• 54.5 MB

    Размер файла

  • Android 9.0+

    Android OS

Oписание poseHook

оценка позы человека и потоковая передача данных OSC для музыки и исполнительского искусства

This is an app that continuously detects the body parts of a single person in the frames seen by your device's camera. It transmits the detected positions to a host in form of OSC messages. OSC is a UDP based protocol understood by many music or visual art software, e.g. TouchDesigner, Max for Live, Resolume Arena, etc.

You can download Ableton Live sets demonstrating OSC conversion to MIDI, and much more:

https://bitbucket.org/constanze/posehook/

Detected are: nose, eyes, ears, shoulders, elbows, wrists, hips, knees, and ankles. It is possible to configure the OSC address names, the minimum confidence and IP / port of the receiver. It doesn't support detection of multiple persons.

poseHook uses TensorFlow PoseNet lite for the detection. The OSC messages are sent as fast as they are detected. A frame rate of > 20fps is possible with a S10-like phone.

On host side, you can receive OSC messages with various kinds of musical or creative coding software. Note that the data is quite noisy, so you have to take that into account when creating an effect. Increasing the minimum detection confidence reduces the noise, but also filters some data.

Questions how to use poseHook? Or would you like to share your idea for improvement? Get in contact with us on twitter: @holllyhook (trippple L).

The person detection works to 100% offline, the data is neither saved nor shared, besides of the intended OSC usage.

poseHook is open source: https://bitbucket.org/constanze/posehook/

NB: this is poseHook v1. The next major release will integrate MediaPipe model instead of PoseNet, which is an incompatible change in output format. Sorry for that. The v1 apk will still be provided for sideloading. A preview of the v2 is already available if you opt in for beta testing.

ЕщёСкрыть

Что нового в последней версии v2.0

Last updated on 2021-06-24
Replaced poseNet model with improved BlazeNet from MediaPipe, see data sheet at https://google.github.io/mediapipe/solutions/pose

new in v2.0
- option to mirror X
- combine OSC
- camera flip (crashes sometimes)


For a limited time, you can view the poses detected by poseHook v2 online. For this, you have to send the OSC data to 18.192.229.240, and open http://ec2-18-192-229-240.eu-central-1.compute.amazonaws.com:8081 in the browser. Code is at https://bitbucket.org/constanze/posehook-demo
ЕщёСкрыть

Старые Версии poseHook

Супер Быстрая и Безопасная Загрузка через Приложение APKPure

Один клик для установки XAPK/APK файлов на Android!

Скачать APKPure